There's a lot to love about New York City today: A flood of new, ambitious architecture, refurbished river-fronts, miles and miles of additional bike lanes and recently launched parks like the High Line. New York is constantly evolving and changing.

Yet we can't help but mourn for yesterday's New York. So many historic spots have vanished in the eternal march of progress. Here's a few we miss:

1. The Original Penn Station

The original Pennsylvania Station was torn down in 1963 due to financial problems and replaced with a squat, hideous train station that's almost universally despised. The brutal demolition of such a beautiful, historic piece of architecture was a huge embarrassment for the city. As a result New York established the Landmarks Preservation Commission, which was tasked with saving the city's historic landmarks and avoiding further debacles.

2. CBGB

CBGB was once much more than just a T-shirt logo . The iconic music club is recognized for its key role in the 1970s and 1980s NYC punk scene and hosted everyone from Patti Smith to the Ramones. The spot closed in 2006 and the space is now home to a high-end clothing store.

3. The Hippodrome

Once billed as the world’s largest theater, the Hippodrome on Manhattan’s West Side was big enough to allow more than 1,000 actors to perform at the same time -- including famous magician Harry Houdini. The theater also boasted an 8,000 gallon water tank that could be raised for diving and swimming shows, before closing in 1939 in part due to the Depression and the increasingly popular movie business.

4. The Artist Apartments Above Carnegie Hall

Above the historic concert hall, Carnegie Hall Towers once provided affordable housing to dancers, photographers, poets and musicians. Marilyn Monroe, Mark Twain, Marlon Brando and Grace Kelly once hung out there, but the building's last remaining residents were pushed out in 2010 to create more rehearsal space.

5. Claremont Riding Academy

Until 2007, this stable gave just about anyone the chance to go horseback riding in Central Park, where the paths were designed with horses in mind. While a new stable has been built as a home for police horses, arranging a horseback ride in the park is now much more complicated.

6. Studio 54

In the late 1970s, Studio 54 became the city’s hottest night spot drawing countless celebrities like Michael Jackson, Mick Jagger and Woody Allen. Like all good parties, it had to end, however, and shut down after just three years.

7. The Gaslight Cafe

Jack Kerouac, Allen Ginsberg, Bob Dylan and Bruce Springsteen all performed at this basement cafe that became synonymous with the beat generation until closing in 1971. A tattoo parlor now sits above the old location at 116 Macdougal Street.

8. Old Waldorf-Astoria

Built in the 1890s, the original Waldorf-Astoria raised the bar for what a hotel could be. In 1929 the original location was sold to the developers of the Empire State Building and the hotel moved to a new location uptown.

9. The Sheep Meadow (When It Actually Had Sheep)

Before it hosted throngs of sunbathing New Yorkers, the Sheep Meadow in Central Park was home to grazing sheep.

The Sheep Meadow now.

10. 5pointz

November 19, 2013, will go down in history as a sad day for graffiti enthusiasts. 5pointz in Queens, once one of the largest spaces for graffiti artists to legally work in the city, was whitewashed overnight erasing graffiti works by some 1,500 artists. The abandoned factory, which once served as the artists' canvas, will be torn down to make room for luxury apartments.

11. Brooklyn Navy Yard

Brooklyn Navy Yard, 1890

While the site of the original Brooklyn Navy Yard remains, it hasn't been in use as a shipyard since 1966. Originally established by President John Adams in 1801, the shipyard was used to build merchant vessels. It's now home to a number of things including a movie studio, which is where the TV shows "Girls" and "Boardwalk Empire" are made.

12. Starlight Park