(CNN) — The former Soviet Republic of Georgia is a country shrouded in mystery.

Georgia is sandwiched between the Caucasus Mountains to the north, the Black Sea to the west and deserts to the south, and it borders Russia, Azerbaijan, Armenia and Turkey. This small country is not only a crossroads of cultures but also has a wealth of spectacular landscapes.

Until recently, many would have struggled to place the country of Georgia on the map (or at least mistake it for the U.S. state of the same name), but it's emerging as a hot travel destination.

Here are nine places to see and enjoy when you visit Georgia:

1. Tbilisi: An eclectic melting pot

The thermal baths in the Abanotubani district of Tbilisi. Jennifer Walker

From the hanging balconies in the crumbling Old Tbilisi district and the Persian-style sulfur baths clad in turquoise mosaics, to unique art nouveau buildings falling into disrepair sitting side by side with futuristic glass structures, Tbilisi is a city that inspires.

The Georgian capital lies on the banks of the Mtkvari River and is surrounded by mountains on all three sides.

Archeologists trace the first settlement in today's Tbilisi to the 4th millennium BC. Its position on the old Silk Road turned it into a multicultural hub, reflected today in the city's ethnic diversity and eclectic architecture.

The baths in Abanotubani follow the Persian tradition, only the thermal water bubbles up naturally from the ground below.

Tbilisi gets its name from the Old Georgian word "tbili," meaning warm, because of its hot, sulfurous water.

Moving away from Abanotubani, a walk into the Old Town reveals old Georgian and Armenian churches, mosques and synagogues and even the ruins of the most northern Zoroastrian fire temple.

2. Ushguli: Europe's highest village

Way up in the Caucasus Mountains around 2,200 meters above sea level, this small village is Europe's highest continuously inhabited settlement.

Sitting at the foot of Mount Shkhara, Georgia's highest point, Ushguli is famous for the medieval defensive towers connected to each house.

It's deep in the Svaneti region, known for its unique culture that was once cut off from the rest of the country.

In the country of Georgia, Anthony Bourdain gets a taste of how locals cure hangovers. He's skeptical. "Parts Unknown," Sundays at 9 p.m. ET/PT

The main town of Mestia is on its way to becoming the Georgian equivalent of a Swiss resort but Ushguli has been saved by its poor transport routes, which have helped preserve the village's timeless feel.

Young men gallop through the dirt tracks on horseback between the crumbling towers, dodging the livestock in the street.

3. The birthplace of wine

When we think of the origin of wine we tend to think of France, Italy, Greece or Persia, but Georgia is in fact one of the world's oldest wine regions.

In 2003, archaeologists found evidence that Stone Age people were producing wine here up to 8,000 years ago.

Since then, wine has played a core part in Georgia's national identity.

Anthony Bourdain tucks into a traditional feast in the country of Georgia. But can he keep up with the required drinking? "Parts Unknown," Sundays at 9 p

The country's ancient tradition of fermenting grape juice in clay vessels, known as kvevris, has made it onto UNESCO's Intangible Cultural Heritage list. There are hundreds of indigenous grape varieties, and Georgian wine is slowly gaining recognition globally.

While some of the homemade varieties aren't particularly palatable, there are some excellent vineyards in Georgia producing premium wines.

A good place to start is with a red wine aged in oak barrels made from the Saperavi grape from Mukuzani in the wine region of Kakheti, such as those from Teliani Valley , or a white Tsinandali, made from a blend of Rkatsteli and Mtvani grapes.

4. Mysterious cave cities

The cave monastery at Vardzia was excavated from the slopes of Erusheti Mountain in the 12th century. Jennifer Walker

Georgia is home to some of the most unusual cave cities in Europe. By themselves, they're reason alone to visit the country.

The oldest is Uplistsikhe , an ancient settlement that resembles a lunar landscape. Others include Davit Gareja, a vast monastic complex carved into the rock of Mount Gareja, and Vardzia , a spectacular underground city that once housed 2,000 monks.

5. Supra: A traditional Georgian feast

One of the best ways to get to know the country is through its food. In fact, if you haven't tried a Georgian supra, or feast, you haven't experienced all Georgia has to offer.

The local cheese bread is called khachapuri, the most famous being the Adjaran variety. It's a baked bread boat filled with gooey, melted, tangy sulguni cheese, a whole egg yolk and some slivers of butter. Yes, it's heart stopping, but so delicious.

Khinkhali dumplings come with a spiced meat filling that releases its juices when cooked, so you have to suck out the stock before eating. Then there are delectable walnut dressing salads, bean stews cooked with fragrant cilantro and mtsvadi, tender marinated meat cooked on a kebab skewer.

They're best enjoyed, of course, with some excellent Georgian wine.

6. Remote mountain villages

The remote regions of Khevsureti and Tusheti in the Caucasus Mountains are home to spectacular medieval villages with small communities that still retain their ancient pagan traditions. The roads going up here are an adrenaline rush in themselves.

The ruined fortress of Mutso and the settlement of Shatili in Khevsureti look like something described by J.R.R. Tolkien. Set dramatically against the mountains, they're so close to Chechnya, you can see the border guards walking up and down the ridge.

Tusheti is a cluster of communities, kind of like a Georgian Shangri La, full of old towers, churches, villages and spectacular mountain scenery with wild flowers and trees with leaves that almost look golden.

Tusheti has numerous hiking trails and the locals are known for their generous mountain hospitality.

The village of Omalo in Tusheti is only accessible via the Abano Pass, at an altitude of 2,850 meters. Jennifer Walker

7. Europe's most surreal museum

To learn about the life of Old Joe, visit Stalin's hometown, Gori, and the bizarre Joseph Stalin Museum.

There aren't any references to the former Soviet leader's purges beyond a small backroom that doesn't feature on the tour, but there are pictures aplenty of Stalin, including one of the leader voting for himself.

There are also various statues, his death mask, carpets and frescoes featuring the leader's face, his personal green railway carriage and -- the star attraction -- his one-bedroom childhood home preserved in perfect condition.

The museum has been criticized for being a "falsification of history" and an example of "Soviet propaganda." There were plans to transform the museum into a museum of Russian aggression, but so far this is limited to a little room hidden beside the entrance.

It's worth visiting as it captures the essence of Stalin, including his own self-glorification and propaganda, even if that was not its intended purpose.

8. Beautiful and ancient churches

Georgia adopted Christianity back in 324 AD and the country is full of spectacular churches and cathedrals in incredible locations.

Whether it's the UNESCO World Heritage Sites of Mtskheta's Svetitskhoveli Cathedral or Kutaisi's Bagrati Cathedral, or the dramatic hill top position of the church in Kazbegi, Georgia's churches never fail to paint a pretty picture.

Kazbegi is also home to one of the world's most spectacular marathon routes.

9. The people and Georgian hospitality

Georgians might appear a serious bunch at first, but most are kind and welcoming. For Georgians, a guest is a sacred thing, and they will often go out of their way to help you. Their generosity and hospitality will often take the form of lots of food and even more drink.