Washington (CNN) President Donald Trump imposed tariffs on French wine, Italian cheese, and single malt Irish whiskey last year -- and could escalate them by the end of the week.

That's worrying owners of specialty shops, restaurants and importers, some of whom have already raised prices on customers.

"We're faced with a big dilemma. How much can we raise prices without losing our customer base," said Lou Di Palo, who runs the 110-year-old Di Palo's in Manhattan with his family.

Most of what they sell, including cheeses, meats and wine, is imported from Italy -- and that's not something Di Palo intends to change to avoid the cost of the tariff.

"If we have to shift a large portion of our inventory to American-made cheeses, then we'd be just like every other supermarket. That's not what people travel to Di Palo's for," he said.

Read More