When Scott Schmith finally got his Swiss passport last month, it was time for him to take a drastic step: hand back his American one.

Among the reasons was a pending U.S. regulation aimed at tracking down tax cheats that is making life difficult for some Americans abroad. These expatriates say that foreign banks, which have expressed concern about compliance costs and potential penalties for failing to report on their American clients, are turning away their business.

The...