Jeffrey Epstein was worth an estimated $559 million, yet he may have paid little in the way of personal income taxes. The late financier, accused of sexually assaulting and trafficking girls as young as 14, had more than $179 million in assets from real estate, including a New Mexico ranch, a home in Palm Beach, Florida, a residence in Paris and a private island in the U.S. Virgin Islands — Little St. James. The Virgin Islands has its own system based on the tax laws and rates that apply in the U.S., according to the IRS, yet some tax-incentive programs there also make it possible for residents to reduce their federal income tax liability by as much as 90%. "Epstein, if he didn't spend more than 183 days in the U.S., could take advantage of being a resident in the Virgin Islands and possibly reduced his tax liability," said Timothy Speiss, a CPA and partner in the personal wealth advisors practice of EisnerAmper LLP. Claiming residency in a low- or no-tax jurisdiction typically means spending 183 days a year there for starters. According to reports, Epstein changed his residence to his Virgin Islands estate nearly a decade ago.

Little St. James Island, one of the properties of financier Jeffrey Epstein, is seen in an aerial view near Charlotte Amalie, St. Thomas, U.S. Virgin Islands July 21, 2019. Marco Bello | Reuters

If there's one thing rich people like, it's saving on taxes. More often, high-income residents in tax-heavy states such as New York and New Jersey consider moving to an income tax-free haven such as Florida for just that reason. Similarly, it takes six months and one day to establish residency in Florida, where there are also zero taxes on Social Security and retirement income. By comparison, New Yorkers are paying some of the heftiest state income taxes nationwide. The top income tax rate in New York is 8.82% and combined New York City and state taxes are about 12.7%. Over the last decade, the Sunshine State has been the most desirable destination by far for older Americans, as measured by average annual net migration for the 55-plus set, according to an analysis of Census Bureau data by William Frey, a demographer at the Brookings Institution. Tack on the new $10,000 cap on the state and local tax deduction on federal taxes, a feature of the Tax Cuts and Jobs Act, and it becomes only more attractive. For those at the very high end of the income spectrum, the tax savings can be in the millions, according to Mike Savage, a certified public accountant and chief executive officer of 1-800Accountant, which offers financial services to small business owners. However, New York is getting more aggressive about going after people it considers taxpaying residents, so skirting that tax bill is no easy feat. For one thing, income taxes make a significant contribution to states' coffers. Nearly 40% of state tax collections come from levies on wages, according to the Tax Foundation. More from Personal Finance:

Five reasons why your high-tax state won't let you move out

Retirees are flocking to these 'hot' spots

4 tips to prepare your finances for retirement abroad New York conducted about 3,000 "nonresidency" audits a year between 2010 and 2017, collecting around $1 billion, according to Monaeo, a company that sells an app for tracking and proving tax residency. To that end, state tax agents will look at all available records such as credit card charges, utility bills, property taxes, DMV records, voter registration and doctors visits. The onus is on the taxpayer to account for their whereabouts outside of New York, Savage said. "It's guilty until proven innocent." "You literally have to be outside of New York state for 183 days and prove it by taking a picture of yourself with a newspaper every day."