Universal Basic Income (UBI) is a policy that tends to attract a lot of lovers and haters alike. The New York Times’ Eduardo Porter is a hater. In a recent column, he warned readers against the idea that the government should give each adult citizen a regular, set amount of cash. It’s an expensive plan that would wind up hurting the poor, he argues. The only way to pay for it would be through massive tax increases and eliminating social welfare programs.

This would be a sound argument if it didn’t miss the point. UBI isn’t really about welfare spending: It’s about tax policy.

UBI is an unconditional cash transfer, which means that you get money from the government to spend however you want. That’s an unusual government spending program. In the US, besides Social Security, the government usually either spends money on a service (like health care or education) or gives conditional cash in the form of things like food stamps.

But the government also spends a lot of money each year on cash transfers through “tax expenditures,” which is the money the government doesn’t collect in taxes because of exclusions in the tax code. Except for the Earned Income Tax Credit, those expenditures almost always help the rich more than the poor. By replacing them with UBI, we would create a more progressive system. That, not the elimination of all government programs, should be the starting place for debates about UBI.

When people file taxes, most claim a “standard deduction” and “personal exemption,” two policies that combine to subtract about $10,000 from your taxable income. If you make over $38,000 in a single household, you save about $2,500 a year on your taxes, because your marginal tax rate is 25 percent (in this case, 25 percent times $10,000). If you make over $415,000, it’s worth $3,960 a year, because your tax rate is 39.6 percent. So, the higher your tax bracket, the more the deductions are worth.

What’s more, the richest 20% of Americans form the vast majority of those who deduct even more than $10,000 because of their ability to “itemize” deductions. Although only one-third of tax filers itemize, they deduct a lot. That’s because they pay more in state and local taxes, have more expensive houses (and therefore more mortgage interest), and give a lot to nonprofits.

A 2013 report by the nonpartisan Congressional Budget Office said that the richest 20% of Americans make up 81% of the value for the three biggest itemized deductions (state and local taxes, mortgage interest, and charitable giving). That same report said that the benefits of those deductions “equal less than 0.1% of after-tax income for the lowest income quintile, 0.4% for the middle quintile, 2.5% for the highest quintile, and 3.9% for the top percentile.” The three of them cost a combined $185 billion a year.

Many would oppose eliminating the charitable and mortgage interest deductions—it would be more expensive for rich Americans to put their names on college buildings and pay off the mortgage on their expensive houses. That said, Americans would be able to choose to put the money they received each month toward their mortgages or toward charitable donations. One could argue that since the majority of Americans do not use the charitable deduction now, UBI could even encourage more donations throughout the year.

So, if tomorrow we gave everyone $2,500 a year through UBI but eliminated the standard deduction, personal exemption, and itemized deductions, most people earning above $37,000 wouldn’t receive any new money. Those earning above $91,000 would actually lose money.

But that’s not all. If UBI were considered regular income, wealthy people lose even more money compared to the current system. Consider again the $2,500 example. Since the richest face a 39.6% marginal tax rate, they would actually only get $1,510 from the government after taxes. In the past, had they claimed the standard deduction and personal exemption and had there been no UBI, they would have gotten about $3,960.

UBI does not necessarily mean more free money for everyone. To pay for even this modest program, we may need to raise some new taxes even after ridding the tax code of deductions. And to be clear, eliminating deductions and exemptions is a tax increase on wealthier individuals. They would have to pay more than they do now and would get less money. But lower income Americans would get more.

Advocates of UBI talk about $10,000 or $20,000 annual cash transfers. But UBI itself just means giving people some sum of money—there’s nothing that says it has to be extremely expensive at the start. The case described above is about the relatively limited amount of $2,500. And the beauty of it being universal is that it could have broad political support, just like the current standard deduction and personal exemption have now. The difference is that, while those deductions and exemptions are regressive and popular, UBI would be progressive and popular.

Over time, perhaps, there could be political support for increasing UBI above $2,500. Perhaps as the amount increased, fewer social welfare programs would be needed and therefore eliminated. But it would be a slow process. UBI would first be, and indeed is, tax policy, and all of us—even the haters—ought to treat it that way.