Washington (CNN) Sen. Rand Paul called out his fellow Republicans for "hypocrisy" in their budget plan after the GOP criticized President Barack Obama for adding to the US deficit during his time in office.

"The other thing is there's a huge hypocrisy factor. Republicans lambasted President Obama to no end for trillion-dollar deficits and now they have put forward a trillion-dollar deficit," the Republican from Kentucky told CNN's Erin Burnett on Thursday night.

"I think the American people are going to be surprised, upset, hurt that so the so-called conservatives got elected and then turned out to be not much different than the people they were criticizing," Paul added.

Congress was set to vote Thursday night on a deal to fund the government. Paul spoke on the floor in the hours leading up to the deadline, voicing opposition to unnecessary government spending. The deadline for a government shutdown is at midnight, and the White House has told federal agencies to prepare for a government shutdown.

While speaking on CNN's "OutFront," Paul also defended his own vote on tax cuts that are projected to add to the national debt, saying that when he votes for tax cuts, he also always votes for a "corresponding cut in spending as well."

Read More