Sen. Rand Paul’s (R-KY) said on Thursday it was “absurd” that Kentucky county clerk Kim Davis had been jailed for contempt after refusing to issue marriage licenses to same-sex couples.

“I think it’s absurd to put someone in jail for exercising their religious liberties,” the GOP presidential candidate and outspoken advocate of states’ rights told CNN on Thursday, shortly after Davis’ fate was decided by a U.S. District Court Judge David Bunning.

“This is really the problem when from on high we decide to get involved on a federal level with something that has always been a local issue,” Paul said.