Mike Huckabee spoke outside a Kentucky jail Tuesday afternoon alongside county clerk Kim Davis, who was imprisoned for refusing to issue marriage licenses to gay couples.

A judge ordered Davis to be released after six days in jail.

The latest order from U.S. District Judge David Bunning directed Davis not to "interfere in any way" with marriage licenses now being issued by her deputy clerks.

Huckabee declared that if Davis is ordered back to jail, he would go in her place.

"If somebody needs to go to jail, I'm willing to go in her place," said Huckabee, adding that he's tired of seeing the Christian faith "criminalized."

Huckabee called Davis "incredibly brave" for deciding that her religious convictions were more important than her freedom.

Huckabee said he believes Davis has "ignited something across this country" when it comes to anger over judicial actions that infringe on religious liberty.

Davis' attorney, Mat Staver, would not specifically say what Davis will do when she returns to work. Staver maintained that Davis will not violate her conscience and that licenses issued by the deputies are not valid.

Watch Huckabee's comments above, plus hear from the former Arkansas governor tonight at 10p/1a ET on "Hannity."