An emotional Kentucky clerk spoke to a large crowd gathered outside the jail from which she was released Tuesday, amid the controversy over her refusal to issue marriage licenses to gay couples.

"We serve a living God who knows exactly where each and everyone stands," said Kim Davis, who was introduced by presidential candidate Mike Huckabee. "Keep pressing, don't let down because he is here."

U.S. District Judge David Bunning warned in a court document that Davis, the Rowan County Clerk, should not interfere with the licenses that her deputies have been granting since she was jailed last week for defying court orders.

Davis, 49, has spurned repeated court orders to allow same-sex marriage licenses. She has said granting the licenses would violate her Christian beliefs.

Standing with a visibly emotional Davis, her attorney, Mathew Staver, told reporters outside the jail that she would not violate her conscience when she returned to work. “She loves God, she loves people, she loves her work and she will not betray any of these three."

Read More