Washington (CNN) Donald Trump thinks the United States should accept some refugees from Syria due to the "unbelievable humanitarian problem."

Trump has made anti-immigration rhetoric a cornerstone of his campaign, but the Republican presidential candidate said Tuesday evening that though the migrants could pose a security risk -- floating the idea that there may be individuals with ties to Islamic militants -- he supported allowing them into America.

"I hate the concept of it, but on a humanitarian basis, with what's happening, you have to," Trump said to Fox News' Bill O'Reilly.

The New York businessman spoke to O'Reilly hours after Kentucky clerk Kim Davis was released from jail after being imprisoned for declining to issue same-sex marriage licenses. Some Republicans have characterized her decision as an act of conscience that should be protected, but others have charged that government officials shouldn't let their personal beliefs get in the way of public services.

Trump puts himself in the latter camp.

Read More