(CNN) Donald Trump's racially-charged comments about federal judge Gonzalo Curiel might have proven to be an embarrassment to top Republican Party officials, but some advisers to the presumptive GOP nominee argue the billionaire businessman is also voicing what many inside the party often keep to themselves.

"He's saying what a good amount of people are thinking and don't want to say," said one Trump adviser.

During two Sunday morning show appearances, Trump refused to back down from his comments that Judge Curiel should recuse himself from handling lawsuits against Trump University due to his Mexican heritage. Curiel is an American citizen, born in Indiana, and is of Mexican descent.

"(Trump) should put a filter there," said one adviser. "I don't think he's inherently racist," the adviser added, noting Trump is "not a practiced politician."

"We're in a politically correct world and he's never been political correct," said another Trump source. But Trump's capacity to stir up a whirlwind of negative media coverage with incendiary rhetoric is weighing on top Republican officials.

Read More