(CNN) House Speaker Paul Ryan reiterated his support Wednesday for Donald Trump at a closed door meeting with House Republicans and asked his colleagues to unite behind the presumptive Republican nominee, according to several members who attended the session.

Ryan's backing of Trump comes a day after he blasted the businessman's remarks about a federal judge as a "textbook definition of a racist comment."

Trumps comments have sparked a fury on Capitol Hill where many Republicans worry that Trump's racially tinged criticism of Judge Gonzalo Curiel could ultimately hurt down-ballot GOP candidates competing in congressional races this year.

Though Ryan didn't back away from his endorsement, he said he would continue to speak out when he believed the billionaire businessman makes inappropriate statements.

Ryan spokesman said the speaker did not "urge" the party to fall in line behind Trump but stressed the importance of unity.

Read More