Peak party unity around Donald Trump came and went quickly for the Republicans this week.

Less than 24 hours after Trump secured the endorsement of House Speaker Paul Ryan, the speaker on Thursday disavowed the presumptive GOP nominee's latest controversial comments about a federal judge overseeing a fraud lawsuit against Trump University.

In an interview on Wisconsin radio Friday, Ryan slammed Trump for attacking U.S. District Judge Gonzalo Curiel, whom Trump believes is Mexican and biased against him.

"Look, the comment about the judge the other day just was out of left field for my mind," Ryan told WISN radio host Vicki McKenna. "It's reasoning I don't relate to. I completely disagree with the thinking behind that."

Then, Senate Majority Leader Mitch McConnell took a swipe at Trump for criticizing New Mexico Gov. Susana Martinez, a fellow Republican and rising political star. McConnell said Trump's comments about Martinez, the nation's only Latina governor, was "a big mistake" that could permanently wreck the GOP's ability to draw the Latino vote.

In a Wall Street Journal interview, Trump repeated his criticism of Curiel, after claiming the judge has been "very unfair" because he was of "Mexican heritage" and doesn't like Trump's zero-tolerance stance on illegal immigration. The billionaire businessman has made building a wall along the U.S.-Mexico border a centerpiece of his campaign.

"I'm building a wall," he said in an interview with the Wall Street Journal Thursday. "It's an inherent conflict of interest."

On Thursday, nearly a month after Trump vanquished his last two primary rivals, Ryan served up a tepid endorsement of the presumptive GOP nominee. But the House speaker also said he wouldn't bite his tongue if the former reality television star said something particularly outrageous, noting he'd called out Trump several times during the Republican primary campaign.

"It's no secret that he and I have our differences. I won't pretend otherwise," he wrote in an editorial published Thursday in the Janesville, Wisconsin, Gazette Extra. "And when I feel the need to, I'll continue to speak my mind," he said. "But the reality is, on the issues that make up our agenda, we have more common ground than disagreement."

It was a point he reiterated Friday.

"He clearly says and does things I don't agree with," Ryan said. "And I've had to speak up on time to time when that has occurred, and I'll continue to do that if that's necessary. I hope it's not."

Unlike Ryan, Senate Majority Leader Mitch McConnell did not delay in embracing Trump as the party's standard-bearer. But McConnell criticized Trump for going after Martinez, who is the chair of the Republican Governors Association, because she hasn't backed him for president.

"I thought it completely unfortunate and unnecessary for our nominee to attack the governor of New Mexico, Susana Martinez, who I know well," he said on MSNBC Friday. "I think these attacks don't serve the candidate very well."

At a rally in Albuquerque last week, Trump said Martinez, who has not endorsed him, was "not doing the job."

"Hey, maybe I'll run for governor of New Mexico," he said. "I'll get this place going. We've got to get her moving. Come on, let's go governor."

Should he continue in this vein, McConnell fretted on CNN Thursday, Trump could alienate Latinos against the Republican Party, turning them against the GOP like Arizona Sen. Barry Goldwater -- an opponent of the landmark Civil Rights Act of 1964 -- did with African-Americans when he ran for president.

"It did define our party, for at least African-American voters, and it still does today," McConnell said. "That was a complete shift that occurred that year and we've never be able to get them back. So I think it was a defining moment for Republicans with regard to the accomplishments that we had made for African-Americans going back to the Civil War."

Trump has since softened his tone on Martinez, telling the Santa Fe New Mexican he would like her support.