Story highlights Some Republican House members have criticized Speaker Paul Ryan

The criticism follows President Donald Trump striking a deal with Democrats

(CNN) President Donald Trump may have made a short-term deal this week to fund the government and raise the debt ceiling, but he's also placed House Speaker Paul Ryan in the crosshairs of the far-right members within his conference once again.

In a week that began with Trump punting the plight of 800,000 young immigrants to Congress and will end with a vote on major spending bill that Trump negotiated with House Democratic Leader Nancy Pelosi and Senate Minority Leader Chuck Schumer, Ryan's job only seems to be getting harder.

"We should have stayed here and put together a plan clear back in July on the debt ceiling," Rep. Jim Jordan, a Republican from Ohio and a member of the House Freedom Caucus, lamented Thursday about leadership's decision to go home for recess. "Lack of preparation sometimes puts you in a position where the choices aren't great. We should have prepared sooner that's why we said stay here not take the longest August recess in we've taken in 12 years in a non-election year."

Virginia Rep. Dave Brat, a member of the House Freedom Caucus, said on MSNBC Thursday that "everybody likes Speaker Ryan. It's just, we've got to aim at a target and hit it."

"Paul, to his credit, is always a nice guy and a gentleman to everybody, right?" Brat said. "But we need to lead and like this vote coming up, it's going to be won with a majority of Democratic votes and 100 to 150 Republicans are going to vote against the big bill tomorrow."

Read More