Conservatives in the House may be losing patience with Speaker Paul Ryan, as one lawmaker called for Ryan to take on a "nonpartisan" leadership style or step down.

""We can fix it, but we need either a change in direction from this speaker, or we need a new speaker," Michigan Republican Rep. Justin Amash told his constituents while answering a question about partisan gridlock in the federal government.

"It's very difficult to address because the people in charge, namely the speaker of the House and the Senate majority leader or the president of the United States, don't seem too interested in addressing it," Amash said. "They're not that interested in breaking the partisan gridlock."

Amash is a member of the House Freedom Caucus, the group of about 30 mostly tea party-aligned conservatives whose hard-line tactics led to former House Speaker John Boehner's resignation in 2015. In courting their support to be speaker, Ryan promised to overhaul the way the House GOP wrote legislation to be more welcoming to ideas from the rank-and-file.

But on Monday, Amash said Ryan, President Donald Trump and the "Trumpstablishment" were instead directing decision-making from the top.

According to CNN, Amash showed voters at the town hall a piece of paper he said was instructions from Ryan's leadership team on how to talk to his constituents while home in his district for Easter recess.

"When we go home for the weekend, they give us a set of talking points. They say 'here are your talking points,'" Amash said. "That's not the way you're supposed to represent a community."

Relations between the Freedom Caucus members, who control enough votes to deny Ryan a Republican majority on any legislation, and the White House have similarly deteriorated.

While many in the caucus were more inclined to support Trump's presidential bid than Republicans at large, they drew ire from Trump and his aides for their role in sinking the GOP plan to overhaul Obamacare last month.

"It would have been actually very embarrassing, and that's why they pulled it," Amash said. "There were more non-House Freedom Caucus members opposed to it than House Freedom Caucus members."

Trump blamed the group in a tweet after the bill went down, yanked from the floor before the vote when it was clear it would not pass.

"The Freedom Caucus will hurt the entire Republican agenda if they don't get on the team, & fast," he wrote. "We must fight them, & Dems, in 2018!"

White House social media director Dan Scavino Jr. targeted Amash personally, tweeting that the four-term Michigander "is a big liability" to Trump's plans.

"#Trumptrain, defeat him in primary," Scavino tweeted on April 1.

But Ryan has taken a different tack, sympathizing with the president's frustrations while at the same time pressuring his members to stick together – or else Trump might do the unthinkable and cut a deal with Democrats.

"I don't want that to happen," Ryan said last month.