Washington (CNN) Rep. Paul Ryan is telling House Republicans privately he is considering running for speaker, several members say.

Ryan informed several members on the House floor of his deliberations, Rep. Chris Stewart, R-Utah, told CNN. Stewart added that he urged Ryan to run, with the Wisconsin Republican replaying that he was "thinking and praying on it."

Majority Leader Kevin McCarthy, who shocked Capitol Hill by deciding Thursday not to try and succeed retiring Speaker John Boehner, also said Ryan is weighing a run.

"Paul's looking at it but it's his decision," McCarthy said on CNN. "If he decides to do it, he'll be an amazing speaker but he's got to decide on his own."

Rep. Darrell Issa, R-California, said that Ryan told him privately he is thinking about it as well. "I think he's gone from a 'hard no' to he knows he has to consider it," he said.

Ryan, the Ways and Means Committee chairman and Mitt Romney's vice presidential running mate in 2012 is respected throughout the conference and on paper could bridge the gap between tea party-linked conservatives and more establishment Republicans.

Romney even called Ryan and asked him to run, an aide to the former presidential candidate said.

"I wouldn't presume to tell Paul what to do, but I do know that he is a man of ideas who is driven to see them applied for the public good," Romney said in a statement. "Every politician tries to convince people that they are that kind of leader; almost none are -- Paul is. Paul has a driving passion to get America back on a path of growth and opportunity. With Paul, it's not just words, it's in his heart and soul."

There may be no way for Ryan to avoid the calls to run.

"He needs to do this for the team," said Energy and Commerce Committee Chairman Fred Upton, R-Michigan.

"There's going to be a lot of pressure on Paul," said Rep. David Jolly, R-Florida. "If Paul really means no, he better keep his phone off the next two weeks. Or throw it in Lake Michigan."

Ryan spokesman Brendan Buck issued a statement following Friday morning's GOP conference meeting, that did not rule out a run. "Chairman Ryan appreciates the support he's getting from his colleagues but is still not running for speaker," Buck said.

Leaving Capitol Hill Friday afternoon, Ryan declined to comment on his decision.

"Right now I'm going to make my flight so I can make it home for dinner," he told reporters. "Sorry guys I'm just going to go. The Packers are at home. They're going to beat the Rams and cover the spread."

Boehner's plea: work together

Boehner indicated to his fellow Republicans on Friday morning he will stay as long as possible in the speaker's job, although he still wants to "be out of here by the end of the month," Rep. Dennis Ross said, adding that Boehner urged members to "hang in there."

The speaker pled with his fellow Republicans to work together to break the impasse.

"While we go through this process, we've got to continue to address the people's priorities. This institution cannot grind to a halt," Boehner said in the meeting, according to a source in the room.

Several high-profile issues face Congress and the White House later this year, including the need to address the debt limit in early November and the federal government budget by December 11.

Boehner urged GOP lawmakers not to put up barriers between each other. "Don't start erecting walls between us as members. We all came here to help advance the conservative cause," he said.

"It's not helpful for one group of members to say they will only vote for this candidate on the floor," he added. "And it's not helpful for another group of members to say they will only vote for different candidate on the floor. It's up to the people in this room to listen to each other, come together, and figure this out."

He later said: "Time for us to take the walls down, open up our ears and listen to each other."

And addressing rumors that he might step down as majority leader, McCarthy told his fellow Republicans he plans to remain in the job, a source in the room said.

The meeting was centered on the rules and process going forward, members said.

"We are doing what needs to be done, said Rep. Scott Rigell, R-Virginia. "And Kevin (McCarthy) spoke very eloquently this morning and said, 'if this causes us to do what we need to do in terms of reforming the rules and the House rules. Then that's a good thing."

Can Ryan unite the caucus?

As the surprise of McCarthy's decision not to seek the top job wore off Thursday afternoon, eyes turned to Ryan, the former vice presidential nominee and chairman of the Ways and Means Committee. Influential and well-respected throughout the GOP caucus, Ryan could be a peacemaker between the warring factions.

Deputy Majority Whip Tom Cole, R-Oklahoma, also wants Ryan in the job.

"I think eventually Paul Ryan will get into this thing, I really do," Cole said Friday on MSNBC's "Morning Joe." "I think we've had two guys fall on their swords for the good of the conference. In this case it's hard not to step up when there's an overwhelming demand."

And for good measure, he added an appeal to Ryan's sense of duty.

"Paul's got a strong sense of doing the right thing," Cole said. "I'm just so confident he'll make the right choice."

Photos: Paul Ryan, rising GOP star Photos: Paul Ryan, rising GOP star Rep. Paul Ryan, R.-Wisconsin, was elected the 54th speaker of the U.S. House of Representatives on Thursday, October 29, after receiving the votes of 236 members. The vote was largely a formality after House Republicans nominated him for the position on Wednesday, October 28. Hide Caption 1 of 25 Photos: Paul Ryan, rising GOP star Ryan announced Monday, January 12, that he would not run for president in 2016, preferring instead to focus on policy work as chairman of the House Ways and Means Committee. Ryan, the GOP's 2012 vice presidential nominee, has long been seen as a top contender for the presidency. Hide Caption 2 of 25 Photos: Paul Ryan, rising GOP star Ryan, center, speaks with Rep. Devin Nunes, R-California, before a House Ways and Means Committee meeting on March 12, 2014. Hide Caption 3 of 25 Photos: Paul Ryan, rising GOP star Ryan and his wife, Janna, arrive at a state dinner at the White House in honor of French President Francois Hollande on February 11, 2014 . Hide Caption 4 of 25 Photos: Paul Ryan, rising GOP star Willie Robertson of the reality TV series "Duck Dynasty" poses for a picture with Ryan and his wife, Janna, before President Obama delivers his State of the Union address on January 28, 2014. Hide Caption 5 of 25 Photos: Paul Ryan, rising GOP star Ryan speaks at the Conservative Political Action Conference in National Harbor, Maryland, on March 15, 2013. Hide Caption 6 of 25 Photos: Paul Ryan, rising GOP star Ryan greets supporters during a presidential campaign rally with Mitt Romney at The Square at Union Centre in West Chester, Ohio, on November 2, 2012. Hide Caption 7 of 25 Photos: Paul Ryan, rising GOP star Rep. Paul Ryan of Wisconsin speaks during a campagin stop at the Iowa State Fair in Des Moines on August 13, 2012. It was the newly minted GOP vice presidential candidate's first solo stop since becoming Romney's running mate. Hide Caption 8 of 25 Photos: Paul Ryan, rising GOP star Ryan speaks after Romney announced him as his running mate in Norfolk, Virginia, on August 11, 2012. Hide Caption 9 of 25 Photos: Paul Ryan, rising GOP star Romney introduced Ryan as his running mate in front of the USS Wisconsin. The seven-term congressman provides a strong contrast to the Obama administration on fiscal policy. Hide Caption 10 of 25 Photos: Paul Ryan, rising GOP star Romney jokes with Ryan in April 2012 during a pancake brunch at Bluemound Gardens in Milwaukee. Hide Caption 11 of 25 Photos: Paul Ryan, rising GOP star Ryan looks on as Romney greets people June 18, 2012, during a campaign event in Janesville, Wisconsin. Hide Caption 12 of 25 Photos: Paul Ryan, rising GOP star Ryan speaks while campaigning for Romney at a textile factory in Janesville, Wisconsin, on June 18, 2012. Hide Caption 13 of 25 Photos: Paul Ryan, rising GOP star Ryan, left, and Romney greet each other on stage April 3, 2012, during the primary night gathering at The Grain Exchange in Milwaukee. Hide Caption 14 of 25 Photos: Paul Ryan, rising GOP star Ryan introduces Romney at a town hall meeting in Milwaukee, Wisconsin, on April 2, 2012. Hide Caption 15 of 25 Photos: Paul Ryan, rising GOP star Ryan is introduced before speaking about the federal budget at Georgetown University on April 26, 2012. Hide Caption 16 of 25 Photos: Paul Ryan, rising GOP star Ryan holds a news conference in December 2011 in Washington to introduce a package of 10 legislative reforms designed to revamp the budget process. Hide Caption 17 of 25 Photos: Paul Ryan, rising GOP star Ryan listens as Ben Bernanke, chairman of the U.S. Federal Reserve, speaks at the Committee for a Responsible Federal Budget annual conference in Washington on June 14, 2011. Hide Caption 18 of 25 Photos: Paul Ryan, rising GOP star Ryan looks over papers as he waits for other House Republicans to arrive for a news conference in the Capitol Visitors Center in 2010. Hide Caption 19 of 25 Photos: Paul Ryan, rising GOP star Ryan speaks to the media in 2009 about President Barack Obama's 2010 budget proposal. Hide Caption 20 of 25 Photos: Paul Ryan, rising GOP star Ryan, left, and Sen. Judd Gregg of New Hampshire speak to reporters about the 2010 federal budget. Hide Caption 21 of 25 Photos: Paul Ryan, rising GOP star Then-Budget Committee Chairman John M. Spratt Jr., left, and ranking member Ryan listen to Federal Reserve Chairman Ben Bernanke testify during the House Budget hearing on the economy on January 17, 2008. Hide Caption 22 of 25 Photos: Paul Ryan, rising GOP star Ryan follows President George W. Bush off of Air Force One at General Mitchell International Airport - Air Reserve Station in Milwaukee on July 11, 2006. Hide Caption 23 of 25 Photos: Paul Ryan, rising GOP star Ryan speaks at a Cato Institute briefing on Medicare reform in the Rayburn House Office Building in Washington on July 22, 2003. Hide Caption 24 of 25 Photos: Paul Ryan, rising GOP star Speaker of the House Denis Hastert, left, administers the oath of office to Ryan at the beginning of his first term as representative of Wisconsin on January 6, 1999. Hide Caption 25 of 25

Boehner and Ryan have a long relationship: Ryan volunteered for Boehner's campaign when he was a student at Miami University in Ohio in the 1990s, before launching his own political career. But Boehner has not publicly called on Ryan to replace him.

On paper, Ryan is a strong candidate. But his backing among the current House leadership could be a drag on his candidacy, as the conservative backlash against Boehner's team shows no sign of abating.

Conservatives do praise many of Ryan's policy positions, yet are already warning Ryan would need to agree to a series of demands to change House rules and agree to their policy agenda.

Rep. Charlie Dent, a moderate and critic of the Freedom Caucus, said more needs to change than just the man or woman in the chair.

"At the end of the day, it's not who we put in that job," Dent said on CNN. "If we don't change the political dynamic, the next speaker will suffer the fate that John Boehner did."

"We must assemble bipartisan coalitions to pass any meaningful legislation," Dent added. "That's the way this place has been operating. We have to accept that reality and move forward."

Rep. Mimi Walters, a California Republican, called for compromise in selecting the next speaker. "I think we all need to give a little bit," she said on CNN. "We're never going to find the perfect person because nobody is perfect but what we have to remember is we have to put the American people first."

Democratic Rep. Luis Gutierrez on MSNBC called Ryan one of the smartest men in the GOP.

"He would be good for the country," Gutierrez said. "He would be good for the Republican Party. Paul Ryan is the kind of individual that would work with people on the other side of the aisle and that's what we need.'"

Chaffetz won't run if Ryan does

Friday morning, Rep. Jason Chaffetz, the Utah Republican whose candidacy helped draw people away from McCarthy, said he would drop out of the race if Ryan runs, a sign conservatives are willing to rally behind the Wisconsin Republican.

"He's certainly in my mind the most qualified person to do it and I hope he'll do it," Chaffetz said on MSNBC.

Other names that Cole said could be viable if Ryan stands firm and doesn't run include Minnesota Rep. John Kline and Georgia Reps. Lynn Westmoreland and Tom Price. Westmoreland told CNN he was considering it. And Cole's own name has been floated by his peers -- something he said Thursday he wouldn't rule out, though he said there were "better" options than himself.

And Rep. Daniel Webster, R-Florida, who won the Freedom Caucus' endorsement, also remains a candidate. Webster Friday said he is still running but left open the possibility of abandoning his bid if he does not win support in conference.