Boehner, whose last two years as speaker already have been mired in grousing from conservative groups, is again being hit this week from the far right over his counteroffer in fiscal-cliff negotiations with the White House to raise $800 billion in revenue by closing special-interest loopholes and tax deductions. Some groups are casting this as his seeming openness to breaking a promise not to raise taxes.

Adding to that anger has been other news this week that the speaker and his House GOP steering committee had purged four conservatives from their coveted committee seats, at least three of whom have been butting heads with party leaders over government spending and the federal deficit. This just weeks after Boehner had pleaded for unity in a private conference call to fellow House Republicans on the day after the Nov. 6 election.

For this anger to result in Boehner losing his speaker's gavel, explained Ryun to National Journal on Thursday, enough conservative members need to show "some guts" and publicly rebel.

He says his group is looking at a list of about 100 conservatives whom they will try to persuade to step up, go public with their disappointment in Boehner, and show they are willing to take the risks and potential punishment Boehner has already shown he will dish out if such an effort fails.

In fact, there was already some murmuring within the House Republican conference itself about potential maneuvering in the upcoming speaker election as a way to express conservative discontent, say House GOP sources familiar with such talks.

But each of those who spoke -- all on the condition they not be identified -- also underscored that they've seen no concerted effort yet to organize anything beyond some conservatives saying they might simply vote "present" instead of specifically for Boehner. Even doing that would bring potential punishment from top leaders, because the votes are public.

Boehner spokesman Michael Steel responded on Thursday by pointing out that the Ohio Republican last month "was honored to be selected by the House Republican Conference to be its candidate for speaker." In fact, there was only one other candidate nominated in that closed-door process. And the nomination by Rep. Louie Gohmert, R-Texas, of former Speaker Newt Gingrich did not even receive a seconding. But there was no actual roll-call vote, and Boehner was selected by acclamation.

For their part, House Democrats reelected Nancy Pelosi as their leader, and also their nominee to be speaker.

Under normal circumstances, Boehner's reelection as speaker on Jan. 3 should be automatic. House Republicans are set to enter the new Congress holding 234 seats and the Democrats will have 200 seats (one of the House's total 435 seats is to be vacant with the resignation last month of former Rep. Jesse Jackson Jr. of Illinois). But the linchpin of the conservative "oust-Boehner" strategy being floated rests on the requirement that to be elected as speaker, a candidate must receive an "absolute majority" of all House member votes cast for individuals.