Independent Federal MP Bob Katter says Opposition Leader Tony Abbott will be harshly judged over his failure to honour a deal to allow pairing of the speaker in Parliament.

The deal, made by the two major parties and the independents after the federal election, would have made sure the speaker's side of politics was not disadvantaged by donating a member to sit in the speaker's chair.

Yesterday Mr Abbott confirmed that he was walking away from the agreement, saying the deal was unconstitutional.

It is now likely the Government will be forced to nominate a Labor speaker, which will reduce its majority from two to just one vote in the House of Representatives.

It means even a single absence from the Government's ranks could lead to defeat on the chamber floor.

Mr Katter says Mr Abbott's approach will undermine the Coalition's cause.

"I think he has established a most unfortunate reputation for himself," he said.

"I think he is going in there with an adversarial attitude and is not seeing the bigger picture and I think that he's making a very bad political judgement there.

"The people are also sick and tired of this sort of approach.

"I have told a number of high-ranking Liberals in the Parliament that I don't think their cause is best served by simply making trouble at this early stage."

Independent MP Tony Windsor has already described Mr Abbott's actions as a "breach of trust".

But manager of opposition business Christopher Pyne has defended Mr Abbott.

"Two parties can make an agreement, but if it turns out that the agreement is constitutionally invalid or illegal, then the sensible course is to recognise that and to alter it and move on," he said.

The Opposition has also indicated it may not pair ministers who have to travel overseas on government business.

New Liberal whip Warren Entsch is giving no guarantee the Coalition would pair a Labor MP's vote in the case of a trade or defence minister travelling overseas.

"To just expect it's going to happen so that somebody can have an overseas jaunt is highly unlikely," he said.

Treasurer Wayne Swan says he will be forced to cancel commitments outside Parliament if the Opposition refuses to pair in votes.

"It's going to make the operation more difficult - there's no doubt about that," he said.

"It's a pity the Liberal Party has decided they want to be as destructive as they now appear to be."