Cabinet Minister Mathias Cormann has defended Tony Abbott's decision to remain in parliament after a party elder called on the former prime minister to quit immediately.

Howard government minister Amanda Vanstone has delivered a searing assessment of Mr Abbott's decision to remain in parliament after being rolled by Malcolm Turnbull in September.

Ms Vanstone argued Mr Abbott should leave politics and avoid the temptation to mount a leadership challenge.

"I don't think Tony's friends are necessarily doing him any good by suggesting he should stay because it's going to end in tears for him," she said.

"I think with the effort he's put in, he's entitled to leave parliament with a good reputation and I think if he stays, he won't be able to do that."

She argued Mr Abbott's continued presence would be a destabilising force for the Prime Minister.

But Senator Cormann said he did not share her view.

Tony Abbott takes his seat on the backbench after being dumped as PM ( AAP: Dean Lewins )

"No, I don't. Obviously Tony Abbott has made a decision to stay. That is because he feels he still has a contribution to make and I don't agree at all that Tony Abbott is a destabilising force.

"I absolutely believe that Tony Abbott will be true to his word and in fact he is being true to his word.

"I don't believe that Tony Abbott is ever a wrecker. I think that Tony Abbott is always focused on making a positive contribution to our country."

Ms Vanstone also called on veteran government MPs Bronwyn Bishop and Philip Ruddock to step aside.

"If you don't get rid of old stock, what they call dead wood, you can't bring new stock in," she said.