Tony Abbott has declared he'll be staying in politics as Prime Minister Malcolm Turnbull comes under pressure over party unity.

Mr Abbott, who was rolled by Mr Turnbull two years ago, told an address to the Institute of Public Affairs in Brisbane on Tuesday night that he would not disappear from the limelight.

"I'm in no hurry to leave public life because we need strong Liberal conservative voices now, more than ever," he said.

News Corp Australia reported on Wednesday that he also said he would be there to help pick up the pieces "when" the prime minister's leadership falls apart.

Former Victorian premier Jeff Kennett had a blunt response to the news.

"He won't be prime minister again," he told the Seven Network.

He said Liberal Party members are profoundly disappointed at the way colleagues in Canberra are conducting themselves.

"There are some good men in the ranks but this division takes the focus away from good government and, if they are not careful, they will undermine both the Menzies and the Howard legacy."

Mr Turnbull has denied his leadership is under threat from Mr Abbott.

0:00 Abbott has 'benefit of being on the backbench':Joyce 00:00 / 00:00 Share Share on Twitter

Share on Facebook

Tensions between the moderate and conservative arms of the Turnbull government were exposed after a recording of senior cabinet minister Christopher Pyne talking about getting same-sex marriage legalised was leaked earlier this week.

There have been calls for him to be demoted, while the Australian Financial Review on Wednesday said there were moves to force a reshuffle to dump moderates George Brandis and Marise Payne in favour of conservative MPs, such as Angus Taylor and Michael Sukkar.

"It's always been the left that's kept him in power. Malcolm now has to appease the right to keep himself in," the AFR quoted an unnamed conservative.