Deputy Prime Minister Barnaby Joyce says Tony Abbott's continued public commentary on issues such as Israel is not helpful.

The former prime minster suggested on Monday that Australia relocate its embassy in Israel, a move subsequently rejected by Foreign Minister Julie Bishop.

Ms Bishop was also forced to defend the Government's foreign aid program after Mr Abbott added that Australia should reconsider the $40 million in aid it provided unless the Palestinian Authority stopped payments "to terrorists and their families".

When asked today if such comments were helpful, Mr Joyce said "probably not".

He told the ABC he did not want any leadership speculation to distract future voters.

"The alternative in the end will not be between different people within the Liberal Party — it will be between the Coalition and the Labor Party," he said.

Mr Joyce also downplayed tension within the party after Senator Cory Bernardi last week publicly criticised Mr Abbott over "talking up division".

He also brushed off comments from LNP MP George Christensen about his future with the Coalition, saying the Queensland politician "quite clearly" supports the National Party.

"We'll continue doing our job," he said.

"The National Party has its own style and character, the Liberal Party has theirs. They've got to work out their business."