Prime Minister Tony Abbott says Speaker Bronwyn Bishop is deeply remorseful over the entitlements saga, and the take-home message for all politicians is that you cannot "get away with exploiting the rules".

Yesterday, Mrs Bishop fronted the cameras to deliver a public apology for her decision to charter a helicopter for a Liberal Party fundraiser.

Mrs Bishop has maintained the travel was within the entitlements rules and has rebuffed calls for her to resign.

Mrs Bishop rebuffed calls for her resignation and was condemned for holding out for more than two weeks before saying sorry over the entitlements claim.

The Prime Minister said Mrs Bishop's apology showed she was contrite about her decision to charge taxpayers for the $5,227 helicopter charter and other allowances she claimed around the times she attended a number of weddings.

"She's repaid the money with penalties, she is obviously deeply remorseful," Mr Abbott told radio station 2SM.

"Anyone who saw her on television yesterday would know that this is a very, very chastened person indeed.

"If there's one lesson that every single politician must have had reinforced by all of this, it is that you cannot get away with exploiting the rules."

The Finance Department is reviewing Mrs Bishop's spending over the past decade.

"Obviously if there's anything which is outside the rules it will be repaid instantly with penalties," Mr Abbott said.

Cabinet Minister Christopher Pyne also backed the Speaker following yesterday's apology, and declared the matter closed.

Opposition frontbencher Anthony Albanese said voters did not believe Mrs Bishop was sorry.

"An apology that's got out with a crowbar is not taken seriously," he told Channel Nine.

"What we see is like a very bad movie, this is four weddings and a political funeral."

Abbott hints at further changes to entitlements

Mr Abbott said his government had already tightened the entitlements rules and he has hinted that there may be a more rigorous approach to come.

"Let's see what else might emerge out of the review that's going on now," he said.

The Prime Minister also referred to his own experience travelling for personal reasons.

"I took the family overseas at Christmas 2013 and we certainly made the very long trip to Europe in economy class," he said.

"That’s what the people do, and that's what we certainly did when we were travelling privately."

Mrs Bishop held a short media event in regional Victoria yesterday to deal with the continuing criticism of her position.

The Prime Minister and Mrs Bishop met on Wednesday, but she said Mr Abbott did not ask her to say sorry.

"I am so apologetic to the Australia people for letting them down and I will be working very hard to make sure things are right," she said.

But she again said that the entitlements claim had not broken parliamentary rules.

"Although it's within the rules it just doesn't look right and therefore I am apologising and repaying," she said.

The Speaker has been threatened with a no-confidence motion when Parliament resumes.

One of the instigators of the motion, Clive Palmer, said Mrs Bishop should resign because of her age and her partisan approach in Question Time.