Both sides of politics are blaming each other after the Victorian Parliament was suspended until later this month.

The Speaker of the House declared Labor's behaviour as appalling, suspending Parliament twice, before making a third order to suspend Parliament until November 26.

Premier Denis Napthine accused Labor and the party's leader Daniel Andrews as behaving in a "petulant" manner, when the Opposition continued to challenge the authority of Speaker Ken Smith.

Sorry, this video has expired The Victorian Parliament descends into chaos

Mr Andrews then described Dr Napthine's leadership as embarrassing.

It all started when Labor's Jacinta Allan challenged the Speaker.

The Opposition has been pressuring Mr Smith to resign, saying he no longer commands majority support in Parliament.

Mr Smith suspended parliamentary proceedings for about half an hour and on resumption, Labor continued with its challenge against the Speaker.

From the floor Mr Andrews could be heard saying: "You haven't got the numbers, Mr Speaker."

"We'll take an election now," the Labor MPs could be heard yelling.

Ms Smith said to the Labor leader: "Your behaviour is appalling as the leader of the Opposition, you're not showing any leadership qualities at all."

He again suspended proceedings.

During the first break, Mr Smith said Labor's intention was to disrupt the House.

"It's contrived," he said.

He says he has the support of the Premier and the Government, but said he had no reason to test the numbers in Parliament.

Parliament in session for less than 15 minutes 9.30: Parliament begins 9.38: Parliament suspended 11.02: Parliament resumes 11.04: Parliament suspended 11.30: Parliament resumes 11.33: Parliament suspended until November 26

"They're not going to get rid of me," he said.

Mr Smith said he would suspend Parliament again if Labor's behaviour did not improve.

He made good on the threat, suspending Parliament until November 26.

Frankston MP Geoff Shaw, who earlier this week said he had no confidence in the Speaker, left Parliament before it was finally suspended.

He left during the second, 20-minute suspension.

"Nothing's happening up here, it's a farce, it's time to go to Frankston," he said.

"I'm getting a little bit tired of it."

Libs say Opposition treating Parliament with contempt

Liberal MPs left Parliament, describing today's events as disgraceful.

"The Opposition is treating Parliament with contempt," Education Minister Martin Dixon said.

"It's a stunt, it was shocking."

Dr Napthine has defended Mr Smith as Speaker, and says Labor must take full responsibility for the shutdown.

"The reason the Parliament has had inappropriate behaviour this week is purely and simply the political childish tactics of Daniel Andrews and the Labor Party," he said.

"They ought to grow up.

Space to play or pause, M to mute, left and right arrows to seek, up and down arrows for volume. Listen Duration: 4 minutes 56 seconds 4 m 56 s Victorian Parliament in chaos Download 2.3 MB

"People who saw the Parliament today would know who to blame.

"The people to blame are the people who cause the disruption, the people who had a deliberate tactic of disrupting a Parliament, of petulance, of childish behaviour."

Dr Napthine says he has not seen such behaviour in 25 years.

"We didn't shut the Parliament down," Mr Andrews said.

"We stayed. Every member of the Parliamentary Labor Party, on the floor of the chamber, ready for work.

"And on the other side, no-one. No-one at all, as they scrambled to save the only jobs that mattered to them - their own.

"Denis Napthine and the Government he leads are an embarrassment to our state.

"What we've seen today is a shrill Premier, an angry Premier wanting to blame everybody else for the fact that his Speaker doesn't have any support, doesn't have support of the majority of members."