The manager of Opposition business Christopher Pyne has become the first MP of the new Parliament to be booted from the chamber during Question Time.

Question Time is operating under new time limits and other rules aimed to ensure proper debate and less abuse of the process.

During an answer from Prime Minister Julia Gillard, Mr Pyne wanted to make a point of order but was denied by Speaker Harry Jenkins who had already sat Ms Gillard down.

Mr Pyne then said Ms Gillard had sat down because she was "hopeless".

He was promptly expelled from the chamber for one hour.

"The record can show, and I'll take the consequences, that yes, there was an element that I sat the Prime Minister down," Mr Jenkins said.

"But that does not allow someone without the call to stand at the despatch box and throw endearments across the table."

Later during debate over new rules surrounding supplementary questions, Mr Jenkins quipped that he was not one of the "elite three" that formulated them.

On Monday when Mr Jenkins was re-elected to the position, Mr Pyne said he and the Speaker had a "love-hate relationship".

"I need you to love me as the manager of Opposition business, but I haven't always felt that love," he said.