Opposition Leader Tony Abbott has been thrown out of Parliament during question time by acting Speaker Anna Burke for refusing to withdraw unparliamentary remarks.

Mr Abbott was interjecting across the dispatch box as Prime Minister Julia Gillard answered a question on the carbon tax when he was ordered to withdraw his comments ''without qualification''.

''I withdraw but it's still an untrue statement,'' Mr Abbott replied.