Federal Opposition Leader Tony Abbott has embraced the Victorian Government's parliamentary inquiry into clergy abuse, but has warned against singling out the Catholic Church.

Victorian Premier Ted Baillieu yesterday announced an inquiry would be held after a police report uncovered dozens of suicides linked to child abuse by Catholic clergy.

Mr Abbott says child abuse is "a terrible blot on society" that has to be eliminated but the blame should not be solely directed at the church.

"There has been a lot of pretty gruesome behaviour in many institutions over the years and we should be careful not to single out particular institutions, given that a lot of this has been or it was pandemic a generation ago," he said.

The State Government has been criticised by victims groups for not announcing a royal commission, although Mr Abbott said that was a determination for Mr Baillieu.

Mr Abbott did however congratulate the Premier for taking a stance on the issue.

State Opposition Leader Daniel Andrews backs the victims groups, saying the parliamentary committee does not have the legal knowledge or resources for such a complex investigation.

Attorney-General Robert Clark says the criticism is disappointing.

"We have every confidence in the representation on the committee," he told ABC News Breakfast.

"In Victoria, parliamentary committees have a very successful and recognised record of inquiring into difficult and complex social issues and coming up with a welcomed set of recommendations."

Former deputy prime minister Tim Fischer, who recently served as Australia's Ambassador to the Holy See, says he believes a parliamentary committee can be effective.

"Parliamentary committees have often stepped over the edge, stepped outside the envelop to get answers on key issues," he said.

"I was on a Stay Safe committee as a junior backbencher. That introduced RBTs, stood up to the elite that was opposed to it.

"These committees can in fact think laterally because it has a mixture of younger, first-term MPs."