The immigration department sacked an expert health panel because of fears its members would leak information about Operation Sovereign Borders to the media, government documents reveal.

The 12-member Immigration Health Advisory Group was replaced by a sole adviser, military surgeon Paul Alexander, in December.

The panel, which included psychiatrists, psychologists, trauma experts, nurses and GPs, had been providing independent policy advice to the federal government since 2006.

Documents, obtained under Freedom of Information by Australian Associated Press, show immigration department secretary Martin Bowles was concerned about potential conflicts of interest by members of the panel.

It had become increasingly apparent the contentious nature of some policy approaches in relation to "illegal maritime arrivals" had made it difficult for some members to provide health advice independent of their other interests, he wrote in a ministerial minute.

The conflicts of interest arose from "natural professional interests and obligations" including, in some cases, public and media comment related to issues under consideration by the panel.

"The actual and potential conflicts also present challenges in sharing information on policy and operational activities that are becoming increasingly problematic," Mr Bowles said.

Because of the creation of a joint agency taskforce, introduction of rapid transfer arrangements and emphasis on expanding offshore processing it was appropriate to revisit the department's approach to seeking expert health advice.

Mr Bowles conceded the decision was likely to attract criticism that the department was not interested in frank and impartial health advice.

"This is not the case," he wrote, referring to General Alexander's appointment and back-up available to him from the department's chief medical officer and International Health and Medical Services, which provides health care in detention centres.

The Abbott government, in previously defending its decision, argued the panel struggled to provide timely advice in a fast-moving policy environment because of its large membership.

Former panel member Choong-Siew Yong, from the Australian Medical Association, said the group gave frank clinical advice that sometimes did not fit with government policy but members respected confidentiality rules.

Another panel member, Amanda Gordon from the Australian Psychological Society, told AAP concerns about leaks were unfounded nonsense.

"I found it most offensive that they would suggest we would reveal anything outside the room, no one did ... there was never a media leak," she said, adding that General Alexander did not have any expertise in mental health.

Louise Newman, who was on the panel representing a psychiatrists' peak body, said that "reading between the lines" the subtext was that their advice was not always in keeping with departmental or ministerial direction.

A spokeswoman for Immigration Minister Scott Morrison defended Mr Bowles' decision to disband the group.

"Dr Alexander has an eminent medical background in the Australian Defence Force in clinical executive posts, and in private practice, commercial and not-for-profit organisations," she said.