Indigenous leaders have called on Prime Minister Malcolm Turnbull to reverse Tony Abbott's decision to move the portfolio into the Department of Prime Minister and Cabinet, describing the change as an "absolute disaster".

The National Congress of Australia's First Peoples has called for an overhaul of Indigenous services, following this week's leadership spill which forced Mr Abbott to stand down as prime minister.

Co-Chair of Congress Les Malezer said Mr Abbott's decision to take responsibility for the portfolio in his own department was a big mistake.

"Moving all of the responsibilities into his portfolio in Prime Minister and Cabinet's department in Canberra, centralising all the decision-making, has just been a disaster," Mr Malezer said.

"An absolute disaster, impacting upon the daily lives of our people."

Mr Malezer has also flagged concerns about Mr Abbott's hand-picked Indigenous Advisory Council, which is currently headed by former ALP national president Warren Mundine.

Warren Mundine was appointed to chair the Indigenous Advisory Council when Tony Abbott came to office. ( AAP: Nikki Short )

"This is a matter for Prime Minister to decide, but it's one of the things that will be discussed when we get an opportunity to meet with him," he said.

"We're not hostile to the concept that the Government might seek expert advice, but if it's looking for advice from the communities, from their representatives and so on, then it should go right to the source for that."

Members of the Congress have met in Canberra, urging the new Liberal leader to continue engaging with Indigenous communities.

But Mr Malezer said Mr Turnbull did not necessarily have to spend one week a year in those communities, which Mr Abbott promised when he became prime minister.

"We'd like to see something of a commitment to that effect but not necessarily that commitment," he said.

Momentum for referendum should not slow: Parker

Congress also discussed the proposed referendum into the Constitutional recognition of Indigenous Australians and whether the elevation of Mr Turnbull as Prime Minister would have an impact.

Co-chair of Congress Kirsty Parker said it was too early to say whether the deadline of May 2017 needed to be revised, but warned that momentum should not be allowed to slow down.

"Well, the timeline for constitutional reform, if we're talking about May 2017 for a referendum, is an ambitious target to start with, and we communicated that to the then Prime Minister and the Opposition Leader at a summit at Kirribilli in the first week of July," she said.

"Of course, we are a couple of months down the track. With every week that goes by, the momentum slips."

Members of the Congress said they were keen on meeting with the new leader today but were unable to make an appointment.

In a statement, a spokesman for Mr Turnbull said the Prime Minister had "expressed his very earnest commitment to meet with the representatives of Aboriginal and Torres Strait Islander Peoples as soon as possible".

Mal Brough a 'controversial choice'

Congress also expressed its reservations about the prospect of former Howard government minister Mal Brough being elevated into the role of Indigenous affairs.

The ABC understands a number of Indigenous leaders were concerned about the prospect Mr Brough would be promoted to the role given he entered the room for the spill motion with Mr Turnbull, and was seen as a key supporter of the move to oust Mr Abbott.

Mr Brough was instrumental in the controversial Northern Territory Intervention of 2007 and is tipped to be promoted as a result of this week's leadership spill within the Liberal Party.

Ms Parker said such a move would raise eyebrows within Indigenous communities.

"I think it would be fair to say that it would be a controversial choice," she said.

"Having said that, it's less about the people and more about the policies and the approach that is taken, and this is where the leadership of the Prime Minister will come into play."