The National Congress of Australia's First Peoples says it will push to change a clause in the constitution that allows race discrimination.

Around 40 Indigenous leaders will meet with the Prime Minister and Opposition Leader in Sydney today, for talks on a referendum to change the constitution.

Section 25 in particular allows states to exclude a particular race from voting.

Congress co-chair Les Malezer has told ABC News 24, people want to see it addressed.

"I think this is really the substance of the referendum and what our people are hoping to see in it," he said.

"It's part of a context of addressing race in the constitution and I think there needs to be an understanding generally that there was provisions included in the constitution about dealing with race but in a negative way, that is in terms of removing people from Australia, of restricting voting capacity of people.

"So this recognition is proposed to address all issues of race including ensuring that racial discrimination is not one of the things that is exercised by the governments in Australia."

Chairman of the Prime Minister's Indigenous advisory council, Warren Mundine, is calling for a "practical approach" ahead of the summit.

He told Sky News he favours a proposal that is likely to be supported by the Australian people at a referendum.

"We got one stream here, happy with the constitution, then we've got another stream here want to put all the bastards back on the boats and send them home," Mr Mundine said.

"So we gotta reconcile all that extremes. But in the middle I think there is the majority and there's probably only two degrees of difference between the lot of us."

Tudge believes proposals will be difficult to implement

Over the weekend, Federal Government frontbencher Alan Tudge said banning racial discrimination in the constitution would be tricky to achieve.

"The particular proposal to have a racial discrimination provision in the constitution is a difficult one," he said.

"But let's discuss it with the leadership group and there's going to be many opportunities between now and the next few months to consider all proposals."

Another one of those proposals is to develop the framework for an Indigenous advisory body, which would consult the Federal Government on legislation that affects Aboriginal and Torres Strait Islander people.

But Mr Malezer said it may not gain the support of the Indigenous community.

"The question remains for us, will this model provide guarantee or protection against bad legislation, against bad policies in the future?" he said.

"All it does is allow for advice to go to the Government but still the Government becomes sovereign in that sense and decides what it wants to do.

"And I don't know that Aboriginal people are willing to trust it to that point given the history we've had on those issues."

Monday's meeting will aim to find common ground on the details of the proposal, with Mr Malezar saying problems would arise if Indigenous and parliamentary leaders do not walk out of the meeting agreeing on the way forward.

"There certainly would be problems, and I'm hoping that's what we will be able to do, come out and say this is the way forward," he said.

Aboriginal leader Jackie Huggins says she is optimistic about the meeting.

"Come Monday, when the leaders are in the room, they will realise the seriousness of this, and hopefully put their egos at bay in order to get our people and the Australian people across the line on this referendum," she told Sky News.