The date of Australia Day is dividing Australians and excluding Indigenous people, according to one of Australia's most influential Aboriginal voices.

Key points: Prime Minister Malcolm Turnbull disappointed by calls to change Australia Day date

Prime Minister Malcolm Turnbull disappointed by calls to change Australia Day date Professor Chris Sarra says the date excludes Aboriginal and Torres Strait Islander people

Professor Chris Sarra says the date excludes Aboriginal and Torres Strait Islander people The government believes changing the date is a denial of history

"Regrettably I don't think Australia Day, and what it represents, is a day that most people in the Aboriginal community want to celebrate," says Professor Chris Sarra, one of Malcolm Turnbull's key Indigenous advisers.

"I say that mindful that you get one or two Aborigines who say what people want to hear, but that's not a true and accurate reflection of what most of the Aboriginal community thinks."

Professor Sarra, who was appointed co-chairman of the Prime Minister's Indigenous Advisory Council last year and is an internationally renowned educator, said celebrating on the anniversary of the First Fleet's arrival would never be accepted by the majority of Aboriginal and Torres Strait Islander people.

"Don't compel us to have to stand by and have to celebrate that with you," he said.

"We could pretend that Australia Day is something that unites us when clearly it's something that divides us."

Professor Chris Sarra says most of the Aboriginal community will never celebrate Australia Day. ( Supplied )

He said there had been "dog-whistling" from some commentators and politicians claiming that Australia Day was under attack, and said a different date would be celebrated by all Australians.

"When I hear people create more division and hate and animosity, that Australia Day is under threat, I just think it lacks integrity," Professor Sarra said.

"I just think we can be better than that, let's stop the dog whistling … let's be sophisticated."

Changing the date 'denies history'

Earlier this week the Prime Minister said he was "disappointed" by calls to change the date and said it amounted to a denial of history.

But Professor Sarra said it was time to "calmly" reconsider whether January 26 is an inclusive date.

"Having seen the Prime Minister's response in the fullest context, clearly he's interested in having an honest conversation," Professor Sarra said.

"Clearly we need to have more conversation about what that day means for Aboriginal Australians."

The Federal Government strongly supports the date of Australia Day and has stripped two Melbourne councils of the power to hold citizenship ceremonies.

The Assistant Home Affairs Minister Alex Hawke said he was yet to hear "a reasonable argument about why you should change the date".

"The historical importance of the events at Sydney Cove is real, it's part of our history," Mr Hawke said.

"It had good implications and it had bad implications for the convicts at the time, for the Aboriginal community at the time and for the foundation of our nation."