West Australian Liberal MP Don Randall is under fire over comments he made about Julia Gillard's religious views.

The member for Canning says many people in his electorate and across the country do not like the fact Ms Gillard is an atheist.

The Coalition has dumped its candidate for the Western Sydney seat of Chifley for criticising his opponent's Muslim faith.

Party leader Tony Abbott says attacks based on people's religious beliefs are unacceptable.

The Population Minister Tony Burke says Mr Abbott needs to hold all his candidates to the same standard on religious issues.

"What I would like to know is whether or not those views will also relate to his candidate in the seat of Canning," he said.

Mr Randall would not comment about the decision to dump the Chifley candidate, but did not think his comments were in the same vein.

"It's a criticism of the fact that the electorate has deep concerns about an un-godly leader leading Australia," he said.

Mr Randall says Australia was built on Christian values, which provide the basis for being a better leader.

"We expect out leaders to convey and portray good Christian values," he said.