The first Muslim woman elected to federal Parliament, Anne Aly, has declared that a poll showing half of respondents want to ban Muslim immigration doesn't reflect the true feelings and reality of mainstream Australia.

However, Dr Aly, the Labor member for the WA seat of Cowan and a counter-radicalisation expert, said a degree of xenophobia towards minorities does exist, fed by hateful rhetoric, and needs to be confronted by political leaders and regular people.

The poll, released this week, found 49 per cent of people favoured a ban on Muslims moving to Australia, previously considered an idea espoused only by outsider politicians like One Nation leader Pauline Hanson.

The survey found 60 per cent of Coalition voters, 40 per cent of Labor voters and 34 per cent of Greens voters agreed with the proposition and the most common concern expressed was that Muslim people were not integrating, followed by fears of terrorism.