A One Nation senator has accused one of Victoria's most Jewish councils of being "anti-Semitic", as the stoush between the far-right party and Glen Eira City Council grows.

The Anti Defamation Commission, one of Victoria's peak Jewish groups, in turn labelled One Nation Senator Malcolm Roberts "obscene" for his remarks, and said he was diminishing the memory of six million Jews murdered during the Holocaust.

Senator Malcolm Roberts during a press conference at Parliament House Canberra on Tuesday. Credit:Andrew Meares

The stoush centres on an invitation by conservative Jewish gym owner Avi Yemini to One Nation senators Pauline Hanson and Malcolm Roberts, to speak to members of the Jewish community in Caufield next month.

The pair was invited to speak about the "dangers" of Muslim migration to Australia, repealing race hate laws, and other controversial topics.