A violent scuffle broke out on the steps of Richmond Town Hall on Sunday afternoon as rival rally groups clashed during an anti-extremist protest.

About 70 supporters of the far-right United Patriots Front attempted to storm the town hall but their efforts were thwarted by hundreds of counter-protesters.

No serious injuries were reported and no arrests were made, but a police spokeswoman said a man is expected to be charged on summons for weapons offences after being caught carrying a knife.

Campaign Against Racism and Fascism counter-protest supporters began gathering at the town hall from noon, chanting "no Nazis, never again".