A Melbourne Rabbi has been forced to defend himself from a man screaming “go back to Israel” and “swear to Allah” outside a synagogue yesterday.

The enraged man cornered the orthodox Jew and then slapped him outside the Adass Synagogue in Elsternwick and a video was posted to the IDF Training Facebook page.

In the clip, an agitated man can be seen screaming at the Jewish man to “go back to Israel”.

“I am from Australia,” the Jewish man responded.

Tensions boil over when man in the red t-shirt tries to grab the other man around the neck and is tackled by a group of onlookers in religious dress.

The group calmly hold the man down until police arrive.

Witnesses say the man appeared to be on drugs or drunk.

The man has charged and will appear in court on January 19, according to reports.

In a separate anti-Semitic incident, a car used by a group of Jewish concert-goers has been covered in Nazi and ISIL references at the Strawberry Fields Music Festival near Tocumwal, NSW.

“That’s just not on a funny thing to say in light of everything that’s happening at the moment,” concert goer Jemma said.

“That’s not on. Not on,” she said

Soon after the festival, Jemma posted the photos on the Strawberry Fields Facebook page which attracted more hateful comments, like "Maybe ISIS did it" and "I'm going to gas your family."