A teacher has accused a top Victorian school of racial discrimination after he was allegedly told he made the staff room look like "Angelina Jolie's family".

The former McKinnon Secondary College maths teacher also claimed that a colleague referred to him as the "brown-skinned man" at a staff party and said "we don't need more brown skins in our staffroom".

Manu Chopra has taken his fight against the high-performing state school to the Victorian Civil and Administrative Tribunal, accusing the Education Department, the school's principal Pitsa Binnion and seven staff members of victimising him.

He claimed that a colleague said "our staffroom does not need to look like Angelina Jolie's family" – a reference to the Hollywood star's multicultural and multiracial family.