Police have arrested one man after raids by Victoria's Counter Terrorism Team and Australian Federal Police in Melbourne's west and Tatura, near Shepparton.

A 31-year-old man, believed to be a notorious right-wing extremist, was arrested by Special Operations Group members at an address in Ballarat Road, Braybrook about 1pm.

It is understood the man is Phillip Galea, a member of the anti-immigration group Reclaim Australia, who served jail time last year for possessing tasers and mercury.

Victoria police counter terrorism command Assistant Commissioner Ross Guenther​ said that earlier this year they had received information that suggested there were individuals or an individual looking at either advocating harm against Victorian individuals or producing documents that might lead to the harm of people in Victoria.