A regional Victorian train conductor has been stood down after a Facebook video emerged showing the V/Line employee assaulting a man on a platform.

The footage shows the conductor kicking and punching another man at the Broadford train station in central Victoria.

People on board can be heard saying "no more, no more".

Passengers told the ABC the man was being kicked off the train when the incident erupted.

The conductor has been stood down pending an internal V/Line investigation into the incident.

The other man involved — a 46-year-old from Croydon — was charged over the alleged assault of a woman on the train, police said.

He declined to make a statement to police.

Detectives from the Transit Crime Investigation Unit are investigating the altercation.

V/Line said it was providing trauma counselling to staff.