An elderly Victoria man is recovering in hospital after he was pushed off a seaside cliff while bird watching along Dallas Road on Sunday.

Witnesses reported a younger man shoved the 78-year-old victim over the cliff for no apparent reason, according to Victoria Police spokesman Sgt. Grant Hamilton.

"The suspect in this case, a 29-year-old man, severely intoxicated, had been yelling at people on the beach," said Hamilton.

"The elderly man was ignoring him, just doing some bird watching, and randomly unprovoked, this 29-year-old suspect came up to the elder gentleman and pushed him down the cliff. Both of them tumbled down the cliff," said Hamilton.

The pair fell 12-metres to the bottom of the cliff and the suspect landed on top of the elderly man, who suffered a broken pelvis and other less serious injuries.

Hamilton said the suspect does not have any previous record and he's been released with a promise to appear in court.