Victorian opposition frontbencher Tim Smith has taken a swipe at some of Melbourne's so-called "Aspen set" and branded newly returned overseas travellers disobeying rules to self-isolate as "flogs".

The opposition planning spokesman on Wednesday criticised a man who was meant to be self-isolating but instead was allegedly drink-driving when he crashed into a Kew East bike shop.

The MP blasted the driver, while also taking aim at others who skip quarantine, echoing comments from federal Health Minister Greg Hunt, who told The Age on Tuesday that authorities should "throw the book" at offenders.

A backlash greeted Melbourne holiday makers who returned from Aspen's ski resort and ignored advice to self-isolate.

Mr Smith said the Kew driver should be dealt with harshly if found guilty, as should others accused of avoiding isolation in Melbourne after being exposed to COVID-19.