Home Affairs Minister Peter Dutton has been grilled over the veracity of his controversial claims that Victorians are "scared to go out to restaurants of a night time because they are followed home by these gangs".

When challenged on radio station 3AW to provide evidence, Mr Dutton said he had spoken to a "number of people" and parliamentary colleagues, but only specified fellow federal MP Jason Wood.

Mr Dutton again attacked the Andrews government for its handling of youth crime but in the evening interview, he was repeatedly challenged to back up his claims with evidence.

When Mr Dutton repeated comments made on Sydney station 2GB on Wednesday that he did not want to see people get hurt or "followed home from restaurants", he was rebuked by 3AW presenter Nick McCallum, who accused Mr Dutton of trying to score "political points" during an election year in Victoria.