Residents of an affluent Melbourne beach-side suburb are outraged by a state government plan to put homeless people in temporary units, on local land.

Brighton locals say they fear for their safety, citing concerns about mental health and drug issues the future occupants might bring to their neighbourhood.

The plan is to build temporary units for five homeless people on two government-owned blocks, worth almost $4 million.

View photos A Victorian Government plan to build temporary units for the homeless people on these two Brighton blocks has outraged residents. Picture: 7 News More

Brighton resident Rosetta Caponio said the plan had potential to bring social problems to her suburb.

"These people might have mental illnesses, they might be drug addicts. I can't come home at night and feel safe," she told 7 News.

"I may have to move out. I can't put the safety of my daughter at risk."

View photos The plan is to build temporary units for five homeless people, similar to these in Preston, north of the city. Picture: 7 News More

Russell McDonald agreed, saying the plan was a risk to community safety.

"The street is full of young families and my own grandchildren [are at risk] for God's Sake."

Adding to the anger, locals say only a handful of them received notification of the plan.

"[We've received] absolutely no consultation whatsoever. It's quite outrageous really," one resident, identified only as Elizabeth, told.

View photos Brighton resident Rosetta Caponio feared the occupants could bring social issues to her neighbourhood. Picture: 7 News More

Victorian Housing Minister Martin Foley said the proposal was part of the response to the Flinders Street homeless camp which was broken up earlier this year.

Story continues