Australian businessman Dick Smith has blamed immigrants for high house prices, claiming the "enormous population increase" is making young families unable to buy their first home.

Appearing alongside former Labor leader Mark Latham and controversial former Liberal MP Ross Cameron, Mr Smith said "jumbo loads" of immigrants arriving each week were the "main driver" behind the country's housing affordability crisis.

"The main point that's driving our unaffordable housing is about 200,000 immigrants come in a year. That's five jumbo loads a week that go out empty," he told Sky News.

"All of our problems are from this unbelievable population increase. You can't drive in Sydney at the moment. The housing prices are enormous.