A man has died of stab wounds after an argument in Chinatown in Melbourne's CBD.

Paramedics and police were called to the Golden Square carpark near the corner of Little Bourke and Swanston streets about 12.40pm after reports a man had been stabbed.

Police confirmed the victim died in hospital on Wednesday afternoon.

Detective Senior Sergeant Steve McIntyre said two men had met at a restaurant and left together before arguing in the carpark.

A knife has been recovered from the scene, and Detective Senior Sergeant McIntyre said police would scour CCTV footage. He would not comment on the type of knife.