Man managed to pinpoint city where he grew up years later after eating signature oyster dish from his hometown