Peter Kammerer says while the rugby fest has its fans, not least the legions from abroad, for the Chinese majority here it’s an event to be ignored or avoided