It's been a difficult week for the Prime Minister, John Key, who's copped a lot of flak from opposition parties and the media.