"I don't see this as me against the Prime Minister," he told the BBC. "It's about what we as country think is the right thing to do."