"If you have slightly conservative or even libertarian points of view, especially if you are persuasive and charismatic and funny and effective, like we both are, you will get called the most appalling things."