Yes, freedom of speech allows irritants to say stupid things — but it empowers the rest of us to have it out with them. In silencing non-violent extremists, Cameron is also infantilising us non-extremists, denying us the opportunity to do our public duty and have a war of words with these reactionaries.