Last night, Sir Patrick Stewart appeared on Comedy Central’s The Colbert Report to promote his new film X-Men: Days of Future Past. During the interview, Stewart recalled that he was always very responsible, even as a child, and he was even made a prefect at school two years early. Host Stephen Colbert doesn’t miss his chance to bring up Harry Potter, and Stewart joked about being excluded from the cast.

You were a prefect? Did you go to Hogwarts?

No.

No?

It’s painful you should bring that up, you know, because, I mean, Ian McKellen and myself… wouldn’t you think that we were shoe-ins for the Harry Potter movies? Not one phone call!

I gotta say, that would be a great thing for the next X-Men. If you get the X-Men to go with Harry Potter and the Lord of the Rings, then you could represent every British actor who worked for the last 50 years. Did it hurt not to get a call for either one of those movies?

It hurt. It still hurts!