Indiana governor and GOP vice presidential nominee Mike Pence is out with a fresh statement on Donald Trump’s now-infamous leaked audio about grabbing women “by the pussy” and other similarly vile thoughts.

Pence said he “does not condone his remarks and cannot defend them” — but also that he’s glad Trump has apologized.

Many of Pence’s fellow Republicans are now openly hoping that Trump drops out of the race to be replaced by Pence himself, which naturally puts Pence in a somewhat delicate situation. He is currently trying to walk the line of saying that what Trump said isn’t okay, while standing behind the idea that Trump should be president.