Despite Donald Trump’s attempts to distance himself from David Duke, the former KKK leader is a huge fan of the 45th U.S. president. Just moments after Trump took the oath of office on Friday, Duke offered him best wishes and proclaimed, “We did it!”

We did it! Congratulation Donald J. Trump President of the United States of America! — David Duke (@DrDavidDuke) January 20, 2017

Duke backed Trump during his campaign and Trump received widespread criticism for not immediately denouncing the endorsement and for wavering on whether he even knew about it. The president has also come under fire over his decision to hire Steve Bannon, the former Breitbart executive with white nationalist ties.

Trump did eventually disavow the self-proclaimed “respectable racist,” saying, I disavow, okay?” But it seems that Duke never got the message.