David Letterman would like to see more girl power in late night, beginning with his old Late Show stomping ground.

In what NBC is billing as his first in-depth post-retirement interview, Letterman tells Tom Brokaw on Sunday’s Dateline (7/6c) that he “couldn’t care less about late night television,” before adding, “I’m happy for the guys, the men and the women, there should be more women. And I don’t know why they didn’t give my show to a woman. That would have been fine. But I’m happy for their success.”

Letterman also confessed that on the day Stephen Colbert officially took over for him on the Late Show, “An energy left me, and I felt like, ‘You know? That’s not my problem anymore.’ And I’ve kind of felt that way ever since. I devoted so much time to [the Late Show] — to the damage of other aspects of my life. Concentrated, fixated, focusing on that. It’s good now to not have that.”

Asked whether CBS consulted him before choosing Colbert as his Late Show successor, Letterman said, “Oh, no. They didn’t ask me about anything. They were just happy I was going.”

Watch a preview of the Dateline Q&A below and then hit the comments with your reaction to Letterman’s candid convo.