Haggard, who left his church after a sex and drug scandal, will reportedly swap spouses with Gary Busey

He weathered a sex and drug scandal but can he handle Celebrity Wife Swap?

Evangelical pastor Ted Haggard will appear on the upcoming celebrity version of ABC’s Wife Swap, the show’s producers confirmed to PEOPLE Wednesday.

Get push notifications with news, features and more.

He’s reportedly swapping spouses with actor Gary Busey.

Haggard, 55, and his wife, Gayle, remain married even after Haggard admitted in late 2006 to paying a male masseuse for sex and using crystal meth. The scandal forced him to resign as a senior pastor of New Life Church in Colorado Springs, Colo., and as president of the National Association of Evangelicals.

Though he subsequently entered counseling and has condemned homosexuality publicly, Haggard told GQ in 2011 of his sexuality, “I think that probably, if I were 21 in this society, I would identify myself as a bisexual.”

Haggard, who founded the New Life Church, is currently the pastor of St. James, a nondenominational church also in Colorado Springs.