Washington (CNN) President Donald Trump's Federal Reserve pick Stephen Moore expressed regret over a comment he made in 2016 about Trump kicking former President Barack Obama's family out of "public housing."

"There's that great cartoon going along, that The New York Times headline: 'First thing Donald Trump does as President is kick a black family out of public housing,'" Moore said at a 2016 event shortly after Trump's election. "And it has Obama leaving the White House. I mean, I just love that one."

Asked about it Tuesday during an interview with PBS' "Firing Line with Margaret Hoover," Moore responded: "I shouldn't have said it."

Moore, an economic commentator who served as a Trump campaign adviser in 2016, has come under fire for columns and comments made over the past 25 years, including comments reported by CNN's KFile disparaging women's equality and participation in the workforce and especially in sports and the media.

Moore appeared to acknowledge in his PBS interview that his comments may end his chances for confirmation.

Read More