Story highlights The interview was conducted by his longtime friend Armstrong Williams

The Trump administration's first full budget proposal called for $6 billion in cuts from HUD's budget

Washington (CNN) Housing and Urban Development Secretary Ben Carson said in an interview Wednesday that having "the wrong mindset" contributes to poverty.

"I think poverty to a large extent is also a state of mind," the retired neurosurgeon said during an interview with SiriusXM Radio released on Wednesday evening. "You take somebody that has the right mindset, you can take everything from them and put them on the street, and I guarantee in a little while they'll be right back up there. And you take somebody with the wrong mindset, you could give them everything in the world, they'll work their way right back down to the bottom."

The former 2016 presidential candidate, who was appointed by President Donald Trump and confirmed to his Cabinet post in March , argued parents can help prevent their kids from developing the "wrong mindset."

"A lot of it has to do with what we teach children," he said. "You have to instill into that child the mindset of a winner."

He went to say that "there's also a poverty of spirit. You develop a certain mindset."