HUD Secretary Ben Carson initially said he didn't know anything about the $31,000 dining set purchased for his office.