With $45 billion in capital and $2.1 trillion in assets, the central bank would not withstand the scrutiny normally afforded other institutions, Grant said in a live interview.

"If the Fed examiners were set upon the Fed's own documents—unlabeled documents—to pass judgment on the Fed's capacity to survive the difficulties it faces in credit, it would shut this institution down," he said. "The Fed is undercapitalized in a way that Citicorp is undercapitalized."

Grant said he would support legislation currently making its way through Congress calling for an audit of the Fed.

Moreover, he criticized the way the Fed has managed the financial crisis, saying the central bank's target rate should not be around zero.