"It's almost Armageddon if the Japanese and Chinese don't buy our debt,” Robertson said in an interview. "I don't know where we could get the money. I think we've let ourselves get in a terrible situation and I think we ought to try and get out of it."

Robertson said inflation is a big risk if foreign countries were to stop buying bonds.

“If the Chinese and Japanese stop buying our bonds, we could easily see [inflation] go to 15 to 20 percent,” he said. “It's not a question of the economy. It's a question of who will lend us the money if they don't. Imagine us getting ourselves in a situation where we're totally dependent on those two countries. It's crazy.”

Watch the Interview With Julian Robertson (Pt. 2)

Slideshow: The Biggest Holders of US Government Debt

Robertson said while he doesn’t think the Chinese will stop buying US bonds, the Japanese may eventually be forced to sell some of their long-term bonds.