Gary Johnson says the Libertarian Party is no longer so "kooky." Gage Skidmore via Flikr Gary Johnson, the Libertarian Party's presidential candidate, was on "The Colbert Report" Monday night, sitting down with the man who was out-polling him in a hypothetical race in January.

Johnson's appearance started with a raucous ovation as Colbert mentioned that he is in favor of legalizing marijuana, to which Colbert quipped that he had never heard his audience "cheer so loudly for a federal offense."

Remember back in January, when a Public Policy Polling survey found that Colbert was beating Johnson almost two-to-one as a theoretical Independent candidate running alongside Democrat Barack Obama and Republican Mitt Romney? Well, now, Johnson wants to start polling at 15 percent to get on the national debate stage.

That doesn't seem to be very plausible, but here's why Johnson thinks he can do it: He thinks most of the country actually falls in line with the Libertarian Party's views of fiscal conservatism and social tolerance. (Except for Stephen Colbert, as he pointed out.)

Johnson outlined his contrasts with both parties: Ending wars in the Middle East, advocating for gay marriage and balancing the federal budget.

"The Libertarian Party is now 40 years old, and in a poll three months ago, 50 percent of Americans support legalizing marijuana," Johnson said. "Who perhaps is singularly most responsible for that? It's the Libertarian Party.

"Initially? Kooks. Today? Not so kooky."

Watch the video of Johnson's appearance below: