If you look at the values and the historical record, you will see that the Founding Fathers never intended guns to go unregulated, Supreme Court Justice Stephen Breyer contended Sunday.

Appearing on "Fox News Sunday," Breyer said history stands with the dissenters in the court's decision to overturn a Washington, D.C., handgun ban in the 2008 case "D.C. v. Heller."

Breyer wrote the dissent and was joined by Justices John Paul Stevens, David H. Souter and Ruth Bader Ginsburg. He said historians would side with him in the case because they have concluded that Founding Father James Madison was more worried that the Constitution may not be ratified than he was about granting individuals the right to bear arms.

Madison "was worried about opponents who would think Congress would call up state militias and nationalize them. 'That can't happen,' said Madison," said Breyer, adding that historians characterize Madison's priority as, "I've got to get this document ratified."

Therefore, Madison included the Second Amendment to appease the states, Breyer said.

"If you're interested in history, and in this one history was important, then I think you do have to pay attention to the story," Breyer said. "If that was his motive historically, the dissenters were right. And I think more of the historians were with us."

That being the case, and particularly since the Founding Fathers did not foresee how modern day would change individual behavior, government bodies can impose regulations on guns, Breyer concluded.

In July 2008, the concurring opinion in "D.C. v. Heller" written by Justice Antonin Scalia and shared by Chief Justice John G. Roberts Jr. and Justices Anthony M. Kennedy, Clarence Thomas and Samuel A. Alito Jr. found that the district's ban on handgun possession at home "violates the Second Amendment, as does its prohibition against rendering any lawful firearm in the home operable for the purpose of immediate self-defense."

The ruling raised concerns by dissenters like Breyer that gun laws nationwide would be thrown out. That has not happened yet.

Breyer, who just published "Making Our Democracy Work," a book about the role of the court in American life, outlined his judicial philosophy as one in which the court must take a pragmatic approach in which it "should regard the Constitution as containing unwavering values that must be applied flexibly to ever-changing circumstances."

Since the Founding Fathers could not foresee the impact of modern day communications and technology, the only option is to take the values of the Founding Fathers and apply them to today's challenges.

"The difficult job in open cases where there is no clear answer is to take those values in this document, which all Americans hold, which do not change, and to apply them to a world that is ever changing," Breyer said. "It's not a matter of policy. It is a matter of what those framers intended."

He suggested that those values and intentions mean that the Second Amendment allows for restrictions on the individual, including an all-out ban on handguns in the nation's capital.

"We're acting as judges. If we're going to decide everything on the basis of history -- by the way, what is the scope of the right to keep and bear arms? Machine guns? Torpedoes? Handguns?" he asked. "Are you a sportsman? Do you like to shoot pistols at targets? Well, get on the subway and go to Maryland. There is no problem, I don't think, for anyone who really wants to have a gun."