The attorney at the center of successfully arguing that California's Proposition 8 is unconstitutional calls Judge Vaughn Walker's ruling an example of "judicial responsibility."

Ted Olson told Fox News' Chris Wallace Sunday that it's not "judicial activism" when a judge follows the Constitution.

"Where is the right to same-sex marriage in the Constitution?" asked Wallace.

"Where is the right to interracial marriage in the Constitution, Chris?" replied Olson.

"The Supreme Court has looked at marriage and has said that the right to marry is a fundamental right for all citizens. So you call it interracial marriage and then you could prohibit it, no? The Supreme Court said no. The same thing here," explained Olson.

"The judge after hearing three weeks of testimony and full day of closing arguments and listening to experts from all over the world concluded that the denial of the right to marry to these individuals in California hurt them and did not advance the cause of opposite sex marriage," Olson continued.

"This is what judges are expected to do. It's not judicial activism. It's judicial responsibility in the classic sense."

As the lawyer that successfully argued Bush v. Gore before the Supreme Court in 2000, Olson's conservative credentials are unassailable. Wallace wanted to know why Olson would support gay rights in this case.

"We believe that a conservative value is stable relationships and stable community and loving individuals coming together and forming a basis that is a building block of our society, which includes marriage," said Olson.