Alabama Supreme Court Chief Justice Roy Moore says two U.S. Supreme Court Justices should recuse themselves from an upcoming vote on gay marriage because they have performed the marriages of same-sex couples.

Justices Ruth Bader Ginsburg and Elena Kagan have both performed same-sex marriages, which indicates how they may vote on the issues of gay marriage, Moore said in an interview with AL.com on Thursday. "Their actions speak louder than their words," he said.

The U.S. Supreme Court in April is set to hear an appeal from U.S. 6th Circuit Court of Appeals decisions upholding bans on same-sex marriage in Ohio, Michigan, Kentucky and Tennessee. The ruling is set to be issued in June and and settle the issue in other states, including Alabama.

Moore has been an outspoken supporter of Alabama's laws banning same-sex marriage and the definition of marriage as being between a man and a woman.

The day before a Mobile federal judge's ruling declaring the state's ban unconstitutional went into effect (after the U.S. Supreme Court and , Moore sent an advisory to state probate judges not to issue marriage licenses. He also was interviewed by various media outlets.

Moore's wife, Kayla Moore, who is president of the President of the Montgomery-based Foundation for Moral Law, in September had also called upon Kagan and Ginsburg to recuse themselves from a case for the same reason.

Because of his advisory opinion to probate judges and his interviews in recent weeks, Moore said he abstained from voting on Tuesday's ruling by the other members of the Alabama Supreme Court ordering state probate judges to stop issuing marriage licenses to same-sex couples. "I abstained from voting to avoid the appearance of impropriety," he said.

Moore said the ruling was from his fellow justices and he played no role in writing it. He said he "didn't push the rest of the court."