At St. Andrew's Church in Albany Sunday, some parishioners burned Bishop Love's letter outside the church, praying while they did it.

The rector there, The Reverend Mary White, says she's heard from her parishioners.

"That they would like to be married in the church because they are active members in the church," she said. "I will as soon as I can."

Right now, she says she is bound to obey her bishop's decision, but she stands by her beliefs.

"That all people are created in God's image. And that all people are equal and all people are deserving of love," said Reverend White.

Bishop Love writes that allowing gay marriage ignores the authority of the Holy Scripture. He has tremendous support from his clergy; he got standing ovations at a clergy meeting Saturday.

However, it's a painful time for the faithful, like Louis Bower Bannister.

"It's not easy, but none of us will know if this is the right thing or the wrong thing until the day comes," said Bannister. "And when the day comes for me, I would rather, I would rather be sent to hell for holding the door open for everyone, than closing it in someone's face."

The head of the national Episcopal Church has responded. Presiding Bishop Michael Curry, the priest who gave a sermon at Prince Harry's wedding, says he's in talks with Albany Bishop Love.

He added a reminder that those who took vows must follow what the church has decided, which is, in this case, to give rectors the ability to marry same-sex couples.