Anglican Archbishop of Sydney Glenn Davies has told Anglican supporters of same-sex marriage they should leave the church rather than "betray God's word" in a scathing speech condemning progressive elements within the faith.

He said the church must focus on "evangelising Australia" rather than "the constant pressure to change our doctrine in order to satisfy the lusts and pleasures of the world".

Anglican Archbishop of Sydney Glenn Davies said supporters of same-sex marriage should leave the church. Credit:Kate Geraghty

Dr Davies directed his strongest criticism at church branches that had moved to bless same-sex unions, such as the Wangaratta diocese in Victoria. That decision has now been referred to the church's internal appeals tribunal.

Addressing the 51st Synod of the Diocese of Sydney, the Anglican church's parliament, on Monday, Dr Davies warned the church had "entered treacherous waters" and called on those who supported same-sex marriage to leave.