Prime Minister Scott Morrison has denounced "disgusting" critics who likened his worshipping at a weekend church service to the Nazi salute, in a broader stinging attack on "grubs" and "gutless keyboard warriors".

Mr Morrison, who along with Labor leader Bill Shorten temporarily suspended the election campaign to celebrate Easter services on Sunday, attended the Pentecostal Horizon Church in Sydney's Sutherland Shire with wife Jenny and young daughters Lily and Abbey.

Prime Minister Scott Morrison at Horizon Church on Easter Sunday. Credit:AAP

Mr Morrison allowed television cameras and photographers to accompany him into church in a move that took some government MPs by surprise.

Images of the Prime Minister clapping, singing and raising his hands in the air were roundly mocked on social media, including by the Construction, Forestry, Maritime, Mining and Energy Union which removed a post featuring a picture of Mr Morrison with the words "Beware of false prophets (or should that be profits?)".