HANNOVER, Germany—On a recent Saturday in a 19th-century Protestant church, Iranian and Afghan immigrants struggled to sing a hymn as the Rev. Hans-Jürgen Kutzner pointed to the German lyrics on a whiteboard.

Once a month, Mr. Kutzner gives a crash course in a neon-lit room adjacent to the church to prepare Muslims wishing to be baptized as Christians.

“What...