Josh McLemore works six days a week as a teaching pastor for the House of Joy church in Valdosta, Ga.

In his spare time, he pursues another passion: Making rap videos about Minecraft, a videogame in which blocky characters wander a blocky landscape, building things, digging up diamonds and sipping milk.

"It's...