New York is known for its food niche stores: The Hummus Place. The Doughnut Plant. The Dumpling Man. Even a spot dedicated solely to rice pudding.

But this week, a store in the East Village went a step further: It sells New York City tap water.

Not just any tap water, insist the owners of Molecule. They say the water...