Building nuclear reactors out of factory-produced modules was supposed to make their construction swifter and cheaper, leading to a new boom in nuclear energy.

But two U.S. sites where nuclear reactors are under construction have been hit with costly delays that have shaken faith in the new construction method and created problems concerning who will bear the added expense.

“Modular...