TOKYO—Japan’s nuclear regulator gave safety clearance to two more reactors Wednesday, raising the prospect that Japan could have four units back online next year to help power the nation’s economy.

The approval comes three days after Prime Minister Shinzo Abe’s pro-nuclear party won decisively in a general election, suggesting a green light for pushing ahead with the resumption of nuclear power in Japan.

But...