To turn its luck around, Nikon needs to start breaking some mirrors.

That's not normally thought of as a way to good fortune, but mirrors—specifically, the ones that add bulk to its high-end single-lens-reflex cameras—are one of Nikon's biggest problems right now.

The digital camera market is in sharp decline as smartphones spread. Compact...