Coach Inc.'s fiscal fourth-quarter earnings rose 24%, but shares spiraled downward as sluggishness in the U.S. raised concerns about upper-end spending.

"Over the (fiscal) fourth quarter, the economic backdrop in the U.S. clearly softened as consumer confidence and sentiment declined," Chief Executive Lew Frankfort said on a conference call.

Sales...