The International Olympic Committee is progressing toward an agreement that would give Paris the Summer Olympics in 2024 and Los Angeles the event four years later, according to people familiar with the matter.

While important details still need to be worked out, top officials overseeing the Olympic bids for the two cities are conceptually lining up behind the plan, these people said.

The...