Hong Kong (CNN Business) Saudi Arabia's big investment conference is losing more high-profile guests as the international crisis over the disappearance of journalist Jamal Khashoggi intensifies.

The latest to drop out are the managing director of the International Monetary Fund and the heads of two major French banks.

The Saudi event, known as "Davos in the desert," has suffered an exodus of global business leaders , including the CEOs of JPMorgan Chase ( JPM ) and Uber, in the past week as questions have mounted over the fate of Khashoggi, a prominent critic of the Saudi government.

The IMF said in a statement late Tuesday that Managing Director Christine Lagarde's trip to the Middle East for the conference next week "is being deferred."

It's an abrupt change of position from Lagarde, who said as recently as Saturday that she still planned to speak at the event in Riyadh despite being horrified by reports about Khashoggi's disappearance.