In the six months since Harvey Weinstein built his new “dream team” of heavy-hitting lawyers to represent him against sexual assault charges in Manhattan, the movie producer’s carefully selected legal cast has completely fallen apart.

Mr. Weinstein, whose alleged sexual misconduct set in motion the global #MeToo movement, and his first lawyer parted ways in January. He then hired a team that included a former Manhattan prosecutor and three attorneys who had defended celebrities and some of the country’s most vilified defendants.

But one by one, Mr. Weinstein’s new lawyers have bowed out. With less than three months until the trial begins, Jose Baez, one of the producer’s last remaining lawyers, asked a State Supreme Court justice in Manhattan to allow him to withdraw from the case, according to a person with knowledge of the matter, who spoke on the condition of anonymity to discuss private communications.

“Mr. Weinstein has been aware since at least May 15 that it was very unlikely that I would be able to continue on this case,” Mr. Baez said in a letter to Justice James Burke on Friday.