The NBA charged Donald Sterling on Monday with damaging the league and its teams with his racist comments, setting up a June 3 hearing after which owners could vote to terminate his ownership of the Los Angeles Clippers.

The league also said the banned owner has engaged in other conduct that has impaired its relationship with fans and merchandising partners.

"All of these acts provide grounds for termination under several provisions of the NBA constitution and related agreements," the league said in a statement.

Sterling was banned for life and fined $2.5 million by Commissioner Adam Silver after the release of a recording in which he made racist remarks. He has until May 27 to respond to the charge, and the right to appear at the hearing and make a presentation before the board of governors. He has the right to a lawyer at the hearing, but strict courtroom rules of evidence would not apply.

Sterling's attorney, Maxwell Blecher, asked for a three-month delay in response to the charge, a person with knowledge of the situation said, confirming a report by SI.com. The league will not grant it, the person told The Associated Press on condition of anonymity because no official comments were authorized.

Minnesota Timberwolves owner Glen Taylor, the board chairman, will preside over the hearing in New York, which is planned for two days before the start of the NBA Finals. If three-quarters of the other 29 owners vote to sustain the charge, Sterling will be forced to sell the team he has owned since 1981.

Silver has said he is confident he has the 23 votes that are necessary.

Sterling told a female friend, V. Stiviano, not to bring black people to Clippers games during their conversation that was recorded. Sterling specifically mentioned Magic Johnson, then criticized the NBA Hall of Famer again as a poor role model during a recent interview with CNN.

"Among other things, Mr. Sterling disparaged African-Americans and 'minorities'; directed a female acquaintance not to associate publicly with African-Americans or to bring African-Americans to Clippers games; and criticized African-Americans for not supporting their communities," the NBA said.

The league also charged Sterling with destroying evidence and providing false and misleading evidence to the NBA investigator, and said the Clippers issued a false and misleading media statement about the matter. It also cited "a failure to use best efforts to see to it that the sport of professional basketball is conducted according to the highest moral and ethical standards."

Article 13 of the NBA's constitution, which deals with termination of ownership, states that one condition is if an owner fails or refuses "to fulfill its contractual obligations to the Association, its members, players, or any other third party in such a way as to affect the Association or its members adversely."

A number of sponsors suspended their deals with the Clippers in the wake of Sterling's remarks, potentially hurting league revenues, and players have said they would consider refusing to play next season if he still owned the team.

"Mr. Sterling's actions and positions significantly undermine the NBA's efforts to promote diversity and inclusion; damage the NBA's relationship with its fans; harm NBA owners, players and Clippers team personnel; and impair the NBA's relationship with marketing and merchandising partners, as well as with government and community leaders," the league said.

If Sterling did not respond to the charge within five business days, or does not appear at the hearing, it would be deemed an admission of the "total validity of the charges as presented," according to the constitution.

But even the players who want him out believe Sterling will fight, and his attorney sent a letter to the league last week informing it that Sterling wouldn't be paying the fine.

A message on the office voicemail of Blecher said he would have no comment now.

Sterling's estranged wife, Shelly, has said she will fight to keep her 50 percent share of the team even if Donald Sterling is forced to sell, but the league said in its statement that "all ownership interests in the Clippers will be terminated" if the charge is upheld.

Shelly Sterling's attorney, Pierce O'Donnell, said he was reviewing the charges.

"Based on our initial assessment, we continue to believe there is no lawful basis for stripping Shelly Sterling of her 50 percent ownership interest in the Clippers," O'Donnell said in a statement Monday. "She is the innocent estranged spouse. We also continue to hope that we can resolve this dispute with the NBA for the good of all constituencies."