Mr. Schlossberg’s rant angered activists for immigrant rights, who said it reinforced stereotypes that Spanish speakers are not citizens. And they worried that it perpetuated fear within immigrant communities of ICE’s aggressive tactics to deport those who are undocumented.

Most problematic, Mr. Espaillat said, the vitriolic video showed Mr. Schlossberg’s inherent bias were he to represent a man who speaks Spanish. (His firm’s website lists services in four languages: Spanish, French, Chinese and Hebrew.)

“What if things did not go well for that particular client?” Mr. Espaillat said. “That client can assume that it was because of how he feels about people who speak another language.”

In the days after his outburst, Mr. Schlossberg received thousands of messages of protest on social media, and protesters gathered in front of both his office and apartment.

Mr. Schlossberg did not in fact have a physical office in midtown, but he had an agreement with a company, Corporate Suites, to use the mailing address and business center at 275 Madison Avenue, said the president of the company, Hiyam Grant. Now, Mr. Schlossberg has even lost his virtual office.

In an interview, Mr. Grant said he terminated the contract after Mr. Schlossberg made his comments because he was concerned about the safety and security of other clients and staff, many of whom are from all over the world. “They speak many different languages, and just the fact that one person is very upset about foreign languages being spoken is very foreign to me running any business in New York,” Mr. Grant said.

Mr. Schlossberg was filmed hiding behind an umbrella to duck reporters last week. New York’s Commission on Human Rights appeared at Fresh Kitchen on Friday to tell employees how to file a complaint.