[What you need to know to start the day: Get New York Today in your inbox.]

When the Police Athletic League two weeks ago announced Bill O’Reilly as the speaker for its monthly business luncheon, organizers hoped the conservative writer and former Fox News host would be a big draw and raise a significant amount of money.

But the invitation led one board member to resign and drew criticism from the National Organization for Women. Then on Monday evening, after The New York Times inquired about O’Reilly’s appearance, the organization abruptly withdrew from Tuesday’s event and said it would not accept money raised from it, the executive director, Frederick J. Watts, said.

“We want speakers to bring light and good will to P.A.L.,” Mr. Watts said. “This speaker was distracting and it seemed inconsistent with that goal. It’s not much more complicated that.”

Mr. O’Reilly was pushed out of his job with Fox in 2017 after The Times reported he had been accused of sexual harassment by five women. His accusers agreed not to pursue litigation or speak out about the accusations in return for payouts that totaled about $13 million from the network or Mr. O’Reilly.