The New York-based comic made a video explaining his rationale, in which he asks: "When is pointing out the color of someone's skin a way to honor them? Especially when it's not the color of their actual skin?"