Whenever I write about the problem of the casual sexual harassment of women in public, someone inevitably attempts to derail the conversation by saying: “It happens to men, too.” And it does—but that’s not the whole story. A new nationally-representative survey, released today by the advocacy organization Stop Street Harassment with the help of market research firm GfK, gives voice to the men who are harassed in public, while demonstrating just how gendered the phenomenon really is.

The resulting report is based off a survey administered to 2,000 people across the United States, plus interviews with ten focus groups among marginalized people around the country, like Native Americans in South Dakota and gay, bisexual, and trans men in D.C. It found that 65 percent of women and 25 percent of men reported experiencing public harassment in their lifetimes. More than half of women in the survey reported experiencing verbal harassment, while 41 percent had experienced physical aggression in public: 23 percent of women reported nonconsensual sexual touching, 20 percent had been followed down the street, 14 percent had been flashed, and 9 percent had been “forced to do something sexual” while out and about. Meanwhile, 18 percent of men had experienced verbal harassment and 16 percent had experienced physical aggression in public. Eight percent of men said they’ve been touched nonconsensually, 7 percent had been followed, 5 percent had been flashed, and 2 percent had been forced to do something sexual. Women were also more likely than men to say the harassment “happened sometimes, often, or daily,” and were more likely to respond to the threat of harassment by “constantly assessing their surroundings” or avoiding walking alone. Julia, a 14-year-old Latina girl living in Florida, said that she had not yet been harassed, but still frequently altered her route in fear that she might be.

Here’s a graph from the report that illustrates the severity of the problem by gender:

Among women, street harassment most commonly took the form of sexualized commentary like whistles, “pssssst” sounds, animal noises, and statements like “mmm, sexy”—51 percent of women reported these incidents, compared to six percent of men. But harassment against men often took on a different sexual element. The most frequent type of harassment reported by men came in the form of homophobic or transphobic slurs (which had been experienced by 9 percent of men in the survey). Gay, bisexual, and trans men were much more likely than straight men to report experiencing harassment, and to experience it frequently. (Meanwhile, heterosexual men were the most likely of any group to say they had been harassed just once in their lives.) Men who were targeted were often harassed for failing to look and act typically masculine. In one focus group, gay, bi, and trans men reported being harassed for holding hands with other men, for carrying accessories that were perceived as feminine, or for wearing brightly colored clothing. “There was a while where I had a pink umbrella I got at the Cherry Blossom Festival,” one man said, “and I would carry it around because it’s a goddamn umbrella and who cares, but apparently plenty of people care. A guy by the bus stop around the corner from my apartment even threatened to rape me with it … I changed my bus route.” Another said that he often modified his appearance in an attempt to avoid harassment: “I butch myself up more to go on certain bus lines,” he said. “Like, I often paint my nails but when I go up there, I take off the polish.”

In fact, the survey found that everyone who’s not a wealthy, straight, white man is disproportionately affected by public harassment. That includes women and LGBT people, but also lower-income people and people of color. Meanwhile, the people responsible for the harassment of both men and women were overwhelmingly male. Seventy percent of female victims and 48 percent of male ones reported being harassed by a lone man; 38 percent of the women and 25 percent of the men reported being harassed by a group of men; and 20 percent of male victims reported being harassed by a lone woman. (Some respondents chose more than one category of harasser; the race, class, and sexuality of harassers weren’t investigated as a part of the survey.) One way or another, street harassment is everybody’s problem. But like many forms of gendered violence, the ubiquity of the phenomenon serves to reflect the toxic power structures inherent in American society—not provide evidence of an equal-opportunity offense.