Asking whether there are sex differences in the human brain is a bit like asking whether coffee is good for you—scientists can’t seem to make up their minds about the answer. In 2013, for example, news stories proclaimed differences in the brain so dramatic that men and women “might almost be separate species.” Then in 2015, headlines announced that there are in fact no sex differences in the brain at all. Even as I write this, more findings of differences are coming out.

So which is it? Are there differences between men’s and women’s brains—or not?

What is a sex difference?

To clear up the confusion, we need to consider what the term “sex difference” really means in the scientific literature. To illustrate the concept, I’ve used a web-based tool I helped develop, SexDifference.org, to plot some actual data. The three graphs below show how measurements from a sample of people are distributed along a scale. Women are represented in pink, and men in blue. Most people are close to the average for their sex, so that’s the peak of each “bump.” People on the left or right side of the peak are below or above average, respectively, for their sex.

I’ve added individual data points for three hypothetical study subjects Sue, Ann and Bob. Not real people, just examples. Their data points are superimposed on the larger data set of hundreds of people.

Before we get into the brain, let’s look at a couple of familiar sex differences outside the brain. Many of us, if asked to describe how men’s bodies differ from women’s, would first mention the sex difference in external genitalia. The graph below depicts the number of nontransgender adults that have a “genital tubercle derivative” (clitoris or penis) of a given size.