Researchers have designed an inventive test suggesting that the arguments commonly used by climate change contrarians don't add up, not only according to climate scientists (we know what they think already) but also in the view of unbiased experts from other fields.

The trick? Disguising the data — and its interpretation — as if it was part of an argument about something else entirely.

"What we find is that whatever so called climate skeptics say about [climate] data just doesn't characterize the data adequately," said Stephan Lewandowsky, the new study's lead author and a psychologist at the University of Bristol. "It's as simple as that. It's judged to be misleading, false, and just incorrect basically," by independent experts from fields like economics and statistics, he said.

Lewandowsky, often a thorn in the side of climate skeptics or doubters, has previously published data linking rejection of the science of climate change to beliefs in conspiracy theories, leading to withering criticism from said skeptics. The new study was published in a peer-reviewed journal, Global Environmental Change, by Lewandowsky and colleagues from Australia, Switzerland and Norway. One of its authors, Rasmus Benestad, of the Norwegian Meteorological Institute, is a prominent climate scientist.

But wait: How is it actually possible to "disguise" climate-related arguments, so that they can be evaluated by other experts who don't know much of anything about climate change?

First of all, consider that climate doubters (like scientists) often use objective data to back up their claims. They just tend to represent it in ways that scientists have long found objectionable.

Here's an example: Data indicate that in the long run — over many decades — global temperatures have been rising. But over shorter periods, temperatures might fluctuate up and down quite a bit. Climate contrarians might exploit this fact by pointing to a small block of data from a short-term period when temperatures were on the downswing, or weren't rising, and use it to suggest that global warming isn't actually happening. It's a tactic known as "cherry-picking" — selecting only data that suit one's purposes, instead of data that reflect the whole story.

It's hard to talk about these problems, though, without the conversation turning into a figurative shouting match between mainstream climate science and climate doubters, who are generally going to disagree with one another no matter what. So Lewandowsky's group of researchers decided to take another tack.

They found a way to let an unbiased group of expert scientists judge for themselves how sound climate-doubting arguments are by presenting them with real climate data — but labelling these data as something else. For instance, they presented data on trends in Arctic sea ice extent, but re-labeled as data on the profits of a fictitious company. And they recast numbers on global sea-level rise as stats on world lithium production.

"So instead of saying, there's a recovery of Arctic ice, we would say, there's a recovery of our share prices," Lewandowsky said.

"The crucial step in this is you're taking out all preconceived notions, political biases, people's emotions about this," he added.

To set up the study, the researchers first recruited an expert set of economists and statisticians to serve as test participants. None of these participants knew the study had anything to do with climate change.

The researchers also compiled a list of contrarian statements commonly used by climate doubters to question the existence or extent of anthropogenic climate change — for instance, the idea that Arctic sea ice is growing, not shrinking. To make sure these statements were representative of ideas commonly included in contrarian discourse, the researchers conducted a search of prominent climate skeptic blogs, verifying that each chosen statement was a popular hit.

During the test, the researchers featured such a statement, along with the corresponding climate data — but they changed the labels and wording, making it appear that they were displaying information about entirely unrelated topics, such as agricultural output or business profits. They then asked the expert participants to answer a series of questions about whether they thought the given statement confirmed or contradicted the accompanying data; whether the statement seemed misleading; and whether the statement was appropriate for use by policy-makers or industries.

Just to shake things up a little, the researchers also administered the test to some participants using statements supporting the ideas of mainstream climate science (also disguised, of course). The difference between the responses in each case was striking.

"Across two groups of experts and across six different scenarios, contrarian claims were judged to be misleading, inaccurate, and unsuitable for policy advice," the researchers wrote in the paper. "Conversely, mainstream scientific interpretations were found to be accurate and suitable for policy advice overall."

"It's a huge effect," Lewandowsky added. "They are about as far apart as anything I've seen."

As an added test, the researchers asked the participants to predict what the masked data should look like in the future — and in general, the experts made predictions in line with what's been projected by mainstream climate scientists.

"So no one thought the Arctic was going to recover — they thought it was going to continue melting, because that is what the data show," Lewandowsky said.

But not everyone is convinced. According to Jonathan Jones, a physics professor at the University of Oxford who has critiqued previous research published by Lewandowsky, a problem with the study is the data it chooses to begin with.

Loading... Loading... Loading... Loading... Loading... Loading...

"The obvious problem is that because they have control over both the choice of data set used to assess a contrarian claim and over the corresponding 'consensus claim,' it is essentially trivial to construct situations where the data supports the consensus claim and opposes the contrarian claim," he added. "In reality, many of the real arguments are over precisely which data set to use (there are several competing data sets for global temperatures) and over which time periods to use (recent trends or longer term trends)."

Most climate scientists feel that using longer-term trends to make inferences and projections about the Earth's changing climate — say, for temperature increase or Arctic ice loss — is best practice, and that short-term trends are not always indicative of ongoing global patterns in factors like temperature or precipitation.

Those remaining skeptical of the science of climate change will surely object to the experimental design. But the researchers say the findings strip away preconceptions to prove a basic point: that across disciplines, experts know good science when they see it.