It’s no use simply telling people they have their facts wrong. To be more effective at correcting misinformation in news accounts and intentionally misleading “fake news,” you need to provide a detailed counter-message with new information – and get your audience to help develop a new narrative. Those are some takeaways from an extensive new meta-analysis of debunking studies published in the journal Psychological Science, a journal of the Association for Psychological Science.

The analysis, the first conducted with this collection of debunking data, finds that a detailed counter-message is better at persuading people to change their minds than merely labeling misinformation as wrong. But even after a detailed debunking, misinformation still can be hard to eliminate, the study finds.

“The effect of misinformation is very strong,” said co-author Dolores Albarracín, professor of psychology at the University of Illinois at Urbana-Champaign. “When you present it, people buy it. But we also asked whether we are able to correct for misinformation. Generally, some degree of correction is possible but it’s very difficult to completely correct.”

The study was conducted by researchers at the Social Action Lab at the University of Illinois at Urbana-Champaign and at the Annenberg Public Policy Center of the University of Pennsylvania. In total, they examined 20 experiments in eight research reports involving 6,878 participants and 52 independent samples.

The analyzed studies, published from 1994 to 2015, focused on false social and political news accounts, including misinformation in reports of robberies; investigations of a warehouse fire and traffic accident; the supposed existence of “death panels” in the 2010 Affordable Care Act; positions of political candidates on Medicaid; and a report on whether a candidate had received donations from a convicted felon.

The researchers coded and analyzed the results of the experiments across the different studies and measured the effect of presenting misinformation, the effect of debunking, and the persistence of misinformation.

“This analysis provides evidence of the value of the extended correction of misinformation,” said co-author Kathleen Hall Jamieson, director of the Annenberg Public Policy Center (APPC) and co-founder of its project FactCheck.org, which aims to reduce the level of deception in politics and science. “Simply stating that something is false or providing a brief explanation is largely ineffective.”

The lead author, Man-pui Sally Chan, a research assistant professor in psychology at the University of Illinois at Urbana-Champaign, said the study found that “the more detailed the debunking message, the higher the debunking effect. But misinformation can’t easily be undone by debunking. The formula that undercuts the persistence of misinformation seems to be in the audience.”

As the researchers reported: “A detailed debunking message correlated positively with the debunking effect. Surprisingly, however, a detailed debunking message also correlated positively with the misinformation-persistence effect.”

However, Albarracín said the analysis also showed that debunking is more effective – and misinformation is less persistent – when an audience develops an explanation for the corrected information.

“What is successful is eliciting ways for the audience to counterargue and think of reasons why the initial information was incorrect,” she said.

For news outlets, involving an audience in correcting information could mean encouraging commentary, asking questions, or offering moderated reader chats – in short, mechanisms to promote thoughtful participation.

The researchers made three recommendations for debunking misinformation:

Reduce arguments that support misinformation : News accounts about misinformation should not inadvertently repeat or belabor “detailed thoughts in support of the misinformation.”

: News accounts about misinformation should not inadvertently repeat or belabor “detailed thoughts in support of the misinformation.” Engage audiences in scrutiny and counterarguing of information : Educational institutions should promote a state of healthy skepticism. When trying to correct misinformation, it is beneficial to have the audience involved in generating counterarguments.

: Educational institutions should promote a state of healthy skepticism. When trying to correct misinformation, it is beneficial to have the audience involved in generating counterarguments. Introduce new information as part of the debunking message: People are less likely to accept debunking when the initial message is just labeled as wrong rather than countered with new evidence.

The authors also included Christopher R. Jones, a former postdoctoral fellow at APPC and at the University of Illinois.

All data have been made publicly available via the Open Science Framework. The complete Open Practices Disclosure for this article is available online. This article has received the badge for Open Data.

Research reported in this article was supported by the National Cancer Institute of the National Institutes of Health (NIH) and Food and Drug Administration (FDA) Center for Tobacco Products (Award No. P50CA179546). The content is solely the responsibility of the authors and does not necessarily reflect the official views of the NIH or the FDA.