Is Blinded Review Enough? How Gendered Outcomes Arise Even Under Anonymous Evaluation Julian Kolev Yuly Fuentes-Medel Fiona Murray NBER Working Paper No. 25759

Issued in April 2019

NBER Program(s):Productivity, Innovation, and Entrepreneurship

For organizations focused on scientific research and innovation, workforce diversity is a key driver of success. Blinded review is an increasingly popular approach to reducing bias and increasing diversity in the selection of people and projects, yet its effectiveness is not fully understood. We explore the impact of blinded review on gender inclusion in a unique setting: innovative research grant proposals submitted to the Gates Foundation from 2008-2017. Despite blinded review, female applicants receive significantly lower scores, which cannot be explained by reviewer characteristics, proposal topics, or ex-ante measures of applicant quality. By contrast, the gender score gap is no longer significant after controlling for text-based measures of proposals’ titles and descriptions. Specifically, we find strong gender differences in the usage of broad and narrow words, suggesting that differing communication styles are a key driver of the gender score gap. Importantly, the text-based measures that predict higher reviewer scores do not also predict higher ex-post innovative performance. Instead, female applicants exhibit a greater response in follow-on scientific output after an accepted proposal, relative to male applicants. Our results reveal that gender differences in writing and communication are a significant contributor to gender disparities in the evaluation of science and innovation. You may purchase this paper on-line in .pdf format from SSRN.com ($5) for electronic delivery. Access to NBER Papers You are eligible for a free download if you are a subscriber, a corporate associate of the NBER, a journalist, an employee of the U.S. federal government with a ".GOV" domain name, or a resident of nearly any developing country or transition economy. If you usually get free papers at work/university but do not at home, you can either connect to your work VPN or proxy (if any) or elect to have a link to the paper emailed to your work email address below. The email address must be connected to a subscribing college, university, or other subscribing institution. Gmail and other free email addresses will not have access. E-mail:

Supplementary materials for this paper:

data appendix Acknowledgments Machine-readable bibliographic record - MARC, RIS, BibTeX Document Object Identifier (DOI): 10.3386/w25759