In studies of educational achievement, students’ self-reported number of books in the family home is a frequently used proxy for social, cultural, and economic background. Absent hard evidence about what this variable captures or how well, its use has been motivated by strong associations with student outcomes. I show that these associations rest on two types of endogeneity: Low achievers accrue fewer books and are also prone to underestimate their number. The conclusion is substantiated both by comparing reports by students and their parents and by the fact that girls report on average higher numbers despite being similar to boys on other measures of social background. The endogenous bias is large enough to overturn classical attenuation bias; it distorts cross-country patterns and invalidates many common study designs. These findings serve as a caution against overreliance on standard regression assumptions and contribute to ongoing debates about the empirical robustness of social science.

References

Ammermueller, Andreas, Pischke, Jörn-Steffen. 2009 . “ Peer Effects in European Primary Schools: Evidence from the Progress in International Reading Literacy Study .” Journal of Labor Economics 27: 315 – 48 .

Google Scholar ISI

Andersen, Anette, Krølner, Rikke, Currie, Candace, Dallago, Lorenza, Due, Pernille, Richter, Matthias, Örkényi, Agota, Holstein, Bjørn Evald. 2008 . “ High Agreement on Family Affluence between Children’s and Parents’ Reports .” Journal of Epidemiology and Community Health 62: 1092 – 94 .

Google Scholar Medline | ISI

Bernardi, Fabrizio, Chakhaia, Lela, Leopold, Liliya. 2017 . “ Sing Me a Song with Social Significance: The (Mis)Use of Statistical Significance Testing in European Sociological Research .” European Sociological Review 33: 1 – 15 .

Google Scholar

Betts, Julian R. 2011 . “ The Economics of Tracking in Education .” Pp. 341 – 81 in Handbook of the Economics of Education, Vol. 3, edited by Hanushek, E. A., Machin, S., Woessmann, L.. Amsterdam, the Netherlands : North-Holland .

Google Scholar

Black, Dan, Sanders, Seth, Taylor, Lowell. 2003 . “ Measurement of Higher Education in the Census and Current Population Survey .” Journal of the American Statistical Association 98: 545 – 54 .

Google Scholar ISI

Bohrnstedt, George W. 2010 . “ Measurement Models for Survey Research .” Pp. 347 – 404 in Handbook of Survey Research, 2nd ed ., edited by Rossi, P. H., Wright, J. D., Anderson, A. B.. Academic Press, Bingley, UK : Emerald .

Google Scholar

Bollen, Kenneth A., Biemer, Paul P., Karr, Alan F., Tueller, Stephen, Berzofsky, Marcus E.. 2016 . “ Are Survey Weights Needed? A Review of Diagnostic Tests in Regression Analysis .” Annual Review of Statistics and Its Application 3: 375 – 92 .

Google Scholar

Breen, Richard, Jonsson, Jan O.. 2005 . “ Inequality of Opportunity in Comparative Perspective: Recent Research on Educational Attainment and Social Mobility .” Annual Review of Sociology 31: 223 – 43 .

Google Scholar ISI

Brese, Falk, Mirazchiyski, Plamen. 2013 . Measuring Students’ Family Background in Large-scale International Education Studies. Hamburg, Germany : IEA-ETS Research Institute .

Google Scholar

Brunello, Giorgio, Checchi, Daniele. 2007 . “ Does School Tracking Affect Equality of Opportunity? New International Evidence .” Economic Policy 22: 782 – 861 .

Google Scholar

Brunello, Giorgio, Weber, Guglielmo, Weiss, Christoph T.. 2017 . “ Books Are Forever: Early Life Conditions, Education and Lifetime Earnings in Europe .” Economic Journal 127: 271 – 96 .

Google Scholar

Buchmann, Claudia, DiPrete, Thomas A., McDaniel, Anne. 2008 . “ Gender Inequalities in Education .” Annual Review of Sociology 34: 319 – 37 .

Google Scholar ISI

Caro, Daniel H., Lenkeit, Jenny. 2012 . “ An Analytical Approach to Study Educational Inequalities: 10 Hypothesis Tests in PIRLS 2006 .” International Journal of Research & Method in Education 35: 3 – 30 .

Google Scholar

Checchi, Daniele, Werfhorst, Herman G. van de. 2017 . “ Policies, Skills and Earnings: How Educational Inequality Affects Earnings Inequality .” Socio-Economic Review 16: 137 – 60 .

Google Scholar

Chiu, Ming Ming . 2007 . “ Families, Economies, Cultures, and Science Achievement in 41 Countries: Country-, School-, and Student-level Analyses .” Journal of Family Psychology 21: 510 – 19 .

Google Scholar Medline | ISI

Chiu, Ming Ming . 2010 . “ Effects of Inequality, Family and School on Mathematics Achievement: Country and Student Differences .” Social Forces 88: 1645 – 76 .

Google Scholar ISI

Chudgar, Amita, Luschei, Thomas F.. 2009 . “ National Income, Income Inequality, and the Importance of Schools: A Hierarchical Cross-national Comparison .” American Educational Research Journal 46: 626 – 58 .

Google Scholar SAGE Journals | ISI

Cohen, Roberta S., Orum, Anthony M.. 1972 . “ Parent-child Consensus on Socioeconomic Data Obtained from Sample Surveys .” Public Opinion Quarterly 36: 95 – 98 .

Google Scholar

Cook, John R., Stefanski, Leonard A.. 1994 . “ Simulation-extrapolation Estimation in Parametric Measurement Error Models .” Journal of the American Statistical Association 89: 1314 – 28 .

Google Scholar ISI

Engzell, Per, Jonsson, Jan O.. 2015 . “ Estimating Social and Ethnic Inequality in School Surveys: Biases from Child Misreporting and Parent Nonresponse .” European Sociological Review 31: 312 – 25 .

Google Scholar

Ensminger, Margaret E., Forrest, Christopher B., Riley, Anne W., Kang, Myungsa, Green, Bert F., Starfield, Barbara, Ryan, Sheryl A.. 2000 . “ The Validity of Measures of Socioeconomic Status of Adolescents .” Journal of Adolescent Research 15: 392 – 419 .

Google Scholar SAGE Journals | ISI

Epple, Dennis, Romano, Richard. 2011 . “ Peer Effects in Education: A Survey of the Theory and Evidence .” Pp. 1053 – 163 in Handbook of Social Economics, Vol. 1, edited by Benhabib, J., Bisin, A., Jackson, M. O.. Amsterdam, the Netherlands : North-Holland .

Google Scholar

Esping-Andersen, Gøsta . 2009 . The Incomplete Revolution. Cambridge, MA : Polity .

Google Scholar

Evans, M. D. R., Kelley, Jonathan, Sikora, Joanna. 2014 . “ Scholarly Culture and Academic Performance in 42 Nations .” Social Forces 92: 1573 – 605 .

Google Scholar ISI

Evans, M. D. R., Kelley, Jonathan, Sikora, Joanna, Treiman, Donald J.. 2010 . “ Family Scholarly Culture and Educational Success: Books and Schooling in 27 Nations .” Research in Social Stratification and Mobility 28: 171 – 97 .

Google Scholar ISI

Evans, M. D. R., Kelley, Jonathan, Sikora, Joanna, Treiman, Donald J.. 2015 . “ Scholarly Culture and Occupational Success in 31 Societies .” Comparative Sociology 14: 176 – 218 .

Google Scholar

Ferreira, Francisco H. G., Gignoux, Jérémie. 2014 . “ The Measurement of Educational Inequality: Achievement and Opportunity .” World Bank Economic Review 28: 210 – 46 .

Google Scholar ISI

Franco, Annie, Malhotra, Neil, Simonovits, Gabor. 2014 . “ Publication Bias in the Social Sciences: Unlocking the File Drawer .” Science 345: 1502 – 05 .

Google Scholar Medline | ISI

Freeman, Richard B., Viarengo, Martina. 2014 . “ School and Family Effects on Educational Outcomes Across Countries .” Economic Policy 29: 395 – 446 .

Google Scholar ISI

Freese, Jeremy, Peterson, David. 2017 . “ Replication in Social Science .” Annual Review of Sociology 43: 147 – 65 .

Google Scholar

Gelman, Andrew, Loken, Eric. 2014 . “ The Statistical Crisis in Science: Data-dependent Analysis—A ‘Garden of Forking Paths’—Explains Why Many Statistically Significant Comparisons Don’t Hold Up .” American Scientist 102: 460 – 65 .

Google Scholar ISI

Hanushek, Eric A., Woessmann, Ludger. 2011 . “ The Economics of International Differences in Educational Achievement .” Pp. 89 – 200 in Handbook of the Economics of Education, Vol. 3, edited by Hanushek, E. A., Machin, S., Woessmann, L.. Amsterdam, the Netherlands : North-Holland .

Google Scholar

Holley, Charles E. 1916 . The Relationship Between Persistence in School and Home Conditions. Chicago, IL : University of Chicago Press .

Google Scholar

Ioannidis, John . 2012 . “ Why Science Is Not Necessarily Self-correcting .” Perspectives on Psychological Science 7: 645 – 54 .

Google Scholar SAGE Journals | ISI

Jerrim, John, Micklewright, John. 2014 . “ Socio-economic Gradients in Children’s Cognitive Skills: Are Cross-country Comparisons Robust to Who Reports Family Background? ” European Sociological Review 30: 766 – 81 .

Google Scholar

Kane, Thomas J., Rouse, Cecilia Elena, Staiger, Douglas. 1999 . “ Estimating Returns to Schooling When Schooling Is Misreported .” Working Paper no. 7235, National Bureau of Economic Research, Cambridge : Massachusetts .

Google Scholar

Kerckhoff, Alan C., Mason, William M., Poss, Sharon S.. 1973 . “ On the Accuracy of Children’s Reports of Family Social Status .” Sociology of Education 46: 219 – 47 .

Google Scholar ISI

Kreuter, Frauke, Eckman, Stephanie, Maaz, Kai, Watermann, Rainer. 2010 . “ Children’s Reports of Parents’ Education Level: Does It Matter Whom You Ask and What You Ask About? ” Survey Research Methods 4: 127 – 38 .

Google Scholar

Küchenhoff, Helmut, Mwalili, Samuel M., Lesaffre, Emmanuel. 2006 . “ A General Method for Dealing with Misclassification in Regression: The Misclassification SIMEX .” Biometrics 62: 85 – 96 .

Google Scholar Medline

Landis, J. Richard, Koch, Gary G.. 1977 . “ The Measurement of Observer Agreement for Categorical Data .” Biometrics 33: 159 – 74 .

Google Scholar Medline | ISI

Looker, E. Dianne . 1989 . “ Accuracy of Proxy Reports of Parental Status Characteristics .” Sociology of Education 62: 257 – 76 .

Google Scholar ISI

Marks, Gary N. 2005 . “ Cross-national Differences and Accounting for Social Class Inequalities in Education .” International Sociology 20: 483 – 505 .

Google Scholar SAGE Journals | ISI

Marks, Gary N., Cresswell, John, Ainley, John. 2006 . “ Explaining Socioeconomic Inequalities in Student Achievement: The Role of Home and School Factors .” Educational Research and Evaluation 12: 105 – 28 .

Google Scholar

Martins, Lurdes, Veiga, Paula. 2010 . “ Do Inequalities in Parents’ Education Play an Important Role in PISA Students Mathematics Achievement Test Score Disparities? ” Economics of Education Review 29: 1016 – 33 .

Google Scholar

Micklewright, John, Schnepf, Sylke V.. 2010 . “ How Reliable Are Income Data Collected with a Single Question? ” Journal of the Royal Statistical Society, Series A 173: 409 – 29 .

Google Scholar

Mullis, Ina V. S., Martin, Michael O., Foy, Pierre, Drucker, Kathleen T.. 2012 . PIRLS 2011 International Results in Reading. Amsterdam, the Netherlands : IEA .

Google Scholar

Mullis, Ina V. S., Martin, Michael O., Kennedy, Ann M., Trong, Kathleen L., Sainsbury, Marian. 2009 . PIRLS 2011 Assessment Framework. Amsterdam, the Netherlands : IEA .

Google Scholar

Muñoz, John, Young, Cristobal. 2018 . “ We Ran 9 Billion Regressions: Eliminating False Positives through Computational Model Robustness .” Sociological Methodology, early access. 48: 1 – 33 . doi:10.1177/0081175018777988.

Google Scholar SAGE Journals

Open Science Collaboration . 2015 . “ Estimating the Reproducibility of Psychological Science .” Science 349: aac4716 .

Google Scholar Medline | ISI

Park, Hyunjoon . 2008 . “ Home Literacy Environments and Children’s Reading Performance: A Comparative Study of 25 Countries .” Educational Research and Evaluation 14: 489 – 505 .

Google Scholar

Rosenbaum, Paul R., Rubin, Donald B.. 1983 . “ Assessing Sensitivity to an Unobserved Binary Covariate in an Observational Study with Binary Outcome .” Journal of the Royal Statistical Society, Series B 45: 212 – 18 .

Google Scholar

Rutkowski, Leslie, Rutkowski, David. 2010 . “ Getting It Better: The Importance of Improving Background Questionnaires in International Large-scale Assessments .” Journal of Curriculum Studies 42: 411 – 30 .

Google Scholar ISI

Salvi del Pero, Angelica, Bytchkova, Alexandra. 2013 . “ A Bird’s Eye View of Gender Differences in Education in OECD Countries .” OECD Social, Employment and Migration Working Papers, No. 149, OECD Publishing, Paris. doi:10.1787/5k40k706tmtb-en.

Google Scholar

Saylor, Ryan . 2013 . “ Concepts, Measures, and Measuring Well: An Alternative Outlook .” Sociological Methods & Research 42: 354 – 91 .

Google Scholar SAGE Journals | ISI

Schütz, Gabriela, Ursprung, Heinrich W., Woessmann, Ludger. 2008 . “ Education Policy and Equality of Opportunity .” Kyklos 61: 279 – 308 .

Google Scholar ISI

Silberzahn, Raphael, Uhlmann, Eric L., Martin, Daniel P., Anselmi, Pasquale, Aust, Frederik, Awtrey, Eli C., Bahník, Štěán. 2018 . “ Many Analysts, One Dataset: Making Transparent How Variations in Analytical Choices Affect Results .” Advances in Methods and Practices in Psychological Science 1: 337 – 356 .

Google Scholar SAGE Journals

Simmons, Joseph P., Nelson, Leif D., Simonsohn, Uri. 2011 . “ False-positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant .” Psychological Science 22: 1359 – 66 .

Google Scholar SAGE Journals | ISI

Stapleton, Laura M., Kang, Yoonjeong. 2018 . “ Design Effects of Multilevel Estimates from National Probability Samples .” Sociological Methods & Research 47: 430 – 57 .

Google Scholar SAGE Journals | ISI

The New York Times . 2011 . “ A Book in Every Home, and Then Some .” The Opinion Pages, David Bornstein. May 16, 2011.

Google Scholar

The New York Times . 2015 a. “ America’s Students Are Lagging. Maybe It’s Not the Schools .” Economic Scene, Eduardo Porter. November 4, 2015, B1.

Google Scholar

The New York Times . 2015 b. “ Our Bare Shelves, Our Selves .” Future Tense, Teddy Wayne. December 6, 2015, ST2 .

Google Scholar

Thorndike, Robert L. 1973 . “ The Relation of School Achievement to Differences in the Backgrounds of Children .” Pp. 93 – 104 in Educational Policy and International Assessment: Implications of the IEA Surveys of Achievement, edited by Purves, A. C., Levine, D. U.. Berkeley, CA : McCutchan .

Google Scholar

van de, Werfhorst, Herman, G., Mijs, Jonathan J. B.. 2010 . “ Achievement Inequality and the Institutional Structure of Educational Systems: A Comparative Perspective .” Annual Review of Sociology 36: 407 – 28 .

Google Scholar

Vereecken, Carine, Vandegehuchte, Ann. 2003 . “ Measurement of Parental Occupation: Agreement between Parents and Their Children .” Archives of Public Health 61: 141 – 49 .

Google Scholar

West, Patrick, Sweeting, Helen, Speed, Ewen. 2001 . “ We Really Do Know What You Do: A Comparison of Reports From 11 Year Olds and Their Parents in Respect of Parental Economic Activity and Occupation .” Sociology 35: 539 – 59 .

Google Scholar SAGE Journals | ISI