Direct assessments of explicit racial attitudes, such as reporting an overt preference for White versus Black people, may raise social desirability concerns and reduce measurement quality. As a result, researchers have developed more indirect self-report measures of explicit racial attitudes. While such measures dampen social desirability concerns, they may weaken measurement quality by assessing construct-irrelevant attitudes, thereby lowering correspondence between measure and construct. To investigate whether direct or indirect self-report measures better assess explicit racial attitudes, participants ( N > 800,000) completed an implicit racial attitude measure and a subset of over 400 items that varied in the degree to which they were indirect or direct assessments of self-reported racial attitudes. More direct assessments of racial preferences were better predictors of implicit racial attitudes and maximized differences between Black and White participants. These results suggest that the best method to measure individuals’ explicit racial attitudes is to ask about them directly.

References

Ajzen, I., Fishbein, M. ( 1977 ). Attitude-behavior relations . Psychological Bulletin, 84, 888 – 918 .

Google Scholar ISI

Altemeyer, R. A. ( 1981 ). Right-wing authoritarianism. Winnipeg, Canada : University of Manitoba Press .

Google Scholar

Alwin, D. F., Krosnick, J. A. ( 1991 ). The reliability of survey attitude measurement the influence of question and respondent attributes . Sociological Methods & Research, 20, 139 – 181 .

Google Scholar SAGE Journals | ISI

Blincoe, S., Harris, M. J. ( 2009 ). Prejudice reduction in white students: Comparing three conceptual approaches . Journal of Diversity in Higher Education, 2, 232 – 242 .

Google Scholar

Bobo, L., Kluegel, J. R. ( 1993 ). Opposition to race-targeting: Self-interest, stratification ideology, or racial attitudes? American Sociological Review, 58, 443 – 464 .

Google Scholar ISI

Brigham, J. C. ( 1993 ). College students’ racial attitudes . Journal of Applied Social Psychology, 23, 1933 – 1967 .

Google Scholar ISI

Britt, T. W., Bonieci, K. A., Vescio, T. K., Biernat, M., Brown, L. M. ( 1996 ). Intergroup anxiety: A person × situation approach . Personality and Social Psychology Bulletin, 22, 1177 – 1188 .

Google Scholar SAGE Journals | ISI

Cao, J., Banaji, M. R. ( 2016 ). The base rate principle and the fairness principle in social judgment . Proceedings of the National Academy of Sciences, 113, 7475 – 7480 .

Google Scholar Medline

Davis, J. A., Smith, T. W. ( 1991 ). The NORC general social survey: A user’s guide (Vol. 1). Thousand Oaks, CA : Sage .

Google Scholar

De Houwer, J., Moors, A. ( 2010 ). Implicit measures: Similarities and differences . In Gawronski, B., Payne, B. K. (Eds.), Handbook of implicit social cognition: Measurement, theory, and applications (pp. 176 – 193 ). New York, NY : Guilford Press .

Google Scholar

De Houwer, J., Teige-Mocigemba, S., Spruyt, A., Moors, A. ( 2009 ). Implicit measures: A normative analysis and review . Psychological Bulletin, 135, 347 – 368 .

Google Scholar Medline | ISI

Derous, E., Nguyen, H. H., Ryan, A. M. ( 2009 ). Hiring discrimination against Arab minorities: Interactions between prejudice and job characteristics . Human Performance, 22, 297 – 320 .

Google Scholar ISI

Dovidio, J. F., Kawakami, K., Gaertner, S. L. ( 2002 ). Implicit and explicit prejudice and interracial interaction . Journal of Personality and Social Psychology, 82, 62 – 68 .

Google Scholar Medline | ISI

Duckitt, J., Farre, B. ( 1994 ). Right-wing authoritarianism and political intolerance among whites in the future majority-rule South Africa . The Journal of Social Psychology, 134, 735 – 741 .

Google Scholar ISI

Dunton, B. C., Fazio, R. H. ( 1997 ). An individual difference measure of motivation to control prejudiced reactions . Personality and Social Psychology Bulletin, 23, 316 – 326 .

Google Scholar SAGE Journals | ISI

Forscher, P. S., Cox, W. T., Graetz, N., Devine, P. G. ( 2015 ). The motivation to express prejudice . Journal of Personality and Social Psychology, 109, 791 – 812 .

Google Scholar Medline

Friese, M., Hofmann, W., Schmitt, M. ( 2009 ). When and why do implicit measures predict behaviour? Empirical evidence for the moderating role of opportunity, motivation, and process reliance . European Review of Social Psychology, 19, 285 – 338 .

Google Scholar ISI

Gawronski, B., Bodenhausen, G. V. ( 2006 ). Associative and propositional processes in evaluation: An integrative review of implicit and explicit attitude change . Psychological Bulletin, 132, 692 – 731 .

Google Scholar Medline | ISI

Goff, P. A., Steele, C. M., Davies, P. G. ( 2008 ). The space between us: Stereotype threat and distance in interracial contexts . Journal of Personality and Social Psychology, 94, 91 – 107 .

Google Scholar Medline | ISI

Greenwald, A. G., McGhee, D. E., Schwartz, J. L. ( 1998 ). Measuring individual differences in implicit cognition: The implicit association test . Journal of Personality and Social Psychology, 74, 1464 – 1480 .

Google Scholar Medline | ISI

Greenwald, A. G., Nosek, B. A., Banaji, M. R. ( 2003 ). Understanding and using the implicit association test: I. An improved scoring algorithm . Journal of Personality and Social Psychology, 85, 197 – 216 .

Google Scholar Medline | ISI

Greenwald, A. G., Poehlman, T. A., Uhlmann, E. L., Banaji, M. R. ( 2009 ). Understanding and using the implicit association test: III. Meta-analysis of predictive validity . Journal of Personality and Social Psychology, 97, 17 – 41 .

Google Scholar Medline | ISI

Groom, V., Bailenson, J. N., Nass, C. ( 2009 ). The influence of racial embodiment on racial bias in immersive virtual environments . Social Influence, 4, 231 – 248 .

Google Scholar ISI

Guinote, A., Willis, G. B., Martellotta, C. ( 2010 ). Social power increases implicit prejudice . Journal of Experimental Social Psychology, 46, 299 – 307 .

Google Scholar ISI

Gulker, J. E., Monteith, M. J. ( 2013 ). Intergroup boundaries and attitudes: The power of a single potent link . Personality and Social Psychology Bulletin, 39, 943 – 955 .

Google Scholar SAGE Journals | ISI

Hallgren, K. A. ( 2012 ). Computing inter-rater reliability for observational data: An overview and tutorial . Tutorials in Quantitative Methods for Psychology, 8, 23 – 34 .

Google Scholar Medline

Henry, P. J., Sears, D. O. ( 2002 ). The symbolic racism 2000 scale . Political Psychology, 23, 253 – 283 .

Google Scholar ISI

Hofmann, W., Gawronski, B., Gschwendner, T., Le, H., Schmitt, M. ( 2005 ). A meta-analysis on the correlation between the implicit association test and explicit self-report measures . Personality and Social Psychology Bulletin, 31, 1369 – 1385 .

Google Scholar SAGE Journals | ISI

Hofmann, W., Gschwendner, T., Castelli, L., Schmitt, M. ( 2008 ). Implicit and explicit attitudes and interracial interaction: The moderating role of situationally available control resources . Group Processes & Intergroup Relations, 11, 69 – 87 .

Google Scholar SAGE Journals | ISI

Hofmann, W., Gschwendner, T., Nosek, B. A., Schmitt, M. ( 2005 ). What moderates implicit—explicit consistency? European Review of Social Psychology, 16, 335 – 390 .

Google Scholar

Huntsinger, J. R., Smith, C. T. ( 2009 ). First thought, best thought: Positive mood maintains and negative mood degrades implicit-explicit attitude correspondence . Personality and Social Psychology Bulletin, 35, 187 – 197 .

Google Scholar SAGE Journals | ISI

Inzlicht, M., Gutsell, J. N., Legault, L. ( 2012 ). Mimicry reduces racial prejudice . Journal of Experimental Social Psychology, 48, 361 – 365 .

Google Scholar

Jacobson, C. K. ( 1985 ). Resistance to affirmative action: Self-Interest or racism? Journal of Conflict Resolution, 29, 306 – 329 .

Google Scholar SAGE Journals | ISI

Joy-Gaba, J. A., Nosek, B. A. ( 2010 ). The surprisingly limited malleability of implicit racial evaluations . Social Psychology, 41, 137 – 146 .

Google Scholar ISI

Katz, I., Hass, R. G. ( 1988 ). Racial ambivalence and American value conflict: Correlational and priming studies of dual cognitive structures . Journal of Personality and Social Psychology, 55, 893 – 905 .

Google Scholar ISI

Kinder, D. R., Sanders, L. M. ( 1996 ). American politics and political economy. Divided by color: Racial politics and democratic ideals. Chicago, IL : University of Chicago Press .

Google Scholar

Kluegel, J. R., Smith, E. R. ( 1986 ). Beliefs without inequality: Americans’ view of what is and what ought to be. Hawthorne, NJ : Aldine de Gruyter .

Google Scholar

Kteily, N., Bruneau, E., Waytz, A., Cotterill, S. ( 2015 ). The ascent of man: Theoretical and empirical evidence for blatant dehumanization . Journal of Personality and Social Psychology, 109, 901 – 931 .

Google Scholar Medline | ISI

Legault, L., Gutsell, J. N., Inzlicht, M. ( 2011 ). Ironic effects of antiprejudice messages: How motivational interventions can reduce (but also increase) prejudice . Psychological Science, 22, 1472 – 1477 .

Google Scholar SAGE Journals | ISI

Likert, R. ( 1932 ). A technique for the measurement of attitudes . Archives of Psychology, 140, 1 – 55 .

Google Scholar

Lybarger, J. E., Monteith, M. J. ( 2011 ). The effect of Obama saliency on individual-level racial bias: Silver bullet or smokescreen? Journal of Experimental Social Psychology, 47, 647 – 652 .

Google Scholar ISI

Maison, D., Greenwald, A. G., Bruin, R. ( 2001 ). The implicit association test as a measure of implicit consumer attitudes . Polish Psychological Bulletin, 32, 1 – 9 .

Google Scholar

McClosky, H. ( 1958 ). Conservatism and personality . American Political Science Review, 52, 27 – 45 .

Google Scholar ISI

McConahay, J. B. ( 1986 ). Modern racism, ambivalence, and the Modern Racism Scale . In Dovidio, J. F., Gaertner, S. L. (Eds.), Prejudice, Discrimination, and Racism (pp. 91 – 125 ). San Diego, CA : Academic Press .

Google Scholar

Moors, A., De Houwer, J. ( 2006 ). Automaticity: A theoretical and conceptual analysis . Psychological Bulletin, 132, 297 – 326 .

Google Scholar Medline | ISI

Nosek, B. A. ( 2005 ). Moderators of the relationship between implicit and explicit evaluation . Journal of Experimental Psychology: General, 134, 565 .

Google Scholar Medline | ISI

Nosek, B. A. ( 2007 ). Implicit–explicit relations . Current Directions in Psychological Science, 16, 65 – 69 .

Google Scholar SAGE Journals | ISI

Nosek, B. A., Banaji, M., Greenwald, A. G. ( 2002 ). Harvesting implicit group attitudes and beliefs from a demonstration web site . Group Dynamics: Theory, Research, and Practice, 6, 101 – 115 .

Google Scholar ISI

Nosek, B. A., Bar-Anan, Y., Sriram, N., Axt, J., Greenwald, A. G. ( 2014 ). Understanding and using the brief implicit association test: Recommended scoring procedures . PLoS One, 9, e110938 .

Google Scholar Medline

Nosek, B. A., Greenwald, A. G., Banaji, M. R. ( 2007 ). The implicit association test at age 7: A methodological and conceptual review . In Bargh, J. A. (Ed.), Social psychology and the unconscious: The automaticity of higher mental processes (pp. 265 – 292 ). New York, NY : Psychology Press .

Google Scholar

Nosek, B. A., Smyth, F. L. ( 2007 ). A multitrait-multimethod validation of the implicit association test . Experimental Psychology, 54, 14 – 29 .

Google Scholar Medline | ISI

Olson, M. A., Fazio, R. H. ( 2006 ). Reducing automatically activated racial prejudice through implicit evaluative conditioning . Personality and Social Psychology Bulletin, 32, 421 – 433 .

Google Scholar SAGE Journals | ISI

Paulhus, D. L. ( 1984 ). Two-component models of social desirable responding . Journal of Personality and Social Psychology, 46, 598 – 609 .

Google Scholar ISI

Payne, B. K., Krosnick, J. A., Pasek, J., Lelkes, Y., Akhtar, O., Tompson, T. ( 2010 ). Implicit and explicit prejudice in the 2008 American presidential election . Journal of Experimental Social Psychology, 46, 367 – 374 .

Google Scholar ISI

Peffley, M., Hurwitz, J., Sniderman, P. M. ( 1997 ). Racial stereotypes and whites’ political views of blacks in the context of welfare and crime . American Journal of Political Science, 41, 30 – 60 .

Google Scholar ISI

Pettigrew, T. F., Meertens, R. W. ( 1995 ). Subtle and blatant prejudice in Western Europe . European Journal of Social Psychology, 25, 57 – 75 .

Google Scholar ISI

Phillips, S. T., Ziller, R. C. ( 1997 ). Toward a theory and measure of the nature of nonprejudice . Journal of Personality and Social Psychology, 72, 420 – 434 .

Google Scholar ISI

Plant, E. A., Devine, P. G. ( 1998 ). Internal and external motivation to respond without prejudice . Journal of Personality and Social Psychology, 75, 811 – 832 .

Google Scholar ISI

Ranganath, K. A., Nosek, B. A. ( 2008 ). Implicit attitude generalization occurs immediately: Explicit attitude generalization takes time . Psychological Science, 19, 249 – 254 .

Google Scholar SAGE Journals | ISI

Robinson, J. P., Shaver, P. R., Wrightsman, L. S. (Eds.). ( 1999 ). Measures of social psychological attitudes, Vol. 2. Measures of political attitudes. San Diego, CA : Academic .

Google Scholar

Rudman, L. A., Lee, M. R. ( 2002 ). Implicit and explicit consequences of exposure to violent and misogynous rap music . Group Processes & Intergroup Relations, 5, 133 – 150 .

Google Scholar SAGE Journals

Saucier, D. A., Miller, C. T. ( 2003 ). The persuasiveness of racial arguments as a subtle measure of racism . Personality and Social Psychology Bulletin, 29, 1303 – 1315 .

Google Scholar SAGE Journals | ISI

Sears, D. O. ( 1988 ). Symbolic racism . In Katz, P. A., Taylor, D. A. (Eds.), Eliminating racism: Profiles in controversy (pp. 53 – 84 ). New York, NY : Plenum .

Google Scholar

Schmidt, K., Axt, J. R. ( 2016 ). Implicit and explicit attitudes toward African Americans and Barack Obama did not substantively change during Obama’s presidency . Social Cognition, 34, 559 – 588 .

Google Scholar

Schmidt, K., Nosek, B. A. ( 2010 ). Implicit (and explicit) racial attitudes barely changed during Barack Obama’s presidential campaign and early presidency . Journal of Experimental Social Psychology, 46, 308 – 314 .

Google Scholar ISI

Sidanius, J., Pratto, F. ( 2001 ). Social dominance: An intergroup theory of social hierarchy and oppression. New York : Cambridge University Press .

Google Scholar

Sidanius, J., Pratto, F., Martin, M., Stallworth, L. M. ( 1991 ). Consensual racism and career track: Some implications of social dominance theory . Political Psychology, 12, 691 – 721 .

Google Scholar ISI

Sidanius, J., Van Laar, C., Levin, S., Sinclair, S. ( 2004 ). Ethnic enclaves and the dynamics of social identity on the college campus: The good, the bad, and the ugly . Journal of Personality and Social Psychology, 87, 96 – 110 .

Google Scholar Medline | ISI

Stanley, D. A., Sokol-Hessner, P., Banaji, M. R., Phelps, E. A. ( 2011 ). Implicit race attitudes predict trustworthiness judgments and economic trust decisions . Proceedings of the National Academy of Sciences of the United States of America, 108, 7710 – 7715 .

Google Scholar Medline | ISI

Stephan, W. G., Stephan, C. W. ( 1985 ). Intergroup anxiety . Journal of Social Issues, 41, 157 – 175 .

Google Scholar ISI

Trawalter, S., Hoffman, K. M., Waytz, A. ( 2012 ). Racial bias in perceptions of others’ pain . PLoS One, 7, e48546 .

Google Scholar Medline | ISI

Uhlmann, E. L., Brescoll, V. L., Machery, E. ( 2010 ). The motives underlying stereotype-based discrimination against members of stigmatized groups . Social Justice Research, 23, 1 – 16 .

Google Scholar