Follow The Science We’re Constantly Told: Research Shows Diversity Training is Typically Ineffective
In wake of George Floyd’s killing and the protests that followed, many colleges and universities have been rolling out new training requirements – often oriented towards reducing biases and encouraging people from high-status groups to ‘check their privilege.’ The explicit goal of these training programs is generally to help create a more positive and welcoming institutional environment for people from historically marginalized and underrepresented groups.
As I have explained elsewhere, there is a long literature on the benefits of diversity on knowledge production. However, many of the approaches to training people how to navigate and utilize diversity were implemented by corporations, non-profits and universities before their effectiveness had been tested rigorously (if at all).
Although the precursor to contemporary diversity training, sensitivity training, actually dates back to the mid 1940s, diversity training became especially important beginning in the mid-80s to early-90s. Why? Starting in the late 70s through early 80s, universities began enrolling significantly higher numbers of women, minorities, and people from middle-class and lower-income backgrounds. Soon thereafter, employers found themselves with a much more heterogenous labor pool. They had to face, often for the first time, some of the challenges that come along with the benefits of diversity — as people with increasingly divergent backgrounds and perspectives were put side by side and tasked with common goals.
Beginning in the mid-90s, however, it became increasingly clear that, due to their lack of validation, many widely-used interventions could be ineffective or harmful. An empirical literature was built up measuring the effectiveness of diversity-related training programs. The picture that has emerged is not very flattering.
- Kalev, Alexandra w/ Frank Dobbin & Erin Kelly (2006). “Best Practices or Best Guesses? Assessing the Efficacy of Corporate Affirmative Action and Diversity Policies.” American Sociological Review 71(4): 589-617.
- Naff, Katherine & J. Edward Kellough (2007). “Ensuring Employment Equity: Are Federal Diversity Programs Making a Difference?” International Journal of Public Administration 26(12): 1307-36.
- Paluck, Elizabeth & Donald Green (2009). “Prejudice Reduction: What Works? A Review and Assessment of Research and Practice.” Annual Review of Psychology 60: 339-67.
The limited research suggesting diversity-related training programs as efficacious was based on things like surveys before and after the training, or testing knowledge or attitudes about various groups or policies. And to be clear, the training does help people answer survey questions in the way the training said they ‘should.’ And many people who undergo the training say they enjoyed it or found it helpful in post-training questionnaires.
However, when scientists set about to investigate whether the programs actually changed behaviors, i.e. do they reduce expressions of bias, do they reduce discrimination, do they foster greater collaboration across groups, do they help with retaining employees from historically marginalized or underrepresented groups, do they increase productivity or reduce conflicts in the workplace — for all of these behavioral metrics, the metrics that actually matter, not only is the training ineffective, it is often counterproductive.
Training is Generally Ineffective at Its Stated Goals
The stated goals of these training programs vary, from helping to increase hiring and retention of people from historically marginalized and underrepresented groups, to eliminating prejudicial attitudes or behaviors to members of said groups, to reducing conflict and enhancing cooperation and belonging among all employees. Irrespective of the stated goals of the programs, they are overwhelmingly ineffective with respect to those goals. Generally speaking, they do not increase diversity in the workplace, they do not reduce harassment or discrimination, they do not lead to greater intergroup cooperation and cohesion – consequently, they do not increase productivity. More striking: many of those tasked with ensuring compliance with these training programs recognize them as ineffective (see Rynes & Rosen 1995, p. 258).
Resources on these points:
- Chang, Edward et al. (2019). “The Mixed Effects of Online Diversity Training.” Proceedings of the National Academy of Sciences 116(16): 7778-7783.
- Dobbin, Frank & Alexandra Kalev (2016). “Why Doesn’t Diversity Training Work? The Challenge for Industry and Academia.” Anthropology Now 10(2): 48-55.
- Dobbin, Frank w/ Daniel Schrage & Alexandra Kalev (2015). “Rage against the Iron Cage: The Varied Effects of Bureaucratic Personnel Reforms on Diversity.” American Sociological Review 80(5): 1014–44.
- Dobbin, Frank w/ Alexandra Kalev & Erin Kelly (2007). “Diversity Management in Corporate America.” Contexts 6(4): 21-7.
- Folz, Christina (2016). “No Evidence That Training Prevents Harassment, Finds EEOC Task Force.” Society for Human Resource Management, 19 June.
- Frisby, Craig & William O’Donohue (2018). Cultural Competence in Applied Psychology: An Evaluation of Current Status and Future Directions. Cham, CH: Springer.
- Magley, Vicki et al. (2016). “Changing Sexual Harassment within Organizations via Training Interventions: Suggestions and Empirical Data.” The Fulfilling Workplace: The Organization’s Role in Achieving Individual and Organizational Health. New York, NY: Routledge.
- Newkirk, Pamela (2019). Diversity Inc.: The Failed Promise of a Billion-Dollar Business. New York, NY: Bold Type Books.
Training Often Reinforces Biases
Often, when people attempt to do fact-checks, they begin by underscoring the falsehood, and then proceed to try to debunk that falsehood. This can create what psychologists call an ‘illusory truth effect,’ where people end up remembering the falsehood, forgetting the correction – and then attributing their misinformation to the very source that had tried to correct it! A similar effect seems to hold with antibias training. By articulating various stereotypes associated with particular groups, emphasizing the salience of those stereotypes, and then calling for their suppression, they often end up reinforcing them in participants’ minds. Sometimes they even implant new stereotypes (for instance, if participants didn’t previously have particular stereotypes for Vietnamese people, or much knowledge about them overall, but were introduced to common stereotypes about this group through training intended to dispel said stereotypes).
Other times, they can fail to improve negative perceptions about the target group, yet increase negative views about others. For instance, an empirical investigation of ‘white privilege’ training found that it did nothing to make participants more sympathetic to minorities – it just increased resentment towards lower-income whites.
Encouraging people to ignore racial and cultural differences often results in diminished cooperation across racial lines. Meanwhile, multicultural training — emphasizing those differences — often ends up reinforcing race essentialism among participants. It is not clear what the best position between these poles is (such that these negative side effects can be avoided), let alone how to consistently strike that balance in training.
Resources on these points:
- Cooley, Erin et al. (2019). “Complex intersections of race and class: Among social liberals, learning about White privilege reduces sympathy, increases blame, and decreases external attributions for White people struggling with poverty.” Journal of Experimental Psychology: General 148(12), 2218–28.
- Heilman, Madeline & Brian Welle (2006). “Disadvantaged by Diversity? The Effects of Diversity Goals on Competence Perceptions.” Journal of Applied Social Psychology 36(5): 1291-1319.
- Kulick, Carol w/ Elissa Perry & Anne Bourhis (2000). “Ironic evaluation processes: effects of thought suppression on evaluations of older job applicants.” Journal of Organizational Behaviour 21(6): 689–711.
- Macrae, Neil et al. (1994). “Out of mind but back in sight: Stereotypes on the rebound.” Journal of Personality and Social Psychology 67(5): 808-17.
- Plaut, Victoria w/ Kecia M. Thomas and Matt J. Goren (2009). “Is Multiculturalism or Color Blindness Better for Minorities?” Psychological Science 20(4): 444-6.
- Wilton, Leigh w/ Evan Apfelbaum & Jessica Good (2019). “Valuing Differences and Reinforcing Them: Multiculturalism Increases Race Essentialism.” Social Psychological and Personality Science 10(5): 681-9.
Training Can Increase Biased Behavior, Minority Turnover
Many diversity-related training programs describe bias and discrimination as rampant. One unfortunate consequence of depicting these attitudes and behaviors as common is that it makes many feel more comfortable expressing biased attitudes or behaving in discriminatory ways. Insofar as it is depicted as ubiquitous, diversity-related training can actually normalize bias.
For others, the very fact that the company has diversity-related training is proof that it is a non-biased institution. This perception often reduces concerns about bias and discrimination – by oneself or others. As a consequence, people not only become more likely to act in more biased ways, but they also react with increased skepticism and hostility when colleagues claim to have been discriminated against.
Meanwhile, those who are discriminated against become more likely to rationalize mistreatment by others in the institution after undergoing diversity-related training (for the same reason, because they believe the institution must be fair in virtue of its commitment to diversity-related training; indeed, minority employees are often called upon to lead diversity reviews themselves). Consequently, they become less likely to actually report or address wrongdoing. As a result, problems persist unabated — often leading to higher turnover among the very groups the programs were ostensibly designed to render more comfortable.
Resources on these points:
- Brady, Laura et al. (2015). “It’s Fair for Us: Diversity Structures Cause Women to Legitimize Discrimination.” Journal of Experimental Social Psychology 57: 100-10
- Dobbin, Frank & Alexandra Kalev (2019). “The Promise and Peril of Sexual Harassment Programs.” Proceedings of the National Academy of Sciences 116(25): 12255-12260.
- Dobbin, Frank & Alexandra Kalev (2016). “Why Diversity Programs Fail.” Harvard Business Review 94(7): 52-60.
- Dover, Tessa w/ Brenda Major & Cheryl Kaiser (2014). “Diversity initiatives, status, and system-justifying beliefs: When and how diversity efforts de-legitimize discrimination claims.” Group Processes & Intergroup Relations 17(4): 485-93.
- Duguid, Michelle & Melissa Thomas-Hunt (2015). “Condoning Stereotyping? How Awareness of Stereotyping Prevalence Impacts Expression of Stereotypes.” Journal of Applied Psychology 100(2): 343-59.
- Kaiser, Cheryl et al. (2013). “Presumed Fair: Ironic Effects of Organizational Diversity Structures.” Journal of Personality and Social Psychology 104(3): 504-19.
- Kirby, Teri w/ Cheryl Kaiser & Brenda Major (2015). “Insidious Procedures: Diversity Awards Legitimize Unfair Organizational Practices.” Social Justice Research 28: 169-186.
- Leslie, Lisa (2019). “Diversity Initiative Effectiveness: A Typological Theory of Unintended Consequences.” Academy of Management Review 44(3). DOI: 10.5465/amr.2017.0087
Training Often Alienates People from High-Status Groups, Reduces Morale
Diversity-related training programs often depict people from historically marginalized and disenfranchised groups as important and worthwhile, celebrating their heritage and culture, while criticizing the dominant culture as fundamentally depraved (racist, sexist, sadistic, etc.). People from minority groups are discussed in overwhelmingly positive terms, while people from majority groups are characterized as typically (and uniquely) ignorant, insensitive or outright malicious with respect to those who are different than them. Members of the majority group are told to listen to, and validate, the perspectives of people from historically marginalized or disadvantaged groups — even as they are instructed to submit their own feelings and perspectives to intense scrutiny.
In short, there is a clear double-standard in many of these programs with respect to how members of dominant groups (typically men, whites and/or heterosexuals) are described as compared to members of minority groups (i.e. women, ethnic/ racial minorities, LGBTQ employees). The result is that many members from the dominant group walk away from the training believing that themselves, their culture, their perspectives and interests are not valued at the institution – certainly not as much as those of minority team members — reducing their morale and productivity.
The training also leads many to believe that they have to ‘walk on eggshells’ when engaging with members of minority populations. By calling attention, not just too clear examples of harm and prejudice, but just as much (or more) to things like implicit attitudes and microaggressions, participants come to view colleagues from historically marginalized and disenfranchised groups as fragile and easily offended. As a result, members of the dominant group become less likely to try to build relationships or collaborate with people from minority populations.
Resources on these points:
- Anand, Rohini & Mary-Frances Winters (2008). “A Retrospective View of Corporate Diversity Training from 1964 to the Present.” Academy of Management Learning & Education 7(3): 356-72.
- Dover, Tessa w/ Brenda Major & Cheryl Kaiser (2016). “Members of High-Status Groups Are Threatened by Pro-Diversity Organizational Messages.” Journal of Experimental Social Psychology 62: 58-67.
- Plaut, Victoria et al. (2011). “’What About Me?’ Perceptions of Exclusion and Whites’ Reactions to Multiculturalism.” Journal of Personality and Social Psychology 101(2): 337-53.
- Rios-Morrison, Kimberly w/ Victoria Plaut & Oscar Ybarra (2010). “Predicting Whether Multiculturalism Positively or Negatively Influences White Americans’ Intergroup Attitudes: The Role of Ethnic Identification.” Personality and Social Psychology Bulletin 36(12): 1648-61.
- Sanchez, Juan & Nohora Medkik (2005). “The Effects of Diversity Awareness Training on Differential Treatment.” Group & Organization Management 29(4): 517-36.
Focus On: Implicit Attitudes
Implicit attitudes are one of the most commonly relied-upon constructs in contemporary diversity-related training. However, there are severe problems with these constructs – as hammered home by meta-analysis after meta-analysis: it is not clear precisely what isbeing measured on implicit attitude tests; implicit attitudes do not effectively predict actual discriminatory behavior; most interventions to attempts to change implicit attitudes are ineffective (effects, when present, tend to be small and fleeting). Moreover, there is no evidence that changing implicit attitudes has any significant, let alone durable, impact on reducing biased or discriminatory behaviors. In short, the construct itself has numerous validity issues, and the training has no demonstrable benefit.
Resources on these points:
- Blanton, Hart et al. (2009). “Strong claims and weak evidence: Reassessing the predictive validity of the IAT.” Journal of Applied Psychology 94(3): 567–582.
- Carlsson, Richard & Jens Agerstrom (2016). “A Closer Look at Discrimination Outcomes in the IAT Literature.” Scandinavian Journal of Psychology 57(4): 278-87.
- Forscher, Patrick et al. (2019). “A Meta-Analysis of Procedures to Change Implicit Measures.” Journal of Personality and Social Psychology 117(3): 522–559.
- Lai, Calvin et al. (2016). “Reducing implicit racial preferences: II. Intervention effectiveness across time.” Journal of Experimental Psychology: General 145(8): 1001-1016.
- Oswald, Frederick et al. (2013). “Predicting ethnic and racial discrimination: A meta-analysis of IAT criterion studies.” Journal of Personality and Social Psychology 105(2): 171–192.
Focus On: Microaggressions
Contemporary diversity-related training often draws significant attention to microaggressions – small, typically inadvertent, faux pas involving people from historically marginalized and disadvantaged groups. The cumulative effects of microaggressions are held to have significant and adverse impacts on the well-being of people from low-status groups. However, although the microaggressions framework goes back to 1974, there is virtually no systematic research detailing if and how microaggressions are harmful, for whom, and under what circumstances (indeed, there is not even robust conceptual clarity in the literature as to what constitutes a microaggression). There is no systematic empirical evidence that training on microaggressions has any significant or long-term effects on behavior, nor that it correlates with any other positive institutional outcomes.
In fact, when presented with canonical microaggressions, black and Hispanic respondents overwhelmingly find them to be inoffensive – and we have ample reason to believe that sensitizing people to perceive and take greater offense at these slights actually would cause harm: the evidence is clear and abundant that increased perceptions of racism have adverse mental and physical consequences for minorities. In short, not only is there no evidence that training on microaggressions is valuable for improving the well-being of people from historically marginalized or disadvantaged groups, there is reason to believe it could actually be counter-productive to that end.
Resources on these points:
al-Gharbi, Musa (2020). “Who Gets To Define What’s ‘Racist’?” Contexts, 15 May.
Lillienfeld, Scott (2017). “Microaggressions: Strong Claims, Inadequate Evidence.” Perspectives on Psychological Science 12(1): 138-69.
Mandatory Training Causes Additional Blowback
Although diversity-related training programs are generally ineffective, and often bring negative side-effects, they tend to work better (or at least, be less harmful) when they are opt-in. Mandatory training causes people to engage with the materials and exercises in the wrong frame of mind: adversarial and resentful. Consequently, mandatory training often leads to more negative feelings and behaviors, both towards the company and minority co-workers. This effect is especially pronounced among the people who need the training most. Yet roughly 80% of diversity-related training programs in the U.S. seem to be mandatory.
If an institution is going to include diversity-related training, it should offer it as a resource for those who want to learn more. To encourage more people to volunteer for the training, its value and purpose should be linked to specific organizational and development goals. Small incentives could be offered for those who take part, rather than the current norm of sanctioning those who do not.
Resources on these points:
- Bingham, Shereen & Lisa Schrer (2001). “The Unexpected Effects of a Sexual Harassment Educational Program.” The Journal of Applied Behavioral Science 37(2): 125-53.
- Devine, Patricia et al. (2002). “The Regulation of Explicit and Implicit Race Bias: The Role of Motivations to Respond without Prejudice.” Journal of Personality and Social Psychology 82(5): 835-48.
- Kidder, Deborah et al. (2004). “Backlash toward Diversity Initiatives: Examining the Impact of Diversity Program Justification, Personal and Group Outcomes.” International Journal of Conflict Management 15(1): 77-102.
- Kulick, Carol et al. (2007). “The Rich Get Richer: Predicting Participation in Voluntary Diversity Training.” Journal of Organizational Behavior 28(6): 753-69.
- Legault, Lisa w/ Jennifer Gutsell & Michael Inzlicht (2011). “Ironic Effects of Antiprejudice Messages: How Motivational Interventions Can Reduce (but Also Increase) Prejudice.” Psychological Science 22(12): 1472-7.
- Plant, Elizabeth & Patricia Devine (2001). “Responses to Other-Imposed Pro-Black Pressure: Acceptance or Backlash?” Journal of Experimental Social Psychology 37(6): 486-501.
- Robb, Lori & Dennis Doverspike (2001). “Self-Reported Proclivity to Harass as a Moderator of the Effectiveness of Sexual Harassment-Prevention Training.” Psychological Reports 88(1): 85-8.
Training Comes at the Expense of Other Priorities
We are in a period of educational austerity. Creating, implementing and ensuring compliance with diversity-related training programs is expensive. In a world where these training programs consistently advanced diversity and inclusion goals within an organization, or enhanced intergroup cooperation and overall productivity, then these costs could be justified – even during a time of belt-tightening. However, it’s a different dynamic when the training is typically ineffective or even counterproductive. Worse, it often crowds out much more substantial efforts that could be undertaken to actually enhance diversity and inclusion within institutions.
Why do many rely on diversity training despite its demonstrated ineffectiveness? The short answer is that, even if training is expensive and doesn’t work, it is relatively easy to implement – and it allows institutions to show (including, often, in court) that they are doing something to address prejudice, discrimination and inequalities… even if what they’re doing is, in fact, pointless.
This is sort of empty signaling is bad across the board. However, it is particularly egregious for universities – institutions that regularly claim to embody and inculcate such values as evidence-based reasoning, respect for facts, commitment to truth, etc. Schools are doing a bad job at modeling those values for students insofar as they force upon them (and upon the faculty who are supposed to be instructing them!) pedagogical materials that are demonstrably ineffective or even counterproductive.
Indeed, it seems antithetical to their pedagogical purpose to dump increasing sums of money into these programs, even as many departments are seeing hiring freezes or budget cuts, and contingent faculty are being laid off en masse (disproportionately people from historically underrepresented and disadvantaged groups).
It insults, rather than honors, the memory of George Floyd to offer empty gestures like these in his name. As Cyrus Mehri aptly put it, “When you keep choosing the options on the menu that don’t create change, you’re purposely not creating change. It’s part of the intentional discrimination.”