BUS 6553 Module 1 Review of Research on Bias in Talent Decisions Example

Same Résumé, Different Callback: What Field Experiments and Organizational Studies Reveal About Bias in Talent Decisions

Student Name

American College of Education

BUS6553: Leveling the Playing Field in Talent Management

Module 1 Assignment

Instructor Name

January 14, 2030

Introduction

Leaders generally believe their organizations hire and promote on merit, and most managers sincerely intend to be fair. Research on talent decisions shows that intentions are not enough: equally qualified candidates are often treated differently because of their race, gender or other characteristics unrelated to performance. This review examines the evidence, organized by research method, because each method answers a different question and carries different limits. It covers field experiments on hiring, laboratory studies of evaluators, a natural experiment in blind evaluation, organizational studies of pay and promotion and research on efforts to change biased associations. It closes by asking where the evidence suggests leaders should intervene.

Field Experiments on Hiring

The most direct evidence comes from audit experiments that send matched applications to real job openings. Bertrand and Mullainathan (2004) answered help-wanted advertisements in two large cities with invented applications, attaching at random either a name common among white Americans or one common among Black Americans. The first group heard back about half again as often as the second, and adding stronger credentials helped the first group noticeably more than it helped the second. Because the applications were otherwise identical, the difference can be attributed to the signal of race. Audit studies measure callbacks rather than final hiring, but callbacks are the gateway to every later stage.

Has Discrimination Declined?

A natural question is whether such findings are dated. Quillian et al. (2017) meta-analyzed field experiments of hiring discrimination in the United States conducted since 1989 and found no change over time in discrimination against African American applicants, while discrimination against Latino applicants showed a modest decline that was not statistically reliable. White applicants received substantially more callbacks on average than equally qualified African American applicants across the period. The finding undercuts the assumption that bias in hiring has largely disappeared and sets a baseline for evaluating organizational practices.

Laboratory Evidence on Evaluators

Laboratory studies show how evaluators' judgments shift. Moss-Racusin et al. (2012) asked science faculty at research universities to evaluate an application for a laboratory manager position, randomly assigning a male or female name to otherwise identical materials. Faculty rated the male applicant as more competent and hireable, offered a higher starting salary and more mentoring, and female faculty showed the same pattern as male faculty. The study is valuable because its participants were professional evaluators making a realistic judgment, though as with all experiments the setting is simpler than real hiring.

A Natural Experiment: Blind Auditions

Goldin and Rouse (2000) studied symphony orchestras that adopted screens to hide candidates' identity during auditions. Using audition records, they estimated that blind auditions increased the likelihood that women advanced from preliminary rounds and were eventually hired, and that the shift to screens explained part of the growth in women's share of orchestra positions. The study is often cited as proof that blinding works. Later commentators have noted that some estimates were imprecise, which argues for citing it as suggestive evidence rather than a definitive effect size. Its broader lesson, that changing the decision process can change outcomes, remains well supported.

Bias Inside Organizations

Organizational studies show bias persisting after hiring. Castilla and Benard (2010) conducted experiments in which participants made bonus decisions for employees with identical performance records; when the organization's values emphasized meritocracy, participants gave larger bonuses to men than to equally performing women. They called this the paradox of meritocracy: an emphasis on merit can license bias by making evaluators confident that their judgments are objective. The finding suggests that commitment to merit, without structures that check how it is applied, may not reduce bias and may increase it.

Can Biased Associations Be Changed?

Many organizations respond to bias with training aimed at implicit associations. Forscher et al. (2019) meta-analyzed hundreds of studies testing procedures to change implicit measures and found that such procedures could produce small changes in the measures, but that these changes did not reliably translate into changes in explicit attitudes or behavior. Combined with organizational evidence that training alone does little to change outcomes, this research suggests that efforts to change individual associations are an unreliable route to fairer decisions.

What the Methods Show Together

The methods converge. Field experiments show that bias affects real employers' decisions; meta-analysis shows that the effect has not faded; laboratory studies show that even trained professionals are affected; the blind audition study shows that changing process can change outcomes; organizational experiments show that values without structure can backfire; and research on implicit measures shows that changing minds is hard. Each method has limits, but together they support a consistent conclusion: bias operates through decision processes in which evaluators have discretion and identity cues are visible.

Gaps in the Research

Gaps remain. Most field experiments study callbacks rather than offers, pay or later careers. Research on promotion and succession is thinner than on hiring, and few studies track the same people across stages. Evidence comes mainly from the United States and Western Europe. And many studies examine race or gender separately, though people experience combinations of characteristics. These gaps shape the later modules of this course, which examine hiring, promotion and succession in turn.

Bias Beyond Race and Gender

Although most of the evidence concerns race and gender, field experiments have documented differential treatment on other grounds with methods similar to the résumé audits, including fewer callbacks for older applicants (Neumark et al., 2019) and for applicants who disclosed a disability (Ameri et al., 2018). The mechanisms appear similar: evaluators fill gaps in information with assumptions linked to group membership. For leaders, this means that structural safeguards designed for one characteristic should be examined for others, and monitoring should include as many groups as data and privacy allow.

Why Process Beats Persuasion

A final reason to favor process over persuasion is practical. Training sessions end, and their effects fade, while a rubric, a structured interview guide or a review of promotion data operates every time a decision is made. Process changes also protect evaluators: a manager following defined criteria is less exposed to accusations of favoritism than one relying on instinct. For organizations, structural changes are easier to audit, because their use can be observed and their outcomes measured.

Implications for Leaders

The review points leaders toward decision structures. Where possible, remove or delay identity cues during early screening. Define criteria before evaluating candidates and apply them consistently. Limit unchecked discretion by requiring that decisions be explained and reviewed. Monitor outcomes by group, since bias is visible in patterns more than in individual cases. And treat training as, at most, a supplement to these structural changes rather than the main response.

Conclusion

Evidence from field experiments, laboratory studies, a natural experiment and organizational research shows that bias shapes hiring and later talent decisions, that it has not declined in hiring over recent decades and that it persists among sincere and expert evaluators. Efforts to change individual associations show little effect on behavior, while changes to decision processes show promise. Leaders seeking fair talent decisions should therefore focus on structures that limit unchecked discretion and identity cues, a principle the following modules apply to hiring, promotion and succession.

References

Ameri, M., Schur, L., Adya, M., Bentley, F. S., McKay, P., & Kruse, D. (2018). The disability employment puzzle: A field experiment on employer hiring behavior. ILR Review, 71(2), 329-364. https://doi.org/10.1177/0019793917717474

Bertrand, M., & Mullainathan, S. (2004). Are Emily and Greg more employable than Lakisha and Jamal? A field experiment on labor market discrimination. American Economic Review, 94(4), 991-1013. https://doi.org/10.1257/0002828042002561

Castilla, E. J., & Benard, S. (2010). The paradox of meritocracy in organizations. Administrative Science Quarterly, 55(4), 543-676. https://doi.org/10.2189/asqu.2010.55.4.543

Forscher, P. S., Lai, C. K., Axt, J. R., Ebersole, C. R., Herman, M., Devine, P. G., & Nosek, B. A. (2019). A meta-analysis of procedures to change implicit measures. Journal of Personality and Social Psychology, 117(3), 522-559. https://doi.org/10.1037/pspa0000160

Goldin, C., & Rouse, C. (2000). Orchestrating impartiality: The impact of "blind" auditions on female musicians. American Economic Review, 90(4), 715-741. https://doi.org/10.1257/aer.90.4.715

Moss-Racusin, C. A., Dovidio, J. F., Brescoll, V. L., Graham, M. J., & Handelsman, J. (2012). Science faculty's subtle gender biases favor male students. Proceedings of the National Academy of Sciences, 109(41), 16474-16479. https://doi.org/10.1073/pnas.1211286109

Neumark, D., Burn, I., & Button, P. (2019). Is it harder for older workers to find jobs? New and improved evidence from a field experiment. Journal of Political Economy, 127(2), 922-970. https://doi.org/10.1086/701029

Quillian, L., Pager, D., Hexel, O., & Midtbøen, A. H. (2017). Meta-analysis of field experiments shows no change in racial discrimination in hiring over time. Proceedings of the National Academy of Sciences, 114(41), 10870-10875. https://doi.org/10.1073/pnas.1706255114