BUS 6553 Module 3 Promotion and Performance Evaluation Analysis Example

Equal Ratings, Unequal Potential: Examining Promotion and Performance Evaluation for Project Managers at an Engineering Firm

Student Name

American College of Education

BUS6553: Leveling the Playing Field in Talent Management

Module 3 Assignment

Instructor Name

February 11, 2030

Introduction

The previous paper found that bias enters hiring at Piedmont Civil Group, the composite Charlotte engineering firm in this course, at referral sourcing, unscreened résumé review and fit-based interviews. Those who are hired then face a second set of decisions: annual performance evaluations and promotion from project engineer to project manager, the step that leads to leadership and higher pay. This paper examines whether the playing field is level after hiring. It follows two cohorts of engineers through evaluations and promotion decisions, identifies where outcomes diverge by gender and race and explains the divergence with research on evaluation and promotion.

How Evaluation and Promotion Work

Each engineer receives an annual review with two ratings on a five-point scale: performance in the current role and potential for advancement. Managers also write comments. Ratings are adjusted in calibration meetings, where department leaders compare engineers and agree final ratings. Promotion to project manager requires a performance rating of at least four, a potential rating of at least four and nomination by a department leader. The potential rating has no written definition; leaders describe it as judgment about who is ready to lead.

What the Data Show

Records for engineers hired between 2021 and 2023 covered 164 people. Average performance ratings were nearly identical across groups: 3.7 for women and 3.7 for men, 3.6 for engineers of color and 3.7 for white engineers. Potential ratings diverged: women averaged 3.3 and men 3.7; engineers of color averaged 3.2 and white engineers 3.6. Among engineers with performance ratings of four or five, 61 percent of white men received potential ratings of four or above, compared with 42 percent of women and 39 percent of engineers of color. Promotion rates to project manager within four years followed the potential ratings.

A Check on the Data

Because the cohorts are small, the analysis checked whether the pattern held when engineers in each department were compared only with peers in the same department. The divergence between performance and potential ratings remained in four of five departments, which reduces the chance that it reflects differences between departments rather than within them. The numbers remain modest, and the firm should continue tracking the pattern with each new review cycle.

Performance Versus Potential in Research

The pattern matches research findings. Roth et al. (2012) meta-analyzed field studies of job performance and found that women and men received very similar performance ratings, with a small difference favoring women, while ratings of promotion potential tended to favor men. Ratings of current performance are anchored in observable work, while potential requires forecasting, which leaves more room for assumptions about who looks like a leader. When a firm requires a high potential rating for promotion, the less defined judgment becomes the gatekeeper.

From Equal Ratings to Unequal Rewards

Castilla (2008) studied a large service organization and showed that workers whose evaluations were identical could still end up with different raises depending on their group, showing that bias can enter after evaluation, when ratings are translated into rewards. Piedmont's promotion process has the same structure: equal performance ratings are converted into promotion decisions through a second, discretionary judgment. The finding suggests that auditing ratings alone is insufficient; organizations must also examine what happens between ratings and rewards.

The Language of Reviews

Written comments offer further evidence. A review of 120 anonymized comments found that women's reviews more often described their communication style and collaborative qualities, while men's reviews more often credited technical judgment and leadership of client relationships. Correll et al. (2020) analyzed performance reviews in a technology company and found that the language used to describe men's and women's work differed in ways that reflected gendered expectations, even where overall ratings were similar. At Piedmont, comments that emphasize style over impact may feed into lower potential ratings in calibration.

Calibration Meetings

Calibration is meant to make ratings consistent, but observation of two meetings showed how it can amplify bias. Discussions focused on a few engineers whom leaders knew well, often those who had worked on high-profile projects. Engineers on smaller projects, more often women and engineers of color according to staffing data, were discussed briefly. Leaders used phrases such as executive presence and natural leader without defining them. The meetings gave the most discretion to those with the most informal knowledge, the opposite of the consistency calibration is designed to produce.

Confidence in Merit

Leaders interviewed for this paper were confident the process was fair because it rewarded merit. Castilla and Benard (2010) found that emphasizing meritocracy in an organization's culture can increase bias in reward decisions, because evaluators who believe they are objective are less likely to examine their judgments. Piedmont's leaders often cited the firm's merit-based culture as evidence that bias could not be a factor, which is the pattern the research warns about. Confidence in merit is not a safeguard; structures that test how merit is applied are.

What the Engineers Said

Short interviews with eight engineers rated high on performance but not on potential added perspective. Several said they had never been told what potential meant or how to demonstrate it. Others said they had asked for larger projects without success. Two said they had begun looking for jobs at firms with clearer promotion criteria. Their accounts suggest the undefined rating affects retention as well as promotion, an added cost for the firm.

Assignments as a Hidden Input

Staffing data revealed another input. Engineers assigned to large, visible projects in their first three years were far more likely to receive high potential ratings, and these assignments were made informally by department leaders. Women and engineers of color were less often assigned to such projects. Because potential ratings reward visible experience, unequal access to assignments becomes unequal potential. This finding links promotion to the succession and pipeline questions examined in the next module.

Lessons for Other Organizations

The Piedmont findings suggest questions any organization can ask of its own promotion system. Is potential defined, and can employees see the definition? Do calibration meetings discuss every eligible employee or mainly those leaders know? Are the experiences that lead to promotion assigned openly? And are outcomes compared by group at each step, not only at the end? Answering these questions requires little investment and can reveal where a process needs structure.

Rival Explanations

One alternative is that some engineers show less interest in management. Survey data from the firm's engagement survey showed similar interest in project management roles across groups. Another is that potential ratings reflect real differences in leadership skills not captured by performance ratings. The lack of a definition for potential, the reliance on informal knowledge in calibration and the link to assignment visibility make this explanation difficult to test and suggest the ratings capture opportunity as much as ability.

Conclusion

At Piedmont, women and engineers of color receive performance ratings similar to their peers but lower ratings of potential, and promotion follows potential. The divergence arises in an undefined potential rating, in calibration meetings that favor informal knowledge, in review language that emphasizes style and in informal project assignments that determine visibility. Research on ratings, rewards, review language and meritocracy explains each mechanism. The next module examines succession planning, where these patterns shape the firm's future leadership.

References

Castilla, E. J. (2008). Gender, race, and meritocracy in organizational careers. American Journal of Sociology, 113(6), 1479-1526. https://doi.org/10.1086/588738

Castilla, E. J., & Benard, S. (2010). The paradox of meritocracy in organizations. Administrative Science Quarterly, 55(4), 543-676. https://doi.org/10.2189/asqu.2010.55.4.543

Correll, S. J., Weisshaar, K. R., Wynn, A. T., & Wehner, J. D. (2020). Inside the black box of organizational life: The gendered language of performance assessment. American Sociological Review, 85(6), 1022-1050. https://doi.org/10.1177/0003122420962080

Roth, P. L., Purvis, K. L., & Bobko, P. (2012). A meta-analysis of gender group differences for measures of job performance in field studies. Journal of Management, 38(2), 719-739. https://doi.org/10.1177/0149206310374774