Work

Developing a Simulated Assessment Center for Analyzing Assessor Rating Accuracy

Year: 2025
Type: article
Abstract: Assessors play a central role in assessment center (AC) but few educationally grounded tools exist to evaluate or train rating accuracy. Therefore, this research aimed to develop a simulated AC designed for assessor learning and examining social-cognitive judgment processes. The development followed the Standards for Educational and Psychological Testing and six structured stages, integrating principles from Funder’s Realistic Accuracy Model (RAM). The simulation targets two dimensions assessed through written and oral presentation exercises. The task content was derived from real assessee performances, transformed into standardized scenarios, and performed by trained roleplayers. The simulation was piloted with 23 psychology graduate students serving as novice assessors following expert review. The results showed that there was a significant dimension-by-exercise interactions in rating accuracy in line with RAM’s emphasis on cue availability and interpretation. The simulated AC offered a fidelity-based tool for advancing understanding of assessor cognition and strengthening training practices.
Language: English
Open Access status: gold
Estimated APC paid: $50
OpenAlex ID: W7117765268
FWCI:
Cites: 56
Cited by:
Related to: 10