Work

A comparison of traditional and adaptive comparative judgment assessment techniques for freshmen engineering design projects

Year: 2018
Type: article
Abstract: This article examines the use of an alternative form of assessment for engineering design projects called adaptive comparative judgment (ACJ). The researchers employed an ACJ tool to evaluate undergraduate engineering student design projects in an effort to examine its’ reliability, validity, and utility in comparison with traditional assessment techniques. The ACJ process employed multiple judges to compare the design artifacts of 16 first-year engineering majors. The authors conducted an analysis of the reliability and validity of the ACJ method compared to the traditional rubric used to evaluate the project and the performance data of each student’s design prototype. For these design artifacts, ACJ demonstrated a strong alignment with traditional assessment methods (rs= 0.79, p< 0.01). Yet, neither ACJ nor traditional assessment results were significantly correlated with the actual performance of the design prototype. Additionally, the findings indicate the amount of time each judge devotes to judging student work using ACJ does not significantly impact the reliability of their assessment.
Authors: Greg Strimel, Scott Bartholomew, W. Andrew Jackson
Language: English
Subfield: Education
Open Access status: green
OpenAlex ID: W2941098953
FWCI: 10.78
Cites: 16
Cited by: 34
Related to: 10