Work

Are automated video interviews smart enough? Behavioral modes, reliability, validity, and bias of machine learning cognitive ability assessments.

Year: 2024

Type: article

Abstract: (measurement and predictive). Overall, the general mental ability, verbal ability, and intellect AVI models captured similar behavioral manifestations of cognitive ability. Validity evidence results were mixed: For example, AVIs trained on observer-rated intellect exhibited superior convergent and criterion relationships (compared to the observer ratings they were trained to model) but had limited discriminant validity evidence. Our findings illustrate the importance of examining psychometric properties beyond convergence with the test that ML algorithms are trained to model. We provide recommendations for enhancing discriminant validity evidence in future AVIs. (PsycInfo Database Record (c) 2025 APA, all rights reserved).

Source: Journal of Applied Psychology

DOI: 10.1037/apl0001236

Authors: Louis Hickman, Louis Tay, Sang Eun Woo

Institutions: Virginia Tech, Purdue University West Lafayette

Language: English

Topic: AI and HR Technologies

Subfield: Organizational Behavior and Human Resource Management

Field: Business, Management and Accounting

Domain: Social Sciences

Open Access status: hybrid

Funders: National Science Foundation, Society for Industrial and Organizational Psychology Foundation

OpenAlex ID: W4402862933

FWCI: 7.572

Cites:

Cited by: 15

Related to: 10