Work

Training Humans for Robust Human-Agent Teaming: Knowing When to Engage with an AI Partner

Year: 2025
Type: conference-paper
Abstract: Learning to team with an AI counterpart can be challenging – particularly in the context of an unfamiliar task that must also be learned. This study compares the impacts of scaffolded versus self-paced training on human-AI agent teams negotiating a novel logistics and sustainment task. It was found that guiding participants early on in how to leverage AI assistance (scaffolded practice) led to much more robust teaming than allowing them to learn at their own pace. Additionally, teams whose human counterpart received scaffolded practice tended to achieve higher scores than those who learned under self-direction. Post-hoc analysis also revealed that \textit{when} human teammembers leveraged the agent was of particular importance -- with the greatest impact of human-AI teaming observed in the most high stakes periods of the game. Taken together, these findings demonstrate not only that some forms of training are more beneficial than others for human-AI agent teaming -- but also, that context-specific learning on the fly is important for effective team performance.
Authors: Leon Lange, Qiao Zhang, Christopher J. MacLellan, Ying Wu
Language: English
Field: Psychology
Open Access status: diamond
OpenAlex ID: W4410823286
FWCI:
Cites:
Cited by:
Related to: 10