Work

Performance Is Not Learning: Designing courses for the age of AI, and four principles from the evidence

Year: 2026
Type: preprint
Abstract: Generative AI has made one of the oldest distinctions in learning science newly urgent: performance during practice is not the same as learning that lasts. In a randomized field experiment, students practicing with a ChatGPT-style assistant scored 48% higher during practice and 17% lower once the assistant was removed. In a randomized trial at Harvard, a structured AI tutor more than doubled median learning gains over an in-class active-learning lesson. The technology was comparable; the design was not. This article reads those trials alongside course-level studies of optional guardrails, oral code reviews, and the link between confidence and critical thinking. It proposes four design principles for courses where AI is present, considers what they mean for higher education institutions, and states the limits of the evidence.
Author: Ngo, Clark
Language: English
Subfield: Education
Open Access status: green
OpenAlex ID: W7226006573
Cites:
Cited by:
Related to: 10