Work

Automating Pursuitworthiness: Four Concerns About ‘AI Scientists’ and the Proper Roles for Machine Learning Systems in Scientific Discovery

Year: 2026
Type: preprint
Abstract: Machine learning (ML) systems play increasingly important roles in scientific discovery. Recent efforts seek to build ML systems that predict upcoming discoveries and who is likely to make them, identify emerging research trends, and suggest novel concepts, ideas, questions, hypotheses and experiments to investigators. Notably, unlike other ML systems, these predictive discovery and recommender systems (PDRS) seek to augment and automate agenda-setting roles currently played by human researchers: determining or shaping the goals and trajectories of scientific discovery, rather than taking given goals and merely executing tasks in their pursuit. This paper argues, first, that PDRS raise novel conceptual and methodological disruptions, creating uncertainty around whether PDRS can and should play such roles. Second, the paper draws out four major questions, and associated concerns, about the roles PDRS are envisioned to play. These issues have not received attention in the literature thus far, leaving unclear what the proper roles of PDRS in science could be and how these roles should be carved out through appropriate designs and divisions of labor. To address these issues, the paper explores concerns about PDRS’ potential impacts and limitations, and how PDRS fit with broader views of how science should function.
Language: English
Open Access status: green
OpenAlex ID: W7149223810
Cites: 89
Cited by: 1
Related to: 10