Work

ReproAgent: Contract-Guided Paper-to-Code Reproduction

Year: 2026
Type: conference-paper
Abstract: Paper-to-code reproduction asks scientific AI agents to turn research papers into executable repositories that preserve the paper's method, protocol and artifacts.This is difficult because the specification is split: explicit paper content such as algorithms, metrics and artifacts is often lost across long agent trajectories, while implicit details such as framework defaults and conventions inherited from related work are absent from the paper.We introduce REPROA-GENT, a four-stage Prepare-Plan-Generate-Repair pipeline built around a persistent implementation contract with two channels: an implementation-requirement channel that turns paper snippets into code obligations, and a reference-evidence channel that retrieves content and structure evidence from related repositories.Both are bound to work packages, projected into file-level contracts, and consumed across generation and repair.On PaperBench Code-Dev (Starace et al., 2025), ReproAgent reaches the highest mean score among samebackbone scaffolds under both Claude-Sonnet-4.5 and Gemini-3-Flash.End-to-end channel ablations and per-paper cases support the contribution of both channels.Code and experimental artifacts are publicly available.1
Language: English
Open Access status: bronze
OpenAlex ID: W7204223035
FWCI:
Cites:
Cited by:
Related to: 10