Work

CaVER: Capability-Guided Environment Synthesis with Verification and Experience Reuse

Year: 2026
Type: preprint
Abstract: Executable environments can supply agent training data at scale, yet successful execution need not teach the intended capability. Defective public contracts can obstruct it, valid solutions can bypass it, and loss masking can remove its only training witness. We introduce CaVER, a capability-guided framework for environment synthesis, verifiable supervision, and reusable production experience. Capability cards specify triggering conditions, public evidence, observable behavior, and consequential use, guiding joint task-environment construction through six expansion axes and versioned reuse. A critic, validator, and repairer test defect hypotheses and make contract-preserving changes before sampling. Eight independent teacher attempts then support business, capability, and supervision review; diagnosis routes problems to package, checker, or state-grounded execution repair. A separate experience agent turns validated findings into scoped lessons and reusable authoring skills linked to source evidence. Authors can challenge guidance with counterexamples; substantive revisions require independent validation before publication. For supervised fine-tuning, we select 3,768 trajectories with their executable task packages and evaluate three Qwen3.5 configurations on three benchmarks. Mean task pass rate and native average score improve in all nine model-benchmark comparisons; Qwen3.5-27B reaches 31.08% +/- 0.40 strict AutomationBench success over four inference runs. A paired study on 979 early task packages yields 180 validated repairs; the self-audit arm has 20.3% fewer packages with eight valid teacher failures. Together, these evaluations characterize the selected training data and the self-audit stage of capability-guided environment production.
Institution: Peking University
Language: English
Open Access status: green
OpenAlex ID: W7235342798
Cites:
Cited by:
Related to: 10