LoopTool: Closing the Data–Training Loop for Robust LLM Tool Calls
Year: 2026
Type: other
Abstract: Augmenting Large Language Models (LLMs) with external tools enables them to execute complex, multi-step tasks. However, tool learning is hampered by the static synthetic data pipelines, where data generation and model training are executed as two separate, non-interactive processes. This approach fails to focus on the model's specific weaknesses adaptively and allows noisy labels to persist, degrading training efficiency. We introduce \textbf{LoopTool}, a fully automated, model-aware data evolution framework that closes this loop by tightly integrating data synthesis and model training. LoopTool iteratively evolves both the data and the model through three synergistic modules: (1) \textit{Greedy Capability Probing (GCP)} diagnoses the model's mastered and failed capabilities; (2) \textit{Judgement-Guided Label Verification (JGLV)} uses an open-source judge model to find and correct annotation errors, progressively purifying the dataset; and (3) \textit{Error-Driven Data Expansion (EDDE)} generates new, challenging samples based on identified failures. This closed-loop process is tightly integrated with reinforcement learning training and operates within a cost-efficient, open-source ecosystem, thereby eliminating reliance on costly APIs. Experiments show that LoopTool-8B significantly surpasses its 32B data generator and achieves new state-of-the-art results on the BFCL-v3 and ACEBench benchmarks for its scale. Our work demonstrates that closed-loop, self-refining data pipelines can dramatically enhance the tool-use capabilities of LLMs.
Source: Underline Science Inc.
DOI: 10.48448/netc-4g67
Institutions: Shanghai Jiao Tong University, Shanghai Innovation Institute
Language: English
Topic: Topic Modeling
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
SDG: Quality education
Open Access status: green
OpenAlex ID: W7168366285