Work

Self-Sum: Teaching an Agent to Decide Itself When and What to Summarize

Year: 2026
Type: conference-paper
Abstract: Long-horizon agents operate over extended sequences of reasoning and actions, but this inevitably accumulates context noise, resulting in excessive computational cost and information overload.Existing approaches commonly rely on fixed, rule-based summarization strategies (e.g., summarizing every few steps), which are inflexible, lack generalization, and often introduce irreversible information loss.We propose Self-Sum, a framework that empowers agents to autonomously decide when and what to summarize by modeling summarization as a first-class internal cognitive action, unified with external environmental actions within a multi-turn decision-making process.Specifically, we introduce a two-stage training recipe consisting of (i) a cold-start supervised fine-tuning stage that bootstraps summarization behavior, and (ii) a lightweight, summarization-aware reinforcement learning stage that refines summarization timing and content while discouraging unnecessary summaries.Experiments on multiple longhorizon benchmarks show that Self-Sum consistently outperforms no-summarization and rulebased baselines, with particularly strong gains in generalization.Analysis further reveals that Self-Sum learns to summarize sparsely at meaningful moments and preserves task-relevant information, highlighting the importance of jointly learning when and what to summarize for robust long-horizon agent behavior 1 .
Language: English
Open Access status: hybrid
OpenAlex ID: W7166877845
FWCI:
Cites:
Cited by:
Related to: 10