Work

EvoCoT: Co-evolving generation and verification for LLM-based optimization autoformulation

Year: 2026
Type: article
Abstract: Formulating optimization models from natural-language specifications is a major bottleneck in engineering decision-making, requiring both domain expertise and strict modeling discipline. Existing large language model (LLM) approaches often produce formulations that are executable yet semantically incorrect, or structurally invalid under solver constraints. Evolutionary Chain-of-Thought Optimization (EvoCoT) is introduced as a co-evolutionary autoformulation framework that treats model synthesis as guided discrete search over reasoning–code pairs rather than one-shot generation. EvoCoT couples three mechanisms in a single feedback loop: reasoning-first evolutionary search over a population of decoded programs, memory-guided exemplar retrieval, and a co-evolving verifier that provides structural-faithfulness feedback beyond static solver checks. Experiments on eight benchmark suites show consistent improvements over strong zero-shot baselines and competitive performance against agentic and fine-tuned systems, with the largest gains on difficult industrial-scale tasks. Attribution analyses under matched search budgets show that the population-level evolutionary search at the core of the framework accounts for these accuracy gains. The verifier and memory complement this search with reliability and triage rather than additional accuracy: a graded, execution-grounded trust signal for ranking surviving formulations, and an auditable, leakage-controlled library of validated formulations.
Language: English
Open Access status: hybrid
Estimated APC paid: $3,690
OpenAlex ID: W7140609984
FWCI:
Cites: 32
Cited by:
Related to: 10