Year: 2026
Type: article
Abstract: Formulating optimization models from natural-language specifications is a major bottleneck in engineering decision-making, requiring both domain expertise and strict modeling discipline. Existing large language model (LLM) approaches often produce formulations that are executable yet semantically incorrect, or structurally invalid under solver constraints. Evolutionary Chain-of-Thought Optimization (EvoCoT) is introduced as a co-evolutionary autoformulation framework that treats model synthesis as guided discrete search over reasoning–code pairs rather than one-shot generation. EvoCoT couples three mechanisms in a single feedback loop: reasoning-first evolutionary search over a population of decoded programs, memory-guided exemplar retrieval, and a co-evolving verifier that provides structural-faithfulness feedback beyond static solver checks. Experiments on eight benchmark suites show consistent improvements over strong zero-shot baselines and competitive performance against agentic and fine-tuned systems, with the largest gains on difficult industrial-scale tasks. Attribution analyses under matched search budgets show that the population-level evolutionary search at the core of the framework accounts for these accuracy gains. The verifier and memory complement this search with reliability and triage rather than additional accuracy: a graded, execution-grounded trust signal for ranking surviving formulations, and an auditable, leakage-controlled library of validated formulations.
Authors: Tianyu Wang(Conceptualization, Data curation, Methodology, Software, Validation, Visualization, Writing – original draft), Fubo Qi(Methodology, Validation), Ruixiang Zheng(Data curation, Project administration, Visualization, Writing – review & editing), Xu Ge(Software, Visualization), Mian Li(Funding acquisition, Resources, Supervision, Writing – review & editing), Xi Vincent Wang(Supervision, Writing – review & editing), Lihui Wang(Supervision, Writing – review & editing)
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
Estimated APC paid: $3,690
Award: G2208771225
OpenAlex ID: W7140609984
