The First Step of Decision Making: Alignment under Semantic Uncertainty for Automated Operations Research
Year: 2026
Type: preprint
Abstract: Problem definition: Automated operations research (OR) depends on correctly understanding the problem users intend to solve. In practice, limited user knowledge and vague expressions can obscure that problem, creating semantic uncertainty in the descriptions used for modeling. This uncertainty can lead to mathematical models that depart from users' intentions. We study semantic alignment to identify and correct errors or omissions in these descriptions before mathematical modeling. Methodology/results: We develop AMAO, an ambiguity-aware multi-agent framework for automated OR under semantic uncertainty. Its two-stage alignment process first uses semantic cues and contextual information to identify and correct potential semantic errors, then obtains additional information via human--AI interaction for further revision when the available context is insufficient. Specifically, AMAO integrates OR-guided mixture-of-experts (MoE) tuning and trajectory-based harness evolution to enhance semantic alignment capabilities. In addition, an ambiguity-aware benchmark and its matched multi-turn dialogue extension are proposed. Extensive experiments support that AMAO can recover the intended operational problem from ambiguous descriptions and recognize when available information is insufficient. Managerial implications: AMAO provides managers with an integrated workflow for translating ambiguous operational descriptions into mathematical models and optimization solutions. By combining semantic alignment with targeted user interaction, it supports recovery of the intended problem and improves downstream solution accuracy.
Source: arXiv (Cornell University)
Institutions: Ant Group (China), Nanjing University, Peking University
Language: English
Field: Decision Sciences
Domain: Social Sciences
Open Access status: green
OpenAlex ID: W7220663888