16 papers
SAC-Opt: Semantic Anchors for Iterative Correction in Optimization Modeling
Yansen Zhang, Qingcan Kang, Yujie Chen +5
Large language models (LLMs) have opened new paradigms in optimization modeling by enabling the generation of executable solver code from natural language descriptions. Despite thi…
Automated Optimization Modeling via a Localizable Error-Driven Perspective
Weiting Liu, Han Wu, Yufei Kuang +4
Automated optimization modeling via Large Language Models (LLMs) has emerged as a promising approach to assist complex human decision-making. While post-training has become a pivot…
Activation-Guided Consensus Merging for Large Language Models
Yuxuan Yao, Shuqi Liu, Zehua Liu +6
Recent research has increasingly focused on reconciling the reasoning capabilities of System 2 with the efficiency of System 1. While existing training-based and prompt-based appro…
OptiTree: Hierarchical Thoughts Generation with Tree Search for LLM Optimization Modeling
Haoyang Liu, Jie Wang, Yuyang Cai +3
Optimization modeling is one of the most crucial but technical parts of operations research (OR). To automate the modeling process, existing works have leveraged large language mod…
REG: A Regularization Optimizer for Robust Training Dynamics
Zehua Liu, Han Wu, Xiaojin Fu +4
Optimizers are crucial for the efficient training of Large Language Models (LLMs). While AdamW is the de facto standard, recent structure-aware optimizers like Muon have emerged, w…
A Survey of Optimization Modeling Meets LLMs: Progress and Future Directions
Ziyang Xiao, Jingrong Xie, Lilin Xu +15
By virtue of its great utility in solving real-world problems, optimization modeling has been widely employed for optimal decision-making across various sectors, but it requires su…