arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.19633cs.AI
收藏

OptiMUS-0.3:利用大语言模型在大规模范围内建模和解决优化问题

OptiMUS-0.3: Using Large Language Models to Model and Solve Optimization Problems at Scale

School of Management Science and Engineering, Stanford University(斯坦福大学管理科学与工程学院);Institute for Computational and Mathematical Engineering, Stanford University(斯坦福大学计算与数学工程研究所)

Ali AhmadiTeshnizi, Wenzhi Gao, Herman Brunborg, Shayan Talaei, Connor Lawless, Madeleine Udell

AI总结:

本文提出OptiMUS-0.3系统,通过大语言模型自动建模和解决线性规划问题,提升优化工具的实用性与效率,实验证明其在易实例和实际案例中表现优异。

摘要:

优化问题广泛存在于制造、分销到医疗等领域,但大多数问题仍通过启发式方法手工解决,而非最优的求解器。本文介绍一个基于大语言模型的系统,能够从自然语言描述中构建和解决(混合整数)线性规划问题。系统可生成数学模型、编写并调试求解器代码、评估生成的解决方案,并根据评估结果改进模型和代码的效率与正确性。OptiMUS-0.3采用模块化结构处理问题,可处理长描述和复杂数据而无需长提示。实验表明,OptiMUS-0.3在易实例中比直接提示基线高出43%,在难实例中高出18%。在基准问题上,它与微调专家模型竞争,但在实际案例中表现更优(28.6% vs. 0%)。消融研究显示,模块化架构与错误纠正是性能提升的关键。关键发现是系统架构比模型能力更能驱动性能。结构分解与针对性错误纠正使弱模型在简单提示下可匹配强模型,并在不重新训练的情况下与微调专家模型竞争。

英文摘要:

Optimization problems are pervasive in sectors from manufacturing and distribution to healthcare. However, most such problems are still solved heuristically by hand rather than optimally by state-of-the-art solvers because the expertise required to formulate and solve these problems limits the widespread adoption of optimization tools and techniques. We introduce a Large Language Model (LLM)-based system designed to formulate and solve (mixed integer) linear programming problems from their natural language descriptions. Our system can develop mathematical models, write and debug solver code, evaluate the generated solutions, and improve efficiency and correctness of its model and code based on these evaluations. OptiMUS is designed as a productivity tool for optimization practitioners who understand the problem domain and can describe it precisely, but seek to accelerate the modeling and implementation workflow. OptiMUS-0.3 utilizes a modular structure to process problems, allowing it to handle problems with long descriptions and complex data without long prompts. Experiments demonstrate that OptiMUS-0.3 outperforms direct-prompting baselines by over 43% on easy and 18% on hard instances. It remains competitive with fine-tuned specialist models on benchmark problems, and outperforms them on real-world case studies (28.6% vs. 0%) where fine-tuned models fail to generalize. Ablation studies show that modular architecture with error correction is central to these gains. A key finding is that system architecture is a stronger driver of performance than model capability. Structured decomposition with targeted error correction enables weaker models to match stronger models under naive prompting, and remains competitive with fine-tuned specialist models without retraining costs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑