arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.10450cs.LGcs.AImath.OC
收藏

构建工业规模优化建模基准

Constructing Industrial-Scale Optimization Modeling Benchmark

Great Bay University(大湾大学);Peking University(北京大学);Huawei Technologies Co., Ltd(华为技术有限公司)

Zhong Li, Hongliang Lu, Tao Wei, Yuxuan Chen, Wenyu Liu, Yuan Lan, Fan Zhang, Zaiwen Wen

AI总结:

提出MIPLIB-NL基准,通过结构感知逆向构建方法从真实混合整数线性规划中生成自然语言规范与求解器代码,以评估大语言模型在工业规模优化建模中的性能。

摘要:

优化建模支撑着物流、制造、能源和金融领域的决策,然而将自然语言需求转化为正确的优化公式和可执行求解器代码仍然需要大量人力。尽管大语言模型(LLMs)已被探索用于此任务,但评估仍以玩具级或合成基准为主,掩盖了具有$10^{3}$--$10^{6}$(或更多)变量和约束的工业问题的难度。一个关键瓶颈是缺乏将自然语言规范与基于真实优化模型的参考公式/求解器代码对齐的基准。为填补这一空白,我们引入了MIPLIB-NL,它通过一种结构感知的逆向构建方法从MIPLIB~2017中的真实混合整数线性规划构建而成。我们的流程(i)从平坦的求解器公式中恢复紧凑、可复用的模型结构,(ii)在统一的模型-数据分离格式下,逆向生成明确关联到该恢复结构的自然语言规范,以及(iii)通过专家评审和人类-LLM交互以及独立的逆向检查进行迭代语义验证。这产生了223个一对一的重构,保留了原始实例的数学内容,同时实现了现实的自然语言到优化评估。实验表明,在现有基准上表现良好的系统在MIPLIB-NL上性能显著下降,暴露了在玩具规模下不可见的失败模式。

英文摘要:

Optimization modeling underpins decision-making in logistics, manufacturing, energy, and finance, yet translating natural-language requirements into correct optimization formulations and solver-executable code remains labor-intensive. Although large language models (LLMs) have been explored for this task, evaluation is still dominated by toy-sized or synthetic benchmarks, masking the difficulty of industrial problems with $10^{3}$--$10^{6}$ (or more) variables and constraints. A key bottleneck is the lack of benchmarks that align natural-language specifications with reference formulations/solver code grounded in real optimization models. To fill in this gap, we introduce MIPLIB-NL, built via a structure-aware reverse construction methodology from real mixed-integer linear programs in MIPLIB~2017. Our pipeline (i) recovers compact, reusable model structure from flat solver formulations, (ii) reverse-generates natural-language specifications explicitly tied to this recovered structure under a unified model--data separation format, and (iii) performs iterative semantic validation through expert review and human--LLM interaction with independent reconstruction checks. This yields 223 one-to-one reconstructions that preserve the mathematical content of the original instances while enabling realistic natural-language-to-optimization evaluation. Experiments show substantial performance degradation on MIPLIB-NL for systems that perform strongly on existing benchmarks, exposing failure modes invisible at toy scale.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑