arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.01291cs.LO
收藏

构造-验证:Lean 4中的应用数学基准

Construction-Verification: A Benchmark for Applied Mathematics in Lean 4

Peking University(北京大学);Ant Digital Technologies, Ant Group(蚂蚁数字科技,蚂蚁集团)

Bowen Yang, Yi Yuan, Chenyi Li, Ziyu Wang, Liangqi Li, Bo Zhang, Zhe Li, Zaiwen Wen

AI总结:

本文提出Lean 4中的构造-验证框架,通过AMBER基准评估应用数学领域中显式解决方案合成与验证能力,揭示通用模型在复杂构造任务中的优势。

摘要:

近年来,大型语言模型在数学形式化方面展示了令人印象深刻的潜力。然而,现有基准主要集中在逻辑验证声明性命题上,往往忽视了显式合成解决方案的任务。这种局限性在应用数学领域尤为明显,因为目标通常是推导具体的值或可执行算法,而不是仅仅证明定理。为此,我们引入了一个Lean 4框架,强制代理在证明正确性之前定义显式解决方案。我们整理了一个涵盖应用数学核心领域的综合基准AMBER(应用于推理的数学基准),包括凸分析、优化、数值代数和高维概率。除了定理证明,我们的基准还包括评估、算法设计和表示转换等复杂任务。实验表明,当前模型在这些构造任务上面临显著困难。值得注意的是,我们发现通用推理模型在专用定理证明器上表现更优。我们归因于专用模型在指令遵循能力上的退化。在证明语料库上进行微调似乎导致了

英文摘要:

Recent advances in large language models have demonstrated impressive capabilities in mathematical formalization. However, existing benchmarks focus on logical verification of declarative propositions, often neglecting the task of explicitly synthesizing solutions. This limitation is particularly acute in applied mathematics domains, where the goal is frequently to derive concrete values or executable algorithms rather than solely proving theorems. To address this, we introduce a Lean 4 framework that enforces a construction-verification workflow, compelling the agent to define explicit solutions before proving their correctness. We curate a comprehensive benchmark AMBER (Applied Mathematics BEnchmark for Reasoning) spanning core domains of applied mathematics, including convex analysis, optimization, numerical algebra, and high-dimensional probability. Aside from theorem proving, our benchmark features complex tasks such as evaluation, algorithm design, and representation transformation. Experiments reveal that current models face significant difficulties with these constructive tasks. Notably, we observe that general-purpose reasoning models consistently outperform specialized theorem provers. We attribute this to a degradation of instruction following capabilities in specialized models. Fine-tuning on proof corpora appears to induce ``tactical overfitting", compromising the ability to adhere to complex constructive requirements, whereas general models retain the versatility needed for multi-task formal reasoning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑