arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2412.09285cond-mat.stat-mechcond-mat.dis-nnmath.OCphysics.comp-ph
收藏

用于组合优化的自由能机

Free-Energy Machine for Combinatorial Optimization

Zi-Song Shen, Feng Pan, Yao Wang, Yi-Ding Men, Wen-Biao Xu, Man-Hong Yung, Pan Zhang

AI总结:

本研究提出基于统计物理自由能最小化与机器学习梯度优化的通用组合优化方法自由能机(FEM),可适配并行硬件,在数百万变量规模的多类问题上性能超越定制化的当前最优算法。

摘要:

在学术研究与工业应用中,找到组合优化问题的最优解在科学和技术领域都至关重要。学界已投入大量精力开发依托复杂模型、借助先进计算硬件算力的加速求解方法。尽管已有诸多进展,一项关键挑战依然存在:求解问题时对高效率与广泛通用性的双重需求。\n本研究提出一种通用方法——自由能机(Free-Energy Machine,FEM),该方法基于统计物理中的自由能最小化思想,结合了机器学习中的自动微分与基于梯度的优化技术。该算法具备灵活性,可通过统一框架求解各类组合优化问题;同时具备高效性,可天然利用图形处理单元(GPU)、现场可编程门阵列(FPGA)等大规模并行计算设备。\n我们在最大割问题、平衡最小割问题、最大k-可满足性问题等多种问题上对算法进行基准测试,问题规模扩展至数百万变量,测试覆盖合成实例、真实世界实例与竞赛问题实例。结果表明,该算法不仅速度出众,性能还超越了为各类问题定制的当前最优算法。这凸显出统计物理与机器学习的跨学科融合,为打造将在多类科学与工业场景中产生广泛影响的前沿方法开辟了道路。

英文摘要:

Finding optimal solutions to combinatorial optimization problems is pivotal in both scientific and technological domains, within academic research and industrial applications. A considerable amount of effort has been invested in the development of accelerated methods that leverage sophisticated models and harness the power of advanced computational hardware. Despite the advancements, a critical challenge persists, the dual demand for both high efficiency and broad generality in solving problems. In this work, we propose a general method, Free-Energy Machine (FEM), based on the ideas of free-energy minimization in statistical physics, combined with automatic differentiation and gradient-based optimization in machine learning. The algorithm is flexible, solving various combinatorial optimization problems using a unified framework, and is efficient, naturally utilizing massive parallel computational devices such as graph processing units (GPUs) and field-programmable gate arrays (FPGAs). We benchmark our algorithm on various problems including the maximum cut problems, balanced minimum cut problems, and maximum $k$-satisfiability problems, scaled to millions of variables, across both synthetic, real-world, and competition problem instances. The findings indicate that our algorithm not only exhibits exceptional speed but also surpasses the performance of state-of-the-art algorithms tailored for individual problems. This highlights that the interdisciplinary fusion of statistical physics and machine learning opens the door to delivering cutting-edge methodologies that will have broad implications across various scientific and industrial landscapes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑