arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2601.01779hep-thcs.LG
收藏

基于变压器的序列到序列架构的机器学习模块化

Machine learning modularity

School of Physical Science and Technology, Soochow University(物理科学与技术学院,苏州大学);Institute for Advanced Study, Soochow University(先进研究院,苏州大学);Mandelstam Institute for Theoretical Physics, School of Physics and NITheCS, University of the Witwatersrand(理论物理研究所,沃土大学)

Yi Fan, Vishnu Jejjala, Yang Lei

AI总结:

本文提出了一种基于变压器的机器学习框架,利用模变换规则自动简化包含椭圆Gamma函数的复杂表达式,实现了高精度的符号简化。

摘要:

基于一种结合动态批处理算法的变压器基于序列到序列架构,本文介绍了一种机器学习框架,用于自动简化包含多个椭圆Gamma函数的复杂表达式,包括q-θ函数和椭圆Gamma函数。该模型学习应用代数恒等式,特别是SL(2,Z)和SL(3,Z)模变换,将高度混乱的表达式减少到其标准形式。实验结果表明,该模型在分布内测试中达到超过99%的准确性,并在显著的外推情况下保持稳健性能(超过90%的准确性),例如在更深层次的混乱深度下。这表明该模型已经内化了模变换的底层代数规则,而不是仅仅记忆训练模式。我们的工作展示了首次成功将机器学习应用于使用模恒等式进行符号简化,提供了一种新的自动化工具,用于量子场论和弦论中特殊函数的计算。

英文摘要:

Based on a transformer based sequence-to-sequence architecture combined with a dynamic batching algorithm, this work introduces a machine learning framework for automatically simplifying complex expressions involving multiple elliptic Gamma functions, including the $q$-$θ$ function and the elliptic Gamma function. The model learns to apply algebraic identities, particularly the SL$(2,\mathbb{Z})$ and SL$(3,\mathbb{Z})$ modular transformations, to reduce heavily scrambled expressions to their canonical forms. Experimental results show that the model achieves over 99\% accuracy on in-distribution tests and maintains robust performance (exceeding 90\% accuracy) under significant extrapolation, such as with deeper scrambling depths. This demonstrates that the model has internalized the underlying algebraic rules of modular transformations rather than merely memorizing training patterns. Our work presents the first successful application of machine learning to perform symbolic simplification using modular identities, offering a new automated tool for computations with special functions in quantum field theory and the string theory.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑