arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2512.20064cs.DC
收藏

FastMPS: 重新审视大规模矩阵乘积态采样中的数据并行

FastMPS: Revisit Data Parallel in Large-scale Matrix Product State Sampling

Tsinghua University(清华大学);University of Science and Technology of China(中国科学技术大学);Hefei National Research Center for Physical Sciences at the Microscale(合肥微尺度物质科学国家研究中心);National Supercomputing Center in Wuxi(无锡国家超级计算中心)

Yaojian Chen, Si-Qiu Gong, Lin Gan, Yanfei Liu, An Yang, Yinuo Wang, Chao-yang Lu, Guangwen Yang

AI总结:

Fast-MPS通过结合数据并行与张量并行,实现大规模MPS采样效率的显著提升,达到10倍以上的加速效果。

摘要:

矩阵乘积态(MPS)是一种灵活的张量网络表示,广泛应用于量子物理、量子化学和机器学习等领域。MPS采样在这些领域中是关键的基本操作。随着问题变得更加复杂,MPS的规模迅速增加。传统数据并行受限于大规模MPS的内存和重载I/O。能够处理大规模MPS的模型并行施加了刚性的进程绑定,并缺乏可扩展性。本文提出了Fast-MPS,一种多级并行框架,用于可扩展的MPS采样。我们的设计结合了样本之间的数据并行和沿着键维度的张量并行。通过压缩和重叠消除了内存和I/O压力,并在大规模MPS采样中恢复了数据并行。我们评估了我们的方法在高斯玻色采样上的应用,这是一个代表性和具有挑战性的应用。Fast-MPS相比现有模拟器实现了超过10倍的加速,可扩展到数千个进程,并能够模拟8176个站点和键维度chi=10^4的模拟,显著优于现有技术。Fast-MPS在高性能张量网络应用中展现了巨大的潜力。

英文摘要:

Matrix Product State (MPS) is a versatile tensor network representation widely applied in quantum physics, quantum chemistry, and machine learning, etc. MPS sampling serves as a critical fundamental operation in these fields. As the problems become more complex, the scale of MPS is rapidly increasing. Traditional data parallelism is limited by memory and heavy I/O in large-scale MPS. Model parallelism that can handle large-scale MPS imposes rigid process bindings and lacks scalability. This work proposes Fast-MPS, a multi-level parallel framework for scalable MPS sampling. Our design combines data parallelism across samples with tensor parallelism along bond dimensions. We eliminate memory and I/O pressure through compression and overlapping, and revive data parallel in large-scale MPS sampling. We evaluate our approach on Gaussian Boson Sampling, a representative and demanding application. Fast-MPS achieves over 10x speedup compared to existing simulators, scales to thousands of processes, and enables simulations with 8,176 sites and bond dimension chi = 10^4, significantly outperforming the state of the art. Fast-MPS has demonstrated great potential in high-performance tensor network applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑