arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2502.13166quant-phcs.AIcs.CLcs.LG
收藏

大型语言模型有助于缓解量子神经网络中的 barren plateaus

Large Language Models Can Help Mitigate Barren Plateaus in Quantum Neural Networks

Boise State University(博伊西州立大学);University of Cincinnati(辛辛那提大学)

Jun Zhuang, Chaowen Guan

AI总结:

本文提出AdaInit框架,利用具有亚鞅性质的大语言模型迭代合成量子神经网络的初始参数,以维持梯度方差,缓解 barren plateaus 问题。

摘要:

在噪声中等尺度量子计算时代,量子神经网络(QNNs)因其在各种应用中的潜力而兴起,但其训练常受 barren plateaus(BPs)阻碍,即随着量子比特数量增加,梯度方差呈指数衰减。大多数基于初始化的缓解策略依赖于预设计的静态参数分布,缺乏对不同模型规模或数据条件的适应性。为解决这些限制,我们提出了AdaInit,一个利用具有亚鞅性质的大语言模型的框架,用于迭代合成QNNs的初始参数,以产生非可忽略的梯度方差,从而缓解BPs。与传统一次性初始化方法不同,AdaInit通过结合数据集特征和梯度反馈,适应性地探索参数空间,并有理论保证收敛于找到有效的初始参数集。我们提供了基于亚鞅过程的严格理论分析,并实证验证AdaInit在各种QNN规模中均优于现有初始化方法,在维持较高梯度方差方面表现更优。我们相信这项工作可能开启缓解BPs的新途径。

英文摘要:

In the era of noisy intermediate-scale quantum (NISQ) computing, Quantum Neural Networks (QNNs) have emerged as a promising approach for various applications, yet their training is often hindered by barren plateaus (BPs), where gradient variance vanishes exponentially as the qubit size increases. Most initialization-based mitigation strategies rely heavily on pre-designed static parameter distributions, thereby lacking adaptability to diverse model sizes or data conditions. To address these limitations, we propose AdaInit, a foundational framework that leverages large language models with the submartingale property to iteratively synthesize initial parameters for QNNs that yield non-negligible gradient variance, thereby mitigating BPs. Unlike conventional one-shot initialization methods, AdaInit adaptively explores the parameter space by incorporating dataset characteristics and gradient feedback, with theoretical guarantees of convergence to finding a set of effective initial parameters for QNNs. We provide rigorous theoretical analyses of the submartingale-based process and empirically validate that AdaInit consistently outperforms existing initialization methods in maintaining higher gradient variance across various QNN scales. We believe this work may initiate a new avenue to mitigate BPs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑