arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2212.09431quant-ph
收藏

硬件错误下量子强化学习的鲁棒性

Robustness of quantum reinforcement learning under hardware errors

Andrea Skolik, Stefano Mangini, Thomas Bäck, Chiara Macchiavello, Vedran Dunjko

摘要:

变分量子机器学习算法已经成为最近关于如何利用近期量子设备进行机器学习任务的研究的焦点。它们被认为适合于此,因为运行的电路可以根据设备进行定制,并且大部分计算都委托给经典优化器。也有人假设,由于它们的混合性质,它们可能比传统算法对硬件噪声更鲁棒。然而,在硬件引起的噪声影响下训练量子机器学习模型的效果尚未得到广泛研究。在这项工作中,我们解决这个问题的一种特定类型的学习,即变分强化学习,通过研究其性能存在的各种噪声源:散粒噪声,相干和不相干的错误。我们分析和实证研究如何在训练和评估变分量子强化学习算法的噪声的存在影响代理的性能和学习策略的鲁棒性。此外,我们提供了一种方法来减少所需的测量数量训练Q-学习代理,使用算法的固有结构。

英文摘要:

Variational quantum machine learning algorithms have become the focus of recent research on how to utilize near-term quantum devices for machine learning tasks. They are considered suitable for this as the circuits that are run can be tailored to the device, and a big part of the computation is delegated to the classical optimizer. It has also been hypothesized that they may be more robust to hardware noise than conventional algorithms due to their hybrid nature. However, the effect of training quantum machine learning models under the influence of hardware-induced noise has not yet been extensively studied. In this work, we address this question for a specific type of learning, namely variational reinforcement learning, by studying its performance in the presence of various noise sources: shot noise, coherent and incoherent errors. We analytically and empirically investigate how the presence of noise during training and evaluation of variational quantum reinforcement learning algorithms affect the performance of the agents and robustness of the learned policies. Furthermore, we provide a method to reduce the number of measurements required to train Q-learning agents, using the inherent structure of the algorithm.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑