arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2212.06663quant-phcs.LG
收藏

具有优化动作解码的量子策略梯度算法

Quantum Policy Gradient Algorithm with Optimized Action Decoding

Fraunhofer Institute for Integrated Circuits IIS(弗劳恩霍夫集成电路研究所IIS);Friedrich-Alexander University Erlangen-Nuremberg(埃尔朗根-纽伦堡弗里德里希-亚历山大大学)

Nico Meyer, Daniel D. Scherer, Axel Plinge, Christopher Mutschler, Michael J. Hartmann

AI总结:

本文提出一种基于局部与全局量子测量启发的优化动作解码程序,用于量子策略梯度方法,在多个基准环境中显著提升性能,并成功在5量子比特硬件上完成训练,且经典开销可忽略。

摘要:

由变分量子电路(VQCs)实现的量子机器学习被认为是嘈杂中等规模量子计算时代一个有前景的概念。聚焦于量子强化学习中的应用,我们为量子策略梯度方法提出了一种特定的动作解码程序。受局部和全局量子测量的启发,我们引入了一种新的质量度量,使我们能够优化动作选择所需的经典后处理。由此得到的算法在多个基准环境中表现出显著的性能提升。借助该技术,我们成功在5量子比特硬件设备上执行了完整的训练流程。我们的方法仅引入可忽略的经典开销,并有潜力改进量子强化学习领域之外的基于VQC的算法。

英文摘要:

Quantum machine learning implemented by variational quantum circuits (VQCs) is considered a promising concept for the noisy intermediate-scale quantum computing era. Focusing on applications in quantum reinforcement learning, we propose a specific action decoding procedure for a quantum policy gradient approach. We introduce a novel quality measure that enables us to optimize the classical post-processing required for action selection, inspired by local and global quantum measurements. The resulting algorithm demonstrates a significant performance improvement in several benchmark environments. With this technique, we successfully execute a full training routine on a 5-qubit hardware device. Our method introduces only negligible classical overhead and has the potential to improve VQC-based algorithms beyond the field of quantum reinforcement learning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑