arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2207.06294quant-phcs.AIcs.LG
收藏

强化学习辅助的递归QAOA

Reinforcement Learning Assisted Recursive QAOA

LIACS, Universiteit Leiden(莱顿大学LIACS学院);Institute for Theoretical Physics, University of Innsbruck(因斯布鲁克大学理论物理研究所)

Yash J. Patel, Sofiene Jerbi, Thomas Bäck, Vedran Dunjko

AI总结:

针对递归QAOA在部分实例上性能不佳的问题,提出强化学习增强的RL-RQAOA,在失败实例上严格优于原算法,在近优实例上保持同等性能,展示了强化学习与量子优化的协同潜力。

摘要:

近年来,诸如量子近似优化算法(QAOA)之类的变分量子算法因其有望利用NISQ设备解决困难的组合优化问题而受到广泛关注。然而,已知在低深度下,QAOA的某些局域性约束限制了其性能。为了突破这些限制,人们提出了QAOA的非局域变体,即递归QAOA(RQAOA),以提高近似解的质量。与QAOA相比,RQAOA的研究相对较少,且对其理解也较为有限,例如,对于哪些实例族它可能无法提供高质量的解。然而,由于我们处理的是NP难问题(具体为伊辛自旋模型),预计RQAOA确实会失败,这引发了设计更好的组合优化量子算法的问题。基于此,我们识别并分析了RQAOA失败的案例,并据此提出了一种强化学习增强的RQAOA变体(RL-RQAOA),该变体改进了RQAOA。我们证明RL-RQAOA的性能优于RQAOA:在已识别的RQAOA表现不佳的实例上,RL-RQAOA严格更优;而在RQAOA接近最优的实例上,RL-RQAOA的表现与之相当。我们的工作展示了强化学习与量子(启发式)优化之间潜在有益的协同作用,为设计针对难题的新颖且更优的启发式算法提供了范例。

英文摘要:

Variational quantum algorithms such as the Quantum Approximation Optimization Algorithm (QAOA) in recent years have gained popularity as they provide the hope of using NISQ devices to tackle hard combinatorial optimization problems. It is, however, known that at low depth, certain locality constraints of QAOA limit its performance. To go beyond these limitations, a non-local variant of QAOA, namely recursive QAOA (RQAOA), was proposed to improve the quality of approximate solutions. The RQAOA has been studied comparatively less than QAOA, and it is less understood, for instance, for what family of instances it may fail to provide high quality solutions. However, as we are tackling $\mathsf{NP}$-hard problems (specifically, the Ising spin model), it is expected that RQAOA does fail, raising the question of designing even better quantum algorithms for combinatorial optimization. In this spirit, we identify and analyze cases where RQAOA fails and, based on this, propose a reinforcement learning enhanced RQAOA variant (RL-RQAOA) that improves upon RQAOA. We show that the performance of RL-RQAOA improves over RQAOA: RL-RQAOA is strictly better on these identified instances where RQAOA underperforms, and is similarly performing on instances where RQAOA is near-optimal. Our work exemplifies the potentially beneficial synergy between reinforcement learning and quantum (inspired) optimization in the design of new, even better heuristics for hard problems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑