arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2304.09718quant-phcs.AIcs.LG
收藏

面向量子控制的样本高效型基于模型的强化学习

Sample-efficient Model-based Reinforcement Learning for Quantum Control

Cardiff University(卡迪夫大学);University of Bristol(布里斯托大学);University of Southern California(南加州大学);Swansea University(斯旺西大学)

Irtaza Khalid, Carrie A. Weidner, Edmond A. Jonckheere, Sophie G. Shermer, Frank C. Langbein

AI总结:

本研究提出一种基于模型的强化学习方法,结合可学习哈密顿量拟设的神经ODE构建环境模型,在量子门优化任务中样本复杂度比标准无模型RL高一个数量级,适用于部分表征的单、双量子比特系统。

摘要:

我们提出一种基于模型的强化学习(RL)方法,用于含噪声的含时门优化,其样本复杂度优于无模型RL。样本复杂度指控制器与物理系统的交互次数。受神经常微分方程(ODEs)近期进展启发,我们利用一种归纳偏置,采用由可学习的哈密顿量拟设参数化的可自动微分ODE来表征逼近环境的模型,该模型的含时部分(包括控制项)是完全已知的。我们通过与系统的交互,同时实现控制以及连续不含时参数的哈密顿量学习。在纳入单脉冲测量、任意希尔伯特空间截断和哈密顿量参数不确定性的真实数值实验中,我们证明在制备具有闭系统和开系统动力学的标准幺正门时,本方法的样本复杂度比标准无模型RL高一个数量级。此外,现有控制方法(如GRAPE)可利用学到的哈密顿量,以RL找到的控制器为初始值进行进一步的基于梯度的优化。本文中应用于氮空位(NV)中心和transmon的算法,非常适合控制部分表征的单量子比特和双量子比特系统。

英文摘要:

We propose a model-based reinforcement learning (RL) approach for noisy time-dependent gate optimization with improved sample complexity over model-free RL. Sample complexity is the number of controller interactions with the physical system. Leveraging an inductive bias, inspired by recent advances in neural ordinary differential equations (ODEs), we use an auto-differentiable ODE parametrised by a learnable Hamiltonian ansatz to represent the model approximating the environment whose time-dependent part, including the control, is fully known. Control alongside Hamiltonian learning of continuous time-independent parameters is addressed through interactions with the system. We demonstrate an order of magnitude advantage in the sample complexity of our method over standard model-free RL in preparing some standard unitary gates with closed and open system dynamics, in realistic numerical experiments incorporating single shot measurements, arbitrary Hilbert space truncations and uncertainty in Hamiltonian parameters. Also, the learned Hamiltonian can be leveraged by existing control methods like GRAPE for further gradient-based optimization with the controllers found by RL as initializations. Our algorithm that we apply on nitrogen vacancy (NV) centers and transmons in this paper is well suited for controlling partially characterised one and two qubit systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑