arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.14539quant-ph
收藏

基于强化学习的无模型量子控制

Model-Free Quantum Control with Reinforcement Learning

V. V. Sivak, A. Eickbusch, H. Liu, B. Royer, I. Tsioutsios, M. H. Devoret

摘要:

模型偏差是当前主要的最优量子控制方法的固有限制,其依赖于系统模拟来优化控制策略。为了克服这一限制,我们提出了一种基于电路的方法,用于以无模型的方式在量子控制任务上训练强化学习代理。给定一个连续参数化的控制电路,智能体通过与量子系统的试错交互来学习其参数,使用测量结果作为关于量子态的唯一信息来源。专注于控制耦合到辅助量子比特的谐振子,我们展示了如何使用实验上可用的观测值的测量来奖励学习代理。我们训练代理准备各种非经典状态使用酉控制和控制与自适应测量为基础的量子反馈,并执行编码量子位的逻辑门。这种方法在样本效率方面明显优于广泛使用的无模型方法。我们的数值工作与超导电路和捕获离子平台直接相关,在这些平台上可以在实验中实施这种训练,从而完全消除模型偏差并使量子控制策略适应它们部署的特定系统。

英文摘要:

Model bias is an inherent limitation of the current dominant approach to optimal quantum control, which relies on a system simulation for optimization of control policies. To overcome this limitation, we propose a circuit-based approach for training a reinforcement learning agent on quantum control tasks in a model-free way. Given a continuously parameterized control circuit, the agent learns its parameters through trial-and-error interaction with the quantum system, using measurement outcomes as the only source of information about the quantum state. Focusing on control of a harmonic oscillator coupled to an ancilla qubit, we show how to reward the learning agent using measurements of experimentally available observables. We train the agent to prepare various non-classical states using both unitary control and control with adaptive measurement-based quantum feedback, and to execute logical gates on encoded qubits. This approach significantly outperforms widely used model-free methods in terms of sample efficiency. Our numerical work is of immediate relevance to superconducting circuits and trapped ions platforms where such training can be implemented in experiment, allowing complete elimination of model bias and the adaptation of quantum control policies to the specific system in which they are deployed.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑