Quantum computers promise tremendous impact across applications -- and have shown great strides in hardware engineering -- but remain notoriously error prone. Careful design of low-level controls has been shown to compensate for the processes which induce hardware errors, leveraging techniques from optimal and robust control. However, these techniques rely heavily on the availability of highly accurate and detailed physical models which generally only achieve sufficient representative fidelity for the most simple operations and generic noise modes. In this work, we use deep reinforcement learning to design a universal set of error-robust quantum logic gates on a superconducting quantum computer, without requiring knowledge of a specific Hamiltonian model of the system, its controls, or its underlying error processes. We experimentally demonstrate that a fully autonomous deep reinforcement learning agent can design single qubit gates up to $3\times$ faster than default DRAG operations without additional leakage error, and exhibiting robustness against calibration drifts over weeks. We then show that $ZX(-π/2)$ operations implemented using the cross-resonance interaction can outperform hardware default gates by over $2\times$ and equivalently exhibit superior calibration-free performance up to 25 days post optimization using various metrics. We benchmark the performance of deep reinforcement learning derived gates against other black box optimization techniques, showing that deep reinforcement learning can achieve comparable or marginally superior performance, even with limited hardware access.
Measurement-based adaptation protocol with quantum reinforcement learning in a Rigetti quantum computer
University of the Basque Country UPV/EHU(巴斯克大学(UPV/EHU));IKERBASQUE, Basque Foundation for Science(巴斯克科学基金会(IKERBASQUE));Shanghai University(上海大学);International Center of Quantum Artificial Intelligence for Science and Technology (QuArtist)(国际科学技术量子人工智能中心(QuArtist));IQM(IQM公司);Universidad de Sevilla(塞维利亚大学)
Multiqubit and multilevel quantum reinforcement learning with quantum technologies
Universidad de Santiago de Chile (USACH)(智利圣地亚哥大学);Center for the Development of Nanoscience and Nanotechnology(纳米科学与纳米技术发展中心);University of the Basque Country UPV/EHU(巴斯克大学);IKERBASQUE, Basque Foundation for Science(伊克尔巴斯克巴斯克科学基金会);Shanghai University(上海大学)
Quantum noise modeling through Reinforcement Learning
La Sapienza University of Rome(罗马大学);Technology Innovation Institute(技术创新研究所);The Australian National University(澳大利亚国立大学);Instituto de Física Teórica, UAM-CSIC, Universidad Autónoma de Madrid(马德里自治大学理论物理研究所);CERN, Theoretical Physics Department(欧洲核子研究中心理论物理部);Università degli Studi di Milano(米兰大学);INFN, Sezione di Milano(意大利国家核物理研究所米兰分部)
Efficient $n$-qubit entangling operations via a superconducting quantum router
Pritzker School of Molecular Engineering, University of Chicago(芝加哥大学普里茨克分子工程学院);Applied Materials Inc(应用材料公司);Department of Physics, ETH Zürich(苏黎世联邦理工学院物理系);Department of Physics, University of Chicago(芝加哥大学物理系)
Quantum Adiabatic Algorithm Design using Reinforcement Learning
Fudan University(复旦大学);Institute of Nanoelectronics and Quantum Computing, Fudan University(复旦大学纳米电子学与量子计算研究所);Collaborative Innovation Center of Advanced Microstructures(先进微结构协同创新中心);Shanghai Research Center for Quantum Sciences(上海量子科学研究中心)
Differentiable Maximum Likelihood Noise Estimation for Quantum Error Correction
Singapore University of Technology and Design(新加坡科技设计大学);CAS Key Laboratory for Theoretical Physics, Institute of Theoretical Physics, Chinese Academy of Sciences(中国科学院理论物理研究所);School of Physical Sciences, University of Chinese Academy of Sciences(中国科学院大学物理科学学院)