Quantum sensors offer control flexibility during estimation by allowing manipulation by the experimenter across various parameters. For each sensing platform, pinpointing the optimal controls to enhance the sensor's precision remains a challenging task. While an analytical solution might be out of reach, machine learning offers a promising avenue for many systems of interest, especially given the capabilities of contemporary hardware. We have introduced a versatile procedure capable of optimizing a wide range of problems in quantum metrology, estimation, and hypothesis testing by combining model-aware reinforcement learning (RL) with Bayesian estimation based on particle filtering. To achieve this, we had to address the challenge of incorporating the many non-differentiable steps of the estimation in the training process, such as measurements and the resampling of the particle filter. Model-aware RL is a gradient-based method, where the derivatives of the sensor's precision are obtained through automatic differentiation (AD) in the simulation of the experiment. Our approach is suitable for optimizing both non-adaptive and adaptive strategies, using neural networks or other agents. We provide an implementation of this technique in the form of a Python library called qsensoropt, alongside several pre-made applications for relevant physical platforms, namely NV centers, photonic circuits, and optical cavities. This library will be released soon on PyPI. Leveraging our method, we've achieved results for many examples that surpass the current state-of-the-art in experimental design. In addition to Bayesian estimation, leveraging model-aware RL, it is also possible to find optimal controls for the minimization of the Cramér-Rao bound, based on Fisher information.
Bayesian Frequency Metrology with Optimal Ramsey Interferometry in Optical Atomic Clocks
Institute for Theoretical Physics and Institute for Gravitational Physics (Albert-Einstein-Institute), Leibniz University Hannover(汉诺威莱布尼茨大学理论物理研究所与引力物理研究所(爱因斯坦研究所))
Adaptive, symmetry-informed Bayesian metrology for precise quantum technology measurements
School of Physics and Astronomy, University of Nottingham(诺丁汉大学物理与天文学学院);School of Mathematics and Physics, University of Surrey(萨里大学数学与物理学院);Department of Physics and Astronomy, University of Exeter(埃克塞特大学物理与天文学系);Institute of Physics and Astronomy, University of Potsdam(波茨坦大学物理与天文学研究所)
Encoded Quantum Signal Processing for Heisenberg-Limited Metrology
Physical Detection Systems and Deployment Division, Pacific Northwest National Laboratory(太平洋西北国家实验室物理探测系统与部署部);Department of Computer Science, Colorado State University(科罗拉多州立大学计算机科学系);Department of Physics, University of Toronto(多伦多大学物理系);Advanced Computing, Mathematics, and Data Division, Pacific Northwest National Laboratory(太平洋西北国家实验室先进计算、数学与数据部)
Quantum error correction for multiparameter metrology
Key Laboratory of Quantum Physics and Photonic Quantum Information, Ministry of Education, University of Electronic Science and Technology of China(电子科技大学量子与光子量子信息教育部重点实验室);Shimmer Center, Tianfu Jiangxi Laboratory(天府江西实验室闪烁中心)
Bayesian Monotone Metrics for Multiparameter Quantum Estimation
Graduate School of Informatics and Engineering, The University of Electro-Communications(电气通信大学信息工程学院);Institute of Science and Engineering, Kanazawa University(金泽大学理工研究院)
Journey in quantum metrology and sensing from foundations to applications: a review
Harish-Chandra Research Institute(哈里什-钱德拉研究所);Homi Bhabha National Institute(霍米·巴哈国家研究所);Instytut Fizyki Teoretycznej, Wydział Fizyki, Astronomii i Informatyki Stosowanej, Uniwersytet Jagielloński(雅盖隆大学物理、天文学与应用信息学系理论物理研究所)