arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2312.16985quant-ph
收藏

量子计量学中用于高性能贝叶斯实验设计的模型感知强化学习

Model-aware reinforcement learning for high-performance Bayesian experimental design in quantum metrology

Federico Belliardo, Fabio Zoratti, Florian Marquardt, Vittorio Giovannetti

AI总结:

针对量子传感中优化控制以提升精度的难题,提出结合模型感知强化学习与粒子滤波贝叶斯估计的通用方法,开发qsensoropt库,实现非自适应/自适应策略优化,实验结果超越现有水平,还可优化Cramér-Rao界相关控制。

摘要:

量子传感器在估计过程中通过允许实验者对各种参数进行操控,提供了控制灵活性。对于每个传感平台而言,确定增强传感器精度的最优控制仍是一项具有挑战性的任务。尽管分析解可能无法实现,但机器学习为许多受关注的系统提供了有前景的途径,尤其是考虑到现代硬件的能力。我们引入了一种通用程序,通过将模型感知强化学习(RL)与基于粒子滤波的贝叶斯估计相结合,能够优化量子计量学、估计和假设检验中的广泛问题。为此,我们必须解决在训练过程中纳入估计的许多不可微分步骤的挑战,例如测量和粒子滤波的重采样。模型感知RL是一种基于梯度的方法,其中传感器精度的导数通过实验模拟中的自动微分(AD)获得。我们的方法适用于使用神经网络或其他智能体优化非自适应和自适应策略。我们以名为qsensoropt的Python库的形式提供了该技术的实现,以及针对相关物理平台(即NV中心、光子电路和光学腔)的几个预制应用程序。该库即将在PyPI上发布。利用我们的方法,我们在许多示例中取得了超越当前实验设计最先进水平的结果。除了贝叶斯估计外,利用模型感知RL,还可以基于Fisher信息找到最小化Cramér-Rao界的最优控制。

英文摘要:

Quantum sensors offer control flexibility during estimation by allowing manipulation by the experimenter across various parameters. For each sensing platform, pinpointing the optimal controls to enhance the sensor's precision remains a challenging task. While an analytical solution might be out of reach, machine learning offers a promising avenue for many systems of interest, especially given the capabilities of contemporary hardware. We have introduced a versatile procedure capable of optimizing a wide range of problems in quantum metrology, estimation, and hypothesis testing by combining model-aware reinforcement learning (RL) with Bayesian estimation based on particle filtering. To achieve this, we had to address the challenge of incorporating the many non-differentiable steps of the estimation in the training process, such as measurements and the resampling of the particle filter. Model-aware RL is a gradient-based method, where the derivatives of the sensor's precision are obtained through automatic differentiation (AD) in the simulation of the experiment. Our approach is suitable for optimizing both non-adaptive and adaptive strategies, using neural networks or other agents. We provide an implementation of this technique in the form of a Python library called qsensoropt, alongside several pre-made applications for relevant physical platforms, namely NV centers, photonic circuits, and optical cavities. This library will be released soon on PyPI. Leveraging our method, we've achieved results for many examples that surpass the current state-of-the-art in experimental design. In addition to Bayesian estimation, leveraging model-aware RL, it is also possible to find optimal controls for the minimization of the Cramér-Rao bound, based on Fisher information.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑