基于保真度的概率Q学习用于量子系统的控制
Fidelity-based Probabilistic Q-learning for Control of Quantum Systems
AI总结:
本文提出基于保真度的概率Q学习方法,用于解决强化学习中探索与利用的平衡问题,并应用于量子系统控制,通过迭代更新动作概率实现自然探索策略,提升学习效率。
摘要:
在强化学习中,探索与利用的平衡是一个关键问题,尤其是对于Q学习。本文提出一种基于保真度的概率Q学习(FPQL)方法,以自然解决此问题并应用于量子系统控制。该方法利用保真度指导学习过程,迭代更新每个状态的动作概率,从而实现自然探索策略而非依赖配置参数的尖锐策略。首先提出概率Q学习(PQL)算法以展示概率动作选择的基本思想,随后针对量子系统控制提出FPQL算法。通过两个例子(自旋-1/2系统和λ型原子系统)测试FPQL算法的性能。结果表明,FPQL算法在探索与利用之间取得更好的平衡,能够避免局部最优策略并加速学习过程。
英文摘要:
The balance between exploration and exploitation is a key problem for reinforcement learning methods, especially for Q-learning. In this paper, a fidelity-based probabilistic Q-learning (FPQL) approach is presented to naturally solve this problem and applied for learning control of quantum systems. In this approach, fidelity is adopted to help direct the learning process and the probability of each action to be selected at a certain state is updated iteratively along with the learning process, which leads to a natural exploration strategy instead of a pointed one with configured parameters. A probabilistic Q-learning (PQL) algorithm is first presented to demonstrate the basic idea of probabilistic action selection. Then the FPQL algorithm is presented for learning control of quantum systems. Two examples (a spin- 1/2 system and a lamda-type atomic system) are demonstrated to test the performance of the FPQL algorithm. The results show that FPQL algorithms attain a better balance between exploration and exploitation, and can also avoid local optimal policies and accelerate the learning process.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。