在采样过程中利用先验领域知识的动力学主动学习
Active Learning of Dynamics Using Prior Domain Knowledge in the Sampling Process
AI总结:
提出一种利用先验领域知识引导采样的主动学习算法,通过探索高经验差异区域加速学习并降低模型不确定性,理论上证明了其收敛性,并在欠驱动摆和half-cheetah MuJoCo环境中验证了有效性。
摘要:
我们提出了一种用于学习动力学的主动学习算法,该算法通过将先验领域知识显式纳入采样过程来利用辅助信息。我们提出的算法引导探索趋向于在观测数据与源自辅助信息的不完美先验动力学模型之间表现出高经验差异的区域。通过数值实验,我们证明该策略探索了高差异区域,并在加速学习的同时降低了模型不确定性。我们通过为最大预测方差提供显式的收敛速率,严格证明了我们的主动学习算法能够产生对底层动力学的一致估计。我们在一个欠驱动摆系统和 half-cheetah MuJoCo 环境上展示了我们方法的有效性。
英文摘要:
We present an active learning algorithm for learning dynamics that leverages side information by explicitly incorporating prior domain knowledge into the sampling process. Our proposed algorithm guides the exploration toward regions that demonstrate high empirical discrepancy between the observed data and an imperfect prior model of the dynamics derived from side information. Through numerical experiments, we demonstrate that this strategy explores regions of high discrepancy and accelerates learning while simultaneously reducing model uncertainty. We rigorously prove that our active learning algorithm yields a consistent estimate of the underlying dynamics by providing an explicit rate of convergence for the maximum predictive variance. We demonstrate the efficacy of our approach on an under-actuated pendulum system and on the half-cheetah MuJoCo environment.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。