通过MCMC方法改进从示范中学习的算法
Towards Improving Learning from Demonstration Algorithms via MCMC Methods
AI总结:
本文利用隐式基于能量的策略模型改进从示范中学习算法,实验表明在复杂机器人策略学习场景中,隐式模型平均优于常用显式神经网络模型,尤其适用于不连续和多模态函数逼近。
摘要:
行为克隆,或更广泛地说,从示范中学习(LfD),是在复杂场景下机器人策略学习的一个有前景的方向。尽管行为克隆易于实现且数据高效,但它自身存在缺点,限制了其在真实机器人设置中的有效性。在这项工作中,我们通过利用隐式基于能量的策略模型,向改进从示范中学习的算法迈出了一步。结果表明,在选定的复杂机器人策略学习场景中,使用隐式模型进行监督式策略学习通常比常用的基于神经网络的显式模型表现更好,尤其是在逼近潜在不连续和多模态函数的情况下。
英文摘要:
Behavioral cloning, or more broadly, learning from demonstrations (LfD) is a priomising direction for robot policy learning in complex scenarios. Albeit being straightforward to implement and data-efficient, behavioral cloning has its own drawbacks, limiting its efficacy in real robot setups. In this work, we take one step towards improving learning from demonstration algorithms by leveraging implicit energy-based policy models. Results suggest that in selected complex robot policy learning scenarios, treating supervised policy learning with an implicit model generally performs better, on average, than commonly used neural network-based explicit models, especially in the cases of approximating potentially discontinuous and multimodal functions.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。