arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2212.03570cs.RO
收藏

结合规划、推理和强化学习求解工业机器人任务

Combining Planning, Reasoning and Reinforcement Learning to solve Industrial Robot Tasks

Lund University(隆德大学);University of Patras(帕特雷大学);Stanford University(斯坦福大学)

Matthias Mayr, Faseeh Ahmad, Konstantinos Chatzilygeroudis, Luigi Nardi, Volker Krueger

摘要:

当今工业机器人系统的目标之一是允许快速且容易地供应新任务。基于技能的系统,使用规划和知识表示一直是一个可能的答案。然而,特别是接触丰富的机器人任务,需要仔细的参数设置,这种推理技术可能会功亏一篑,如果所需的知识没有充分建模。我们展示了一种方法,它提供了一个任务级的规划与推理与有针对性的学习技能参数的任务在手的组合。从PDDL中制定的任务目标开始,识别计划中的可学习参数,并且操作员可以选择用于学习过程的奖励函数和参数。与知识框架的紧密集成允许形成用于学习的先验,并且多目标贝叶斯优化的使用便于平衡诸如安全和任务性能等方面,这些方面通常会相互影响。我们证明了我们的方法的有效性和多功能性,通过学习技能参数为两个不同的接触丰富的任务,并显示他们的成功执行一个真正的7自由度KUKA-iiwa。

英文摘要:

One of today's goals for industrial robot systems is to allow fast and easy provisioning for new tasks. Skill-based systems that use planning and knowledge representation have long been one possible answer to this. However, especially with contact-rich robot tasks that need careful parameter settings, such reasoning techniques can fall short if the required knowledge not adequately modeled. We show an approach that provides a combination of task-level planning and reasoning with targeted learning of skill parameters for a task at hand. Starting from a task goal formulated in PDDL, the learnable parameters in the plan are identified and an operator can choose reward functions and parameters for the learning process. A tight integration with a knowledge framework allows to form a prior for learning and the usage of multi-objective Bayesian optimization eases to balance aspects such as safety and task performance that can often affect each other. We demonstrate the efficacy and versatility of our approach by learning skill parameters for two different contact-rich tasks and show their successful execution on a real 7-DOF KUKA-iiwa.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑