FOCUS:面向机器人操作的对象中心世界模型
FOCUS: Object-Centric World Models for Robotics Manipulation
AI总结:
本文提出 FOCUS,一个学习对象中心世界模型的智能体,利用对象中心表示驱动的探索奖励提升机器人操作中的对象交互探索效率,并在仿真和 Franka Emika 机械臂上验证了其有效性。
摘要:
以对象及其可能的交互方式来理解世界是一项重要的认知能力,尤其是在机器人操作领域,许多任务都需要机器人与对象进行交互。然而,学习这种专门捕捉实体与关系的结构化世界模型,仍然是一个具有挑战性且尚未被充分探索的问题。为了解决这一问题,我们提出了 FOCUS,一个基于模型的智能体,它学习对象中心的世界模型。得益于一种源自对象中心表示的新型探索奖励,FOCUS 可以部署在机器人操作任务上,从而更容易地探索对象交互。我们在不同设置下的操作任务上评估了该方法,结果表明对象中心世界模型使智能体能够更高效地解决任务,并实现对机器人-对象交互的一致探索。我们还使用 Franka Emika 机械臂展示了 FOCUS 如何被应用于真实世界环境。
英文摘要:
Understanding the world in terms of objects and the possible interplays with them is an important cognition ability, especially in robotics manipulation, where many tasks require robot-object interactions. However, learning such a structured world model, which specifically captures entities and relationships, remains a challenging and underexplored problem. To address this, we propose FOCUS, a model-based agent that learns an object-centric world model. Thanks to a novel exploration bonus that stems from the object-centric representation, FOCUS can be deployed on robotics manipulation tasks to explore object interactions more easily. Evaluating our approach on manipulation tasks across different settings, we show that object-centric world models allow the agent to solve tasks more efficiently and enable consistent exploration of robot-object interactions. Using a Franka Emika robot arm, we also showcase how FOCUS could be adopted in real-world settings.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。