arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2503.04931cs.ROcs.AI

好奇心驱动的想象:发现规划算子并学习相关策略以实现开放世界适应

Curiosity-Driven Imagination: Discovering Plan Operators and Learning Associated Policies for Open-World Adaptation

Tufts University(塔夫茨大学);AIT Austrian Institute of Technology GmbH(奥地利技术研究院有限公司)

Pierrick Lorang, Hong Lu, Matthias Scheutz

AI总结:

本文提出一种结合低层神经网络内在好奇心模块与高层符号规划算子的混合系统,通过想象空间规划与奖励机生成,实现开放世界中的快速适应,并在机器人操作任务中验证其收敛速度与性能优于现有混合方法。

摘要:

快速适应动态、不确定的环境——通常被称为“开放世界”——仍然是机器人领域的重大挑战。传统的任务与运动规划(TAMP)方法难以应对不可预见的变化,在适应时数据效率低下,并且在学习过程中没有利用世界模型。我们通过一个混合规划与学习系统来解决这一问题,该系统集成了两个模型:一个基于低层神经网络的模型,用于学习随机转移并通过内在好奇心模块(ICM)驱动探索;以及一个高层符号规划模型,利用算子捕捉抽象转移,使智能体能够在“想象”空间中规划并生成奖励机。我们在一个具有顺序新颖性注入的机器人操作领域中的评估表明,我们的方法收敛更快,并且优于最先进的混合方法。

英文摘要:

Adapting quickly to dynamic, uncertain environments-often called "open worlds"-remains a major challenge in robotics. Traditional Task and Motion Planning (TAMP) approaches struggle to cope with unforeseen changes, are data-inefficient when adapting, and do not leverage world models during learning. We address this issue with a hybrid planning and learning system that integrates two models: a low level neural network based model that learns stochastic transitions and drives exploration via an Intrinsic Curiosity Module (ICM), and a high level symbolic planning model that captures abstract transitions using operators, enabling the agent to plan in an "imaginary" space and generate reward machines. Our evaluation in a robotic manipulation domain with sequential novelty injections demonstrates that our approach converges faster and outperforms state-of-the-art hybrid methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑