arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2410.02995cs.ROcs.AI

基于检索加权局部适应的任务无关终身机器人学习

Task-agnostic Lifelong Robot Learning with Retrieval-based Weighted Local Adaptation

College of Design and Engineering National University of Singapore(设计与工程学院新加坡国立大学);Jacobs School of Engineering University of California San Diego(工程学院加州大学圣地亚哥分校);Massachusetts General Hospital Harvard University(麻省总医院哈佛大学);Faculty of Electrical Engineering, Mathematics and Computer Science Delft University of Technology(电子工程、数学和计算机科学学院代尔夫特技术大学);Faculty of Mechanical Engineering Delft University of Technology(机械工程学院代尔夫特技术大学)

Pengzhi Yang, Xinyu Wang, Ruipeng Zhang, Cong Wang, Frans A. Oliehoek, Jens Kober

AI总结:

本文提出一种基于检索加权局部适应的任务无关终身机器人学习框架,通过经验回放与局部适应技术缓解灾难性遗忘,在无任务ID和边界信息下有效恢复知识,提升开放场景表现。

摘要:

智能机器人领域的一个基本目标是迈向终身学习机器人,使其能够随时间学习并适应未见场景。然而,持续学习新任务会因数据分布偏移引发灾难性遗忘问题。为缓解此问题,我们存储先前任务的部分数据,并以两种方式利用它:利用经验回放来保留已学技能,并应用一种新颖的基于检索的局部适应技术来恢复相关知识。由于终身学习机器人必须在无任务场景中运行,其中任务ID甚至任务边界均不可用,我们的方法在不依赖此类信息的情况下依然有效。我们还引入了一种选择性加权机制,以聚焦于最“被遗忘”的技能片段,确保有效的知识恢复。在多种操作任务上的实验结果表明,我们的框架为终身学习提供了可扩展的范式,提升了机器人在开放式、无任务场景中的性能。

英文摘要:

A fundamental objective in intelligent robotics is to move towards lifelong learning robot that can learn and adapt to unseen scenarios over time. However, continually learning new tasks would introduce catastrophic forgetting problems due to data distribution shifts. To mitigate this, we store a subset of data from previous tasks and utilize it in two manners: leveraging experience replay to retain learned skills and applying a novel Retrieval-based Local Adaptation technique to restore relevant knowledge. Since a lifelong learning robot must operate in task-free scenarios, where task IDs and even boundaries are not available, our method performs effectively without relying on such information. We also incorporate a selective weighting mechanism to focus on the most "forgotten" skill segment, ensuring effective knowledge restoration. Experimental results across diverse manipulation tasks demonstrate that our framework provides a scalable paradigm for lifelong learning, enhancing robot performance in open-ended, task-free scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑