arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2501.15068cs.RO
收藏

一种面向数据高效具身操作的原子技能库构建方法

An Atomic Skill Library Construction Method for Data-Efficient Embodied Manipulation

JD Explore Academy(京东探索学院);Jingdong Technology Information Technology Co., Ltd(京东科技信息技术有限公司);University of Science and Technology of China(中国科学技术大学);Shenzhen University(深圳大学);Haier Group(海尔集团);Tsinghua University(清华大学);D-robotics(D机器人公司);RealMan Intelligent Technology (Jiangsu/Beijing) Co., Ltd(睿尔曼智能科技(江苏/北京)有限公司)

Dongjiang Li, Bo Peng, Chang Li, Ning Qiao, Qi Zheng, Lei Sun, Yusen Qin, Bangguo Li, Yifeng Luan, Bo Wu, Yibing Zhan, Mingang Sun, Tong Xu, Lusong Li, Hui Shen, Xiaodong He

AI总结:

本文提出一种三轮数据驱动的原子技能库构建方法,通过VLP划分子任务、抽象技能定义并利用VLA微调动态扩展技能库,从而以更低数据成本实现高效具身操作与新任务适应。

摘要:

具身操作是具身人工智能领域的一项基础能力。尽管当前的具身操作模型在特定场景下表现出一定的泛化能力,但由于真实世界场景的复杂性和多样性,它们在新环境和新任务中仍然面临困难。传统的端到端数据采集与训练方式导致了对数据的大量需求。将端到端任务分解为原子技能有助于降低数据需求并提高任务成功率。然而,现有方法受限于无法动态更新的预定义技能集。为了解决这一问题,我们提出了一种三轮数据驱动的方法来构建原子技能库。我们利用视觉-语言-规划(Vision-Language-Planning, VLP)将任务划分为子任务。然后,通过对子任务进行抽象,形成原子技能定义。最后,通过数据采集和视觉-语言-动作(Vision-Language-Action, VLA)微调构建原子技能库。随着原子技能库在三轮更新策略下动态扩展,其能够覆盖的任务范围自然增长。通过这种方式,我们的方法将关注点从端到端任务转移到原子技能上,在保持高性能的同时显著降低数据成本,并能够高效适应新任务。在真实世界环境中的大量实验证明了我们方法的有效性和高效性。

英文摘要:

Embodied manipulation is a fundamental ability in the realm of embodied artificial intelligence. Although current embodied manipulation models show certain generalizations in specific settings, they struggle in new environments and tasks due to the complexity and diversity of real-world scenarios. The traditional end-to-end data collection and training manner leads to significant data demands. Decomposing end-to-end tasks into atomic skills helps reduce data requirements and improves the task success rate. However, existing methods are limited by predefined skill sets that cannot be dynamically updated. To address the issue, we introduce a three-wheeled data-driven method to build an atomic skill library. We divide tasks into subtasks using the Vision-Language-Planning (VLP). Then, atomic skill definitions are formed by abstracting the subtasks. Finally, an atomic skill library is constructed via data collection and Vision-Language-Action (VLA) fine-tuning. As the atomic skill library expands dynamically with the three-wheel update strategy, the range of tasks it can cover grows naturally. In this way, our method shifts focus from end-to-end tasks to atomic skills, significantly reducing data costs while maintaining high performance and enabling efficient adaptation to new tasks. Extensive experiments in real-world settings demonstrate the effectiveness and efficiency of our approach.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑