arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.11279cs.ROcs.CLcs.IR
收藏

P-RAG: 面向具身日常任务规划的渐进式检索增强生成

P-RAG: Progressive Retrieval Augmented Generation For Planning on Embodied Everyday Task

University of Science and Technology of China(中国科学技术大学);Institute of Artificial Intelligence, Hefei Comprehensive National Science Center(合肥综合性国家科学中心人工智能研究院)

Weiye Xu, Min Wang, Wengang Zhou, Houqiang Li

AI总结:

针对具身日常任务中传统方法规划缺失、训练成本高及现有LLM方法依赖标注等问题,提出渐进式检索增强生成方法P-RAG,通过迭代更新数据库与细粒度检索积累任务知识,在无标注下取得有竞争力的结果且可自迭代提升。

摘要:

具身日常任务是具身AI领域的热门任务,要求智能体根据自然语言指令和视觉观测做出一系列动作决策。传统基于学习的方法面临两大挑战:一是自然语言指令往往缺乏明确的任务规划,二是需要大量训练才能让模型掌握任务环境的相关知识。此前基于大语言模型(LLM)的研究要么因缺乏任务特定知识表现不佳,要么依赖真实标注数据作为少样本示例。\n为解决上述局限,我们提出了名为Progressive Retrieval Augmented Generation(P-RAG,渐进式检索增强生成)的新方法,该方法既能有效利用LLM强大的语言处理能力,又能在无需真实标注的情况下渐进积累任务特定知识。与传统RAG方法一次性从数据库检索相关信息辅助生成不同,P-RAG采用迭代方式渐进更新数据库:在每一轮迭代中,P-RAG检索最新数据库,并从之前的交互中获取历史信息,作为当前交互的经验参考。此外,我们还引入了更细粒度的检索方案,不仅检索相似任务,还加入相似场景的检索,以提供更有价值的参考经验。\n大量实验表明,P-RAG在不使用真实标注的情况下取得了具有竞争力的结果,甚至能通过自我迭代进一步提升性能。

英文摘要:

Embodied Everyday Task is a popular task in the embodied AI community, requiring agents to make a sequence of actions based on natural language instructions and visual observations. Traditional learning-based approaches face two challenges. Firstly, natural language instructions often lack explicit task planning. Secondly, extensive training is required to equip models with knowledge of the task environment. Previous works based on Large Language Model (LLM) either suffer from poor performance due to the lack of task-specific knowledge or rely on ground truth as few-shot samples. To address the above limitations, we propose a novel approach called Progressive Retrieval Augmented Generation (P-RAG), which not only effectively leverages the powerful language processing capabilities of LLMs but also progressively accumulates task-specific knowledge without ground-truth. Compared to the conventional RAG methods, which retrieve relevant information from the database in a one-shot manner to assist generation, P-RAG introduces an iterative approach to progressively update the database. In each iteration, P-RAG retrieves the latest database and obtains historical information from the previous interaction as experiential references for the current interaction. Moreover, we also introduce a more granular retrieval scheme that not only retrieves similar tasks but also incorporates retrieval of similar situations to provide more valuable reference experiences. Extensive experiments reveal that P-RAG achieves competitive results without utilizing ground truth and can even further improve performance through self-iterations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑