arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2404.03587cs.ROcs.AI
收藏

Anticipate & Collab:面向人机协作的数据驱动任务预测与知识驱动规划

Anticipate & Collab: Data-driven Task Anticipation and Knowledge-driven Planning for Human-robot Collaboration

Robotics Research Center, IIIT Hyderabad(IIIT海得拉巴机器人研究中心);TCS Research, Tata Consultancy Services(塔塔咨询服务公司TCS研究院);School of Informatics, University of Edinburgh(爱丁堡大学信息学院)

Shivam Singh, Karthik Swaminathan, Raghav Arora, Ramandeep Singh, Ahana Datta, Dipanjan Das, Snehasis Banerjee, Mohan Sridharan, Madhava Krishna

AI总结:

本文提出 DaTAPlan 框架,结合 LLM 任务预测与经典知识驱动规划,使人与机器人能共同完成预测任务并自适应意外变化。

摘要:

协助人类进行日常生活活动的智能体可以通过预测即将到来的任务而更有效地协作。数据驱动方法代表了任务预测、规划及相关问题的当前最优水平,但这些方法耗费大量资源且不透明。我们此前的工作提出了一个概念验证框架,该框架使用 LLM 预测 3 个高层任务,并将其作为经典规划系统的目标,由该系统计算一系列低层动作,使智能体能够实现这些目标。本文介绍了 DaTAPlan,这是我们对先前工作面向人机协作进行显著扩展后的框架。具体而言,DaTAPlan 规划器为智能体和人类计算动作,以协作并共同实现由 LLM 预测的任务,同时智能体会自动适应人类动作结果和偏好中的意外变化。我们在真实感仿真环境中评估 DaTAPlan 的能力,证明了其准确的任务预测、有效的人机协作以及适应意外变化的能力。项目网站:https://dataplan-hrc.github.io

英文摘要:

An agent assisting humans in daily living activities can collaborate more effectively by anticipating upcoming tasks. Data-driven methods represent the state of the art in task anticipation, planning, and related problems, but these methods are resource-hungry and opaque. Our prior work introduced a proof of concept framework that used an LLM to anticipate 3 high-level tasks that served as goals for a classical planning system that computed a sequence of low-level actions for the agent to achieve these goals. This paper describes DaTAPlan, our framework that significantly extends our prior work toward human-robot collaboration. Specifically, DaTAPlan planner computes actions for an agent and a human to collaboratively and jointly achieve the tasks anticipated by the LLM, and the agent automatically adapts to unexpected changes in human action outcomes and preferences. We evaluate DaTAPlan capabilities in a realistic simulation environment, demonstrating accurate task anticipation, effective human-robot collaboration, and the ability to adapt to unexpected changes. Project website: https://dataplan-hrc.github.io

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑