arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.15834cs.ROcs.AI
收藏

ARO:大型语言模型监督的机器人学 Text2Skill 自主学习

ARO: Large Language Model Supervised Robotics Text2Skill Autonomous Learning

National University of Singapore(新加坡国立大学);Microsoft Research(微软研究院)

Yiwen Chen, Yuyao Ye, Ziyi Chen, Chuheng Zhang, Marcelo H. Ang

AI总结:

本文提出ARO框架,利用大规模语言模型替代人类参与机器人技能学习的奖励函数设计与性能评估,实现无需人工干预的完全自主技能学习,并分析了其在任务理解和优化稳定性上的局限。

摘要:

机器人学习高度依赖人类的专业知识和精力,例如强化学习中的演示、奖励函数设计以及使用人类反馈进行性能评估等。然而,对人类辅助的依赖会导致高昂的学习成本,并使技能学习难以规模化。在这项工作中,我们引入了大型语言模型监督的机器人学 Text2Skill 自主学习(ARO)框架,旨在通过结合奖励函数设计和性能评估的大规模语言模型来替代人类在机器人技能学习过程中的参与。我们提供证据表明,我们的方法能够实现完全自主的机器人技能学习,能够在没有人类干预的情况下完成部分任务。此外,我们还分析了该方法在任务理解和优化稳定性方面的局限性。

英文摘要:

Robotics learning highly relies on human expertise and efforts, such as demonstrations, design of reward functions in reinforcement learning, performance evaluation using human feedback, etc. However, reliance on human assistance can lead to expensive learning costs and make skill learning difficult to scale. In this work, we introduce the Large Language Model Supervised Robotics Text2Skill Autonomous Learning (ARO) framework, which aims to replace human participation in the robot skill learning process with large-scale language models that incorporate reward function design and performance evaluation. We provide evidence that our approach enables fully autonomous robot skill learning, capable of completing partial tasks without human intervention. Furthermore, we also analyze the limitations of this approach in task understanding and optimization stability.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑