arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2404.09228cs.RO
收藏

大语言模型与智能机器人融合研究综述

A Survey on Integration of Large Language Models with Intelligent Robots

Korea Advanced Institute of Science and Technology(韩国科学技术院)

Yeseung Kim, Dohyun Kim, Jieun Choi, Jisang Park, Nayoung Oh, Daehyung Park

AI总结:

该综述梳理GPT-3.5后大语言模型在机器人通信、感知、规划、控制领域的应用,提供提示工程指南与实践示例,为LLM与智能机器人的融合研究提供路线图与实操参考。

摘要:

近年来,大语言模型(LLMs)的融合革新了机器人领域,使机器人具备类人水平的交流、理解与推理能力。本文探讨LLMs对机器人学的多方面影响,梳理在各领域应用这些模型的关键挑战与机遇。本文通过对机器人核心要素——通信、感知、规划与控制——中的LLM应用进行分类分析,旨在为希望将LLMs集成到自身机器人系统的研究者提供可落地的参考。本文的研究聚焦于GPT-3.5之后开发的LLMs,主要覆盖文本模态,同时也考虑了用于感知与控制的多模态方法。文中为提示工程提供了全面的指南与示例,帮助初学者快速上手基于LLM的机器人解决方案。通过教程级示例与结构化提示构建,本文阐释了LLM引导的功能增强如何无缝集成到机器人应用中。本综述可为研究者在LLM驱动的机器人学这一不断演进的领域中指明方向,为在机器人开发中利用语言模型的能力提供全面概述与实践指导。

英文摘要:

In recent years, the integration of large language models (LLMs) has revolutionized the field of robotics, enabling robots to communicate, understand, and reason with human-like proficiency. This paper explores the multifaceted impact of LLMs on robotics, addressing key challenges and opportunities for leveraging these models across various domains. By categorizing and analyzing LLM applications within core robotics elements -- communication, perception, planning, and control -- we aim to provide actionable insights for researchers seeking to integrate LLMs into their robotic systems. Our investigation focuses on LLMs developed post-GPT-3.5, primarily in text-based modalities while also considering multimodal approaches for perception and control. We offer comprehensive guidelines and examples for prompt engineering, facilitating beginners' access to LLM-based robotics solutions. Through tutorial-level examples and structured prompt construction, we illustrate how LLM-guided enhancements can be seamlessly integrated into robotics applications. This survey serves as a roadmap for researchers navigating the evolving landscape of LLM-driven robotics, offering a comprehensive overview and practical guidance for harnessing the power of language models in robotics development.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑