arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.09287cs.AI
收藏

虚拟环境中基于目标条件强化学习的指令跟随

Instruction Following with Goal-Conditioned Reinforcement Learning in Virtual Environments

AIRI(人工智能研究所);MIPT(莫斯科物理技术学院);FRC CSC RAS(俄罗斯科学院联邦研究中心计算机科学与控制)

Zoya Volovikova, Alexey Skrynnik, Petr Kuderov, Aleksandr I. Panov

AI总结:

本研究针对虚拟环境中智能体执行复杂语言指令的难题,提出结合大语言模型语言理解与强化学习动作执行的分层框架,在IGLU和Crafter两类环境中验证了方法的有效性。

摘要:

本研究致力于解决让人工智能智能体在虚拟环境中执行复杂语言指令的问题。在我们的框架设定中,这些指令包含复杂的语言结构以及多项相互依存的任务,智能体必须成功完成这些任务才能达成预期结果。为有效应对这些复杂性,我们提出了一个分层框架,将大语言模型的深度语言理解能力与强化学习智能体的自适应动作执行能力相结合。基于大语言模型(LLM)的语言模块将语言指令转化为高层动作规划,随后由预训练的强化学习智能体执行该规划。我们在两种不同环境中验证了方法的有效性:在IGLU环境中,智能体需根据指令搭建结构;在Crafter环境中,智能体需按照语言命令执行任务并与周围环境中的物体交互。

英文摘要:

In this study, we address the issue of enabling an artificial intelligence agent to execute complex language instructions within virtual environments. In our framework, we assume that these instructions involve intricate linguistic structures and multiple interdependent tasks that must be navigated successfully to achieve the desired outcomes. To effectively manage these complexities, we propose a hierarchical framework that combines the deep language comprehension of large language models with the adaptive action-execution capabilities of reinforcement learning agents. The language module (based on LLM) translates the language instruction into a high-level action plan, which is then executed by a pre-trained reinforcement learning agent. We have demonstrated the effectiveness of our approach in two different environments: in IGLU, where agents are instructed to build structures, and in Crafter, where agents perform tasks and interact with objects in the surrounding environment according to language commands.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑