大型语言模型能玩好文字游戏吗?当前最先进水平与开放问题
Can Large Language Models Play Text Games Well? Current State-of-the-Art and Open Questions
AI总结:
本文率先调查了ChatGPT等大型语言模型玩文字游戏的能力,实验发现其虽优于现有系统,但仍因无法构建世界模型、利用已有知识和推断步骤目标而表现出较低智能水平,由此引出了AI、机器学习与NLP交叉领域的开放性研究问题。
摘要:
ChatGPT和GPT-4等大型语言模型(LLMs)近期展现了与人类用户交流的卓越能力。在本技术报告中,我们率先调查了它们玩文字游戏的能力,在游戏中玩家必须通过与环境对话来理解环境并应对各种情况。实验表明,与所有现有系统相比,ChatGPT表现极具竞争力,但仍展现出较低的智能水平。具体而言,ChatGPT无法通过玩游戏或阅读游戏手册来构建世界模型;它可能无法利用其已掌握的世界知识;随着游戏推进,它无法推断每个步骤的目标。我们的结果开启了人工智能、机器学习和自然语言处理交叉领域的新研究问题。
英文摘要:
Large language models (LLMs) such as ChatGPT and GPT-4 have recently demonstrated their remarkable abilities of communicating with human users. In this technical report, we take an initiative to investigate their capacities of playing text games, in which a player has to understand the environment and respond to situations by having dialogues with the game world. Our experiments show that ChatGPT performs competitively compared to all the existing systems but still exhibits a low level of intelligence. Precisely, ChatGPT can not construct the world model by playing the game or even reading the game manual; it may fail to leverage the world knowledge that it already has; it cannot infer the goal of each step as the game progresses. Our results open up new research questions at the intersection of artificial intelligence, machine learning, and natural language processing.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。