人类与大语言模型在猜词游戏策略中的战略洞察
Strategic Insights in Human and Large Language Model Tactics at Word Guessing Games
AI总结:
该研究调研了猜词游戏高频玩家的策略与参与动机,同时测试了多款大语言模型在两种语言下游玩该游戏的能力,发现部分模型存在长度不符、内容重复及单词幻觉等问题。
摘要:
2022年初,一款简单的猜词游戏风靡全球,且在原版英文版本之外被进一步适配为多种语言。本文研究了两年多时间里日常猜词游戏玩家逐步形成的策略。我们针对25%的高频玩家开展了调研,揭示了他们的策略以及坚持每日参与游戏的动机。此外,我们还探究了多款主流的可公开访问大语言模型系统及开源模型在两种不同语言下理解并游玩该游戏的能力。结果显示,部分模型难以维持正确的猜测长度、会生成重复内容,还会出现凭空捏造不存在的单词及词形变化的幻觉问题。
英文摘要:
At the beginning of 2022, a simplistic word-guessing game took the world by storm and was further adapted to many languages beyond the original English version. In this paper, we examine the strategies of daily word-guessing game players that have evolved during a period of over two years. A survey gathered from 25% of frequent players reveals their strategies and motivations for continuing the daily journey. We also explore the capability of several popular open-access large language model systems and open-source models at comprehending and playing the game in two different languages. Results highlight the struggles of certain models to maintain correct guess length and generate repetitions, as well as hallucinations of non-existent words and inflections.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。