arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2410.20536cs.HCcs.AIcs.CY
收藏

人工智能时代的马林诺夫斯基:大型语言模型能否基于一部人类学经典创作文本游戏?

Malinowski in the Age of AI: Can large language models create a text game based on an anthropological classic?

Freie Universität Berlin(柏林自由大学);Institut für Angewandte Informatik(应用信息学研究所);Fraunhofer FOKUS(弗劳恩霍夫开放通信系统研究所)

Michael Peter Hoffmann, Jan Fillies, Adrian Paschke

AI总结:

本文通过与人类学家协作并采用设计思维迭代,利用GPT3.5基于《西太平洋的航海者》制作三个文本游戏原型,评估LLM传播人类学知识的潜力与局限。

摘要:

近期,ChatGPT和GPT-4等大型语言模型(LLM)的进步,已在文本摘要和辅助编程等广泛任务中展现出卓越能力。科学研究表明,这些模型还能够游玩文字冒险游戏。本研究旨在探究LLM能否自主基于人类学经典创作基于文本的游戏,同时评估其在知识传播方面的有效性。为实现这一目标,研究邀请人类学家参与讨论,收集他们对人类学主题游戏的期望与设计输入。通过遵循既定的“设计思维”这一人机交互(HCI)原则开展迭代过程,研究完善了用于制作这些游戏的提示词和概念框架。研究利用GPT3.5,围绕社会人类学家布罗尼斯拉夫·马林诺夫斯基的开创性人类学著作《西太平洋的航海者》(1922年)创作了三个游戏原型。随后,研究邀请资深人类学家对这些游戏进行试玩评估,并根据他们的意见完善游戏设计。测试揭示了可喜的成果,但也凸显了关键挑战:模型在提供深入的主题理解方面存在困难,易受错误信息影响,在长时间游玩后倾向于给出单调回应,并且难以提供详细的传记信息。尽管存在这些局限,本研究的发现仍在人工智能、机器学习、LLM、民族志、人类学和人机交互的交叉领域开辟了新的研究路径。

英文摘要:

Recent advancements in Large Language Models (LLMs) like ChatGPT and GPT-4 have shown remarkable abilities in a wide range of tasks such as summarizing texts and assisting in coding. Scientific research has demonstrated that these models can also play text-adventure games. This study aims to explore whether LLMs can autonomously create text-based games based on anthropological classics, evaluating also their effectiveness in communicating knowledge. To achieve this, the study engaged anthropologists in discussions to gather their expectations and design inputs for an anthropologically themed game. Through iterative processes following the established HCI principle of 'design thinking', the prompts and the conceptual framework for crafting these games were refined. Leveraging GPT3.5, the study created three prototypes of games centered around the seminal anthropological work of the social anthropologist's Bronislaw Malinowski's "Argonauts of the Western Pacific" (1922). Subsequently, evaluations were conducted by inviting senior anthropologists to playtest these games, and based on their inputs, the game designs were refined. The tests revealed promising outcomes but also highlighted key challenges: the models encountered difficulties in providing in-depth thematic understandings, showed suspectibility to misinformation, tended towards monotonic responses after an extended period of play, and struggled to offer detailed biographical information. Despite these limitations, the study's findings open up new research avenues at the crossroads of artificial intelligence, machine learning, LLMs, ethnography, anthropology and human-computer interaction.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑