什么的大模型?将工程成就误认为人类语言能动性
Large Models of What? Mistaking Engineering Achievements for Human Linguistic Agency
AI总结:
本研究从认知科学生成式视角出发,指出关于大语言模型语言能力的误导性主张基于两个无据假设,揭示LLM缺失人类语言的三大核心特征,说明其无法成为人类式语言能动者。
摘要:
本文提出,关于大语言模型(Large Language Models,LLMs)语言能力的那些往往耸人听闻且具有误导性的核心主张,至少建立在两个无根据的假设之上:语言完备性假设与数据完备性假设。语言完备性假设认为,存在诸如“一种自然语言”这样明确且完备的事物,其本质特征可被LLM有效且全面地建模。数据完备性假设则基于这样的信念:一种语言可被量化并通过数据被完全捕获。\n认知科学的生成式研究进路的相关研究明确指出,语言并非一种明确且完备的事物,而是一种行动的手段或方式。语言活动(languaging)并非那种可以被完全或全面建模的事物。从生成式视角出发,我们识别出生成型语言的三个关键特征:具身性、参与性和不稳定性,这些特征在LLMs中均不存在,且原则上可能与当前架构不兼容。我们认为,这些缺失意味着LLMs现在不是、且以其当前形式也不可能成为人类那样的语言能动者。\n我们特别通过“算法语(algospeak)”现象来阐释这一观点,这是近期被描述的、出现在严格管控的在线环境中的高风险人类语言活动模式。基于这些观点,我们得出结论:关于LLM能动性与能力的耸人听闻且误导性的主张,源于对人类语言本质以及LLMs本质的深层误解。
英文摘要:
In this paper we argue that key, often sensational and misleading, claims regarding linguistic capabilities of Large Language Models (LLMs) are based on at least two unfounded assumptions; the assumption of language completeness and the assumption of data completeness. Language completeness assumes that a distinct and complete thing such as `a natural language' exists, the essential characteristics of which can be effectively and comprehensively modelled by an LLM. The assumption of data completeness relies on the belief that a language can be quantified and wholly captured by data. Work within the enactive approach to cognitive science makes clear that, rather than a distinct and complete thing, language is a means or way of acting. Languaging is not the kind of thing that can admit of a complete or comprehensive modelling. From an enactive perspective we identify three key characteristics of enacted language; embodiment, participation, and precariousness, that are absent in LLMs, and likely incompatible in principle with current architectures. We argue that these absences imply that LLMs are not now and cannot in their present form be linguistic agents the way humans are. We illustrate the point in particular through the phenomenon of `algospeak', a recently described pattern of high stakes human language activity in heavily controlled online environments. On the basis of these points, we conclude that sensational and misleading claims about LLM agency and capabilities emerge from a deep misconception of both what human language is and what LLMs are.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。