arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.01929cs.CLcs.AI
收藏

当我们谈论语言模型时我们在谈论什么:隐性范式转移与语言模型之船

What We Talk About When We Talk About LMs: Implicit Paradigm Shifts and the Ship of Language Models

Cornell University(康奈尔大学)

Shengqi Zhu, Jeffrey M. Rzeszotarski

AI总结:

针对“语言模型(LMs)”术语指代随时间隐性更新的“语言模型之船”问题,本文基于NLP出版物构建数据基础设施并开展文本分析,揭示科学话语中系统与理论的相互影响,为科学进步研究提供新视角。

摘要:

“语言模型(LMs)”这一术语作为特定时期内受关注模型的集合,正不断被重新定义——其指代对象的更新方式酷似“忒修斯之船”:不断替换部件却在本质上仍为同一艘船。本文研究“语言模型之船”问题,即科学演进以对现有关键术语持续、隐性改造的形式展开。除了已被广泛研究的新术语涌现,我们还试图开启科学进步的新视角。为此,我们基于近期自然语言处理(NLP)出版物构建数据基础设施,随后开展一系列基于文本的分析,以实现对“语言模型”这一专业术语使用方式的详细、定量理解。我们的研究强调了科学话语中系统与理论如何相互影响,并呼吁关注这艘由我们共同推动改造的“船”。

英文摘要:

The term Language Models (LMs) as a time-specific collection of models of interest is constantly reinvented, with its referents updated much like the $\textit{Ship of Theseus}$ replaces its parts but remains the same ship in essence. In this paper, we investigate this $\textit{Ship of Language Models}$ problem, wherein scientific evolution takes the form of continuous, implicit retrofits of key existing terms. We seek to initiate a novel perspective of scientific progress, in addition to the more well-studied emergence of new terms. To this end, we construct the data infrastructure based on recent NLP publications. Then, we perform a series of text-based analyses toward a detailed, quantitative understanding of the use of Language Models as a term of art. Our work highlights how systems and theories influence each other in scientific discourse, and we call for attention to the transformation of this Ship that we all are contributing to.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑