arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2305.12920cs.CL
收藏

NLP研究范式转变的历时分析:何时、如何及为何?

A Diachronic Analysis of Paradigm Shifts in NLP Research: When, How, and Why?

IBM Research Europe, Ireland(IBM欧洲研究院(爱尔兰));National Research Council Canada(加拿大国家研究委员会)

Aniket Pramanick, Yufang Hou, Saif M. Mohammad, Iryna Gurevych

AI总结:

本文提出基于因果发现和推断的系统框架,分析NLP研究主题演变,发现任务和方法是主要驱动力,数据集次之,指标影响极小。

摘要:

理解科学领域的基本概念和趋势对于跟上其持续发展至关重要。在本研究中,我们提出了一个系统框架,使用因果发现和推断技术来分析科学领域中研究主题的演变。我们定义了三个变量,以涵盖NLP中研究主题演变的各个方面,并利用因果发现算法,通过观测数据揭示这些变量之间的因果关系。随后,我们利用这一结构来衡量这些关系的强度。通过在ACL Anthology语料库上进行大量实验,我们证明我们的框架能够有效揭示各种NLP研究主题的演变趋势及其潜在原因。具体而言,我们表明任务和方法是NLP研究的主要驱动力,数据集次之,而评估指标的影响极小。

英文摘要:

Understanding the fundamental concepts and trends in a scientific field is crucial for keeping abreast of its continuous advancement. In this study, we propose a systematic framework for analyzing the evolution of research topics in a scientific field using causal discovery and inference techniques. We define three variables to encompass diverse facets of the evolution of research topics within NLP and utilize a causal discovery algorithm to unveil the causal connections among these variables using observational data. Subsequently, we leverage this structure to measure the intensity of these relationships. By conducting extensive experiments on the ACL Anthology corpus, we demonstrate that our framework effectively uncovers evolutionary trends and the underlying causes for a wide range of NLP research topics. Specifically, we show that tasks and methods are primary drivers of research in NLP, with datasets following, while metrics have minimal impact.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑