Understanding the fundamental concepts and trends in a scientific field is crucial for keeping abreast of its continuous advancement. In this study, we propose a systematic framework for analyzing the evolution of research topics in a scientific field using causal discovery and inference techniques. We define three variables to encompass diverse facets of the evolution of research topics within NLP and utilize a causal discovery algorithm to unveil the causal connections among these variables using observational data. Subsequently, we leverage this structure to measure the intensity of these relationships. By conducting extensive experiments on the ACL Anthology corpus, we demonstrate that our framework effectively uncovers evolutionary trends and the underlying causes for a wide range of NLP research topics. Specifically, we show that tasks and methods are primary drivers of research in NLP, with datasets following, while metrics have minimal impact.
NLP-CIC @ DIACR-Ita: POS and Neighbor Based Distributional Models for Lexical Semantic Change in Diachronic Italian Corpora
Instituto Politécnico Nacional(国家理工学院);Instituto Caro y Cuervo(卡罗-奎尔沃研究所)
我们在EVALITA 2020的DIACR-Ita共享任务中展示了我们关于意大利语无监督词汇语义变化的系统和发现。该任务是确定目标词是否随着时间的推移而演变其含义,仅依赖于来自两个特定时间数据集的原始文本。我们提出了两个模型,代表目标词的各个时期预测变化的话,使用阈值和投票计划。我们的第一个模型仅仅依赖于词性的使用和距离测量的集合。第二个模型使用词嵌入表示法提取相邻词在空间上的相对距离,并提出“绝对差平均值”来估计词汇语义变化。我们的模型取得了令人满意的结果,在DIACR-Ita竞赛中排名第三。此外,我们使用第二个模型的k_neighbor参数进行实验,以比较使用“绝对差的平均值”与Hamilton et al.(2016)中使用的余弦距离的影响。
Detecting Historical Turning Points in Italian Media: A Complex Systems Approach to a Diachronic News Corpus
Department of Physics and Chemistry, University of Palermo(帕尔米洛大学物理与化学系);Institute for Cross-Disciplinary Physics and Complex Systems (IFISC), UIB-CSIC(跨学科物理与复杂系统研究所(IFISC), UIB-CSIC)
Change Summarization of Diachronic Scholarly Paper Collections by Semantic Evolution Analysis
IIT Kharagpur(印度理工学院卡拉格普尔分校);SOC, Universiti Utara Malaysia(马来西亚北方大学计算机学院);IIR4.0, Universiti Kebangsaan Malaysia(马来西亚国立大学工业革命4.0研究所);University of Innsbruck(因斯布鲁克大学)
A survey of diversity quantification in natural language processing: The why, what, where and how
France Université Paris-Saclay, CNRS, LISN(法国巴黎萨克雷大学,CNRS,LISN);Belgium FNRS - UCLouvain(比利时FNRS - 奥斯迪大学);Israel The Open University of Israel(以色列开放大学);Germany Heidelberg University(德国海德堡大学)
The What, Why, and How of Context Length Extension Techniques in Large Language Models -- A Detailed Survey
Technology Innovation Institute(技术创新研究所);Islamic University of Technology(伊斯兰理工大学);Stanford University(斯坦福大学);Amazon GenAI(亚马逊生成式人工智能部门);AI Institute, University of South Carolina(南卡罗来纳大学人工智能研究所)
Your Model Is Not Predicting Depression Well And That Is Why: A Case Study of PRIMATE Dataset
Normandie Univ, UNICAEN, ENSICAEN, CNRS, GREYC(诺曼底大学、卡昂大学、卡昂高等工程师学院、法国国家科学研究中心、格雷西研究所);Institute of Computer Science, University of Tartu(塔尔图大学计算机科学研究所)
taz2024full: Analysing German Newspapers for Gender Bias and Discrimination across Decades
Faculty for Computer Science and Mathematics, Hochschule München University of Applied Sciences(计算机科学与数学系,慕尼黑应用科学大学);Department of Statistics, LMU Munich(统计学系,慕尼黑大学);Munich Center for Machine Learning (MCML), LMU Munich(慕尼黑机器学习中心(MCML),慕尼黑大学)
Speciesism in Natural Language Processing Research
Graduate School of Information Science and Technology, Hokkaido University(北海道大学信息科学与技术研究生院);Faculty of Information Science and Technology, Hokkaido University(北海道大学信息科学与技术学院)