arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2401.03545cs.DLcs.AIcs.CL
收藏

NLP中真的存在引用年代偏见吗?

Is there really a Citation Age Bias in NLP?

NTT DATA Deutschland SE(NTT DATA德国公司);University of Mannheim(曼海姆大学)

Hoa Nguyen, Steffen Eger

AI总结:

本研究通过分析Arxiv上约30万篇论文发现,NLP等AI子领域的“引用遗忘”趋势是学科快速发展的自然产物,而非NLP社区特有的引用年代偏见。

摘要:

引用是科学研究的关键要素,用于将一篇论文与社区中发表的其他论文联系起来。最近,人们注意到在自然语言处理(NLP)这一目前增长最快的AI子领域之一中存在引用年代偏见,即过去几年中NLP论文参考文献的平均年代变得越来越新,导致了“引用遗忘”现象,即较旧的知识日益被遗忘。在本研究中,我们通过分析2013年至2022年期间提交到热门预印本服务器Arxiv的15个不同科学领域约30万篇论文的参考文献,对这些说法进行了客观审视。我们发现,所有AI子领域(特别是cs.AI、cs.CL、cs.CV、cs.LG)都有类似的引用遗忘趋势,其中参考文献的平均年代在过去10年中大约减半(平均从2013年的12年以上降至2022年的7年以下)。我们并不认为这是NLP社区中存在的引用年代偏见,而是相信这种模式是这些研究领域动态特征的产物,在这些领域中,新知识产生的时间间隔越来越短。

英文摘要:

Citations are a key ingredient of scientific research to relate a paper to others published in the community. Recently, it has been noted that there is a citation age bias in the Natural Language Processing (NLP) community, one of the currently fastest growing AI subfields, in that the mean age of the bibliography of NLP papers has become ever younger in the last few years, leading to `citation amnesia' in which older knowledge is increasingly forgotten. In this work, we put such claims into perspective by analyzing the bibliography of $\sim$300k papers across 15 different scientific fields submitted to the popular preprint server Arxiv in the time period from 2013 to 2022. We find that all AI subfields (in particular: cs.AI, cs.CL, cs.CV, cs.LG) have similar trends of citation amnesia, in which the age of the bibliography has roughly halved in the last 10 years (from above 12 in 2013 to below 7 in 2022), on average. Rather than diagnosing this as a citation age bias in the NLP community, we believe this pattern is an artefact of the dynamics of these research fields, in which new knowledge is produced in ever shorter time intervals.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑