arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2103.07929cs.CL
收藏

自然语言处理中再现性研究的系统综述

A Systematic Review of Reproducibility Research in Natural Language Processing

University of Brighton(布莱顿大学);Heriot Watt University(赫瑞瓦特大学);Université de Lorraine(洛林大学);University of Aberdeen(阿伯丁大学)

Anya Belz, Shubham Agarwal, Anastasia Shimorina, Ehud Reiter

摘要:

在科学中所谓的再现性危机的背景下,NLP领域对其结果的再现性越来越感兴趣,并且越来越认真。在过去几年中,该领域出现了一系列令人印象深刻的新举措、活动和积极的研究。然而,该领域远未就如何定义、测量和解决可再现性达成共识,目前观点的多样性正在增加而不是趋同。有了这个集中的贡献,我们的目标是提供一个广角,尽可能完整的,快照当前工作的再现性在NLP,描绘的差异和相似之处,并提供指针,以共同的解释。

英文摘要:

Against the background of what has been termed a reproducibility crisis in science, the NLP field is becoming increasingly interested in, and conscientious about, the reproducibility of its results. The past few years have seen an impressive range of new initiatives, events and active research in the area. However, the field is far from reaching a consensus about how reproducibility should be defined, measured and addressed, with diversity of views currently increasing rather than converging. With this focused contribution, we aim to provide a wide-angle, and as near as possible complete, snapshot of current work on reproducibility in NLP, delineating differences and similarities, and providing pointers to common denominators.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑