自然语言处理中再现性研究的系统综述
A Systematic Review of Reproducibility Research in Natural Language Processing
摘要:
在科学中所谓的再现性危机的背景下,NLP领域对其结果的再现性越来越感兴趣,并且越来越认真。在过去几年中,该领域出现了一系列令人印象深刻的新举措、活动和积极的研究。然而,该领域远未就如何定义、测量和解决可再现性达成共识,目前观点的多样性正在增加而不是趋同。有了这个集中的贡献,我们的目标是提供一个广角,尽可能完整的,快照当前工作的再现性在NLP,描绘的差异和相似之处,并提供指针,以共同的解释。
英文摘要:
Against the background of what has been termed a reproducibility crisis in science, the NLP field is becoming increasingly interested in, and conscientious about, the reproducibility of its results. The past few years have seen an impressive range of new initiatives, events and active research in the area. However, the field is far from reaching a consensus about how reproducibility should be defined, measured and addressed, with diversity of views currently increasing rather than converging. With this focused contribution, we aim to provide a wide-angle, and as near as possible complete, snapshot of current work on reproducibility in NLP, delineating differences and similarities, and providing pointers to common denominators.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。