NewsEdits:新闻文章修订历史数据集(技术报告:数据处理)
NewsEdits: A Dataset of Revision Histories for News Articles (Technical Report: Data Processing)
摘要:
新闻文章的修订历史有可能给我们提供跨语言学和社会科学各个领域的新见解。在这项工作中,我们提出,据我们所知,第一个公开的数据集的新闻文章修订历史,或NewsEdits。我们的数据集是多语言的;它载有来自三个国家的22家英文和法文报纸的1 278 804篇文章,4 609 430个版本。在版本对中,我们统计了1090万个添加的句子; 890万个更改的句子和680万个删除的句子。在修改后的句子中,我们得到了7200万个原子编辑。据我们所知,NewsEdits是任何领域最大的修订历史语料库。
英文摘要:
News article revision histories have the potential to give us novel insights across varied fields of linguistics and social sciences. In this work, we present, to our knowledge, the first publicly available dataset of news article revision histories, or NewsEdits. Our dataset is multilingual; it contains 1,278,804 articles with 4,609,430 versions from over 22 English- and French-language newspaper sources based in three countries. Across version pairs, we count 10.9 million added sentences; 8.9 million changed sentences and 6.8 million removed sentences. Within the changed sentences, we derive 72 million atomic edits. NewsEdits is, to our knowledge, the largest corpus of revision histories of any domain.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。