首页/论文/2004.02592

arXiv 2004.025922020-04-06cs.CL

Learning to Summarize Passages: Mining Passage-Summary Pairs from Wikipedia Revision Histories

Harbin Institute of Technology（哈尔滨工业大学）；Microsoft Research（微软研究院）

Qingyu Zhou, Furu Wei, Ming Zhou

英文摘要：

In this paper, we propose a method for automatically constructing a passage-to-summary dataset by mining the Wikipedia page revision histories. In particular, the method mines the main body passages and the introduction sentences which are added to the pages simultaneously. The constructed dataset contains more than one hundred thousand passage-summary pairs. The quality analysis shows that it is promising that the dataset can be used as a training and validation set for passage summarization. We validate and analyze the performance of various summarization systems on the proposed dataset. The dataset will be available online at https://res.qyzhou.me.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

Blocks Architecture (BloArk)：面向维基百科修订历史的高效、高性价比增量式数据集架构

Blocks Architecture (BloArk): Efficient, Cost-Effective, and Incremental Dataset Architecture for Wikipedia Revision History

Manning College of Information and Computer Sciences, University of Massachusetts Amherst（马萨诸塞大学阿默斯特分校信息与计算机科学学院）；University of Massachusetts Medical School（马萨诸塞大学医学院）；Miner School of Computer and Information Sciences, University of Massachusetts Lowell（马萨诸塞大学洛厄尔分校计算机与信息科学学院）；Center for Healthcare Organization and Implementation Research, VA Bedford Health Care（VA贝德福德医疗保健中心医疗保健组织与实施研究中心）

针对维基百科修订历史处理工具不足、资源消耗高的问题，提出高效数据处理架构BloArk，通过三层基础设施与构建、修改流水线实现格式转换与增量处理，支持下游NLP任务且已开源。

2024-10-06cs.CL

TokTrack: A Complete Token Provenance and Change Tracking Dataset for the English Wikipedia

GESIS - Leibniz Institute for the Social Sciences（GESIS - 莱布尼茨社会科学研究所）；Karlsruhe Institute of Technology（卡尔斯鲁厄理工学院）

We present a dataset that contains every instance of all tokens (~ words) ever written in undeleted, non-redirect English Wikipedia articles until October 2016, in total 13,545,349,787 instances. Each token is annotated with (i) the article revision it was originally created in, and (ii) lists with all the revisions in which the token was ever deleted and (potentially) re-added and re-deleted from its article, enabling a complete and straightforward tracking of its history. This data would be exceedingly hard to create by an average potential user as it is (i) very expensive to compute and as …

2017-03-23cs.CL

NewsEdits: A Dataset of Revision Histories for News Articles (Technical Report: Data Processing)

Information Sciences Institute（信息科学研究所）；University of Southern California（南加州大学）

News article revision histories have the potential to give us novel insights across varied fields of linguistics and social sciences. In this work, we present, to our knowledge, the first publicly available dataset of news article revision histories, or NewsEdits. Our dataset is multilingual; it contains 1,278,804 articles with 4,609,430 versions from over 22 English- and French-language newspaper sources based in three countries. Across version pairs, we count 10.9 million added sentences; 8.9 million changed sentences and 6.8 million removed sentences. Within the changed sentences, we derive…

2022-06-30cs.CLcs.DL

WikiSQE：用于维基百科句子质量估计的大规模数据集

WikiSQE: A Large-Scale Dataset for Sentence Quality Estimation in Wikipedia

RIKEN AIP（日本理化学研究所革新智能综合研究中心）；Hitotsubashi University（一桥大学）

本文提出首个用于维基百科句子质量估计的大规模数据集WikiSQE，包含约340万句子和153个质量标签，实验表明竞争性机器学习模型在检测引用、语法/语义或命题问题时更具挑战性，且其性能优于众包工作者。

2023-12-29cs.CL

NewsEdits: A News Article Revision Dataset and a Document-Level Reasoning Challenge

Information Sciences Institute, University of Southern California（南加州大学信息科学研究所）；University of California, Los Angeles（加州大学洛杉矶分校）

News article revision histories provide clues to narrative and factual evolution in news articles. To facilitate analysis of this evolution, we present the first publicly available dataset of news revision histories, NewsEdits. Our dataset is large-scale and multilingual; it contains 1.2 million articles with 4.6 million versions from over 22 English- and French-language newspaper sources based in three countries, spanning 15 years of coverage (2006-2021). We define article-level edit actions: Addition, Deletion, Edit and Refactor, and develop a high-accuracy extraction algorithm to identify t…

2022-06-14cs.CL

SWiPE：一个面向维基百科页面文档级简化的数据集

SWiPE: A Dataset for Document-Level Simplification of Wikipedia Pages

Salesforce AI（赛富时人工智能研究院）

本文提出SWiPE数据集，利用完整修订历史重建英文维基百科到简单英文维基百科的文档级简化编辑过程，标注5,000个文档对和超过40,000处编辑，并通过自动标注模型及实验证明该数据集能提升简化模型生成复杂编辑的能力。

2023-05-30cs.CL

更多相关论文收起更多论文

Mining Naturally-occurring Corrections and Paraphrases from Wikipedia's Revision History

LIMSI-CNRS（法国国家科学研究中心计算机科学与数学应用实验室）

Naturally-occurring instances of linguistic phenomena are important both for training and for evaluating automatic processes on text. When available in large quantities, they also prove interesting material for linguistic studies. In this article, we present a new resource built from Wikipedia's revision history, called WiCoPaCo (Wikipedia Correction and Paraphrase Corpus), which contains numerous editings by human contributors, including various corrections and rewritings. We discuss the main motivations for building such a resource, describe how it was built and present initial applications …

2022-02-25cs.CL

Measuring Wikipedia Article Quality in One Dimension by Extending ORES with Ordinal Regression

University of Washington（华盛顿大学）

Organizing complex peer production projects and advancing scientific knowledge of open collaboration each depend on the ability to measure quality. Article quality ratings on English language Wikipedia have been widely used by both Wikipedia community members and academic researchers for purposes like tracking knowledge gaps and studying how political polarization shapes collaboration. Even so, measuring quality presents many methodological challenges. The most widely used systems use labels on discrete ordinal scales when assessing quality, but such labels can be inconvenient for statistics a…

2021-08-31cs.CLcs.CYcs.LG

Identifying Editor Roles in Argumentative Writing from Student Revision Histories

University of Pittsburgh（匹兹堡大学）

We present a method for identifying editor roles from students' revision behaviors during argumentative writing. We first develop a method for applying a topic modeling algorithm to identify a set of editor roles from a vocabulary capturing three aspects of student revision behaviors: operation, purpose, and position. We validate the identified roles by showing that modeling the editor roles that students take when revising a paper not only accounts for the variance in revision purposes in our data, but also relates to writing improvement.

2019-09-03cs.CL

WikiSTAR：一个揭示科学维基百科文章隐藏历史的系统

WikiSTAR: A System for Shedding Light on the Hidden History of Scientific Wikipedia Articles

The Hebrew University of Jerusalem（耶路撒冷希伯来大学）；Ben-Gurion University of the Negev（内盖夫本-古里安大学）；Allen Institute for AI (Ai2)（艾伦人工智能研究所）

WikiSTAR系统利用大语言模型分类器标记编辑类型，通过交互式视图追溯科学维基百科文章修订历史，揭示知识发展，经用户研究验证其能发现新模式、问题并实现新分析，还发布了系统、代码和基准。

2026-09-01cs.CL

SciDiagramEdit：从论文修订中学习编辑科学图表

SciDiagramEdit: Learning to Edit Scientific Diagrams from Paper Revisions

King Abdullah University of Science and Technology（阿卜杜拉国王科技大学）；Microsoft Research（微软研究院）；Nanyang Technological University（南洋理工大学）

研究针对科学论文图表编辑自动化的挑战，提出SciDiagramEdit框架，通过从arXiv版本历史挖掘数据，采用技能进化的智能体学习，能从自然论文修订中学习，提升编辑准确性。

2026-07-17cs.AIcs.CL

Wiki-Reliability: A Large Scale Dataset for Content Reliability on Wikipedia

Outreachy；Wikimedia Foundation（维基媒体基金会）

Wikipedia is the largest online encyclopedia, used by algorithms and web users as a central hub of reliable information on the web. The quality and reliability of Wikipedia content is maintained by a community of volunteer editors. Machine learning and information retrieval algorithms could help scale up editors' manual efforts around Wikipedia content reliability. However, there is a lack of large-scale data to support the development of such research. To fill this gap, in this paper, we propose Wiki-Reliability, the first dataset of English Wikipedia articles annotated with a wide set of con…

2021-06-01cs.CLcs.IRcs.LG