arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2210.15067cs.CL
收藏

arXivEdits:理解科学写作中的人类修改过程

arXivEdits: Understanding the Human Revision Process in Scientific Writing

Georgia Institute of Technology(佐治亚理工学院);Ohio State University(俄亥俄州立大学)

Chao Jiang, Wei Xu, Samuel Stevens

摘要:

科学出版物是交流研究发现的主要手段,其中写作质量至关重要。然而,以前的工作研究人类编辑过程在这一领域主要集中在摘要或介绍部分,导致一个不完整的图片。在这项工作中,我们提供了一个完整的计算框架,研究文本修订科技写作。我们首先介绍arXivEdits,这是一个新的注释语料库,包含来自arXiv的751篇完整论文,在其多个版本的修订中具有黄金句子对齐,以及细粒度的跨级编辑及其1,000个句子对的潜在意图。它支持我们的数据驱动分析,以揭示研究人员修改论文的常见策略。为了扩大分析,我们还开发了自动方法来提取文档,句子和单词级别的修订。在我们的语料库上训练的神经CRF句子对齐模型达到了93.8 F1,能够可靠地匹配不同版本之间的句子。我们制定的编辑提取任务作为一个跨度对齐问题,我们提出的方法提取更多的细粒度和可解释的编辑,相比常用的差异算法。在我们的数据集上训练的意图分类器在细粒度意图分类任务上达到78.9 F1。我们的数据和系统发布在tiny.one/arxivedits。

英文摘要:

Scientific publications are the primary means to communicate research discoveries, where the writing quality is of crucial importance. However, prior work studying the human editing process in this domain mainly focused on the abstract or introduction sections, resulting in an incomplete picture. In this work, we provide a complete computational framework for studying text revision in scientific writing. We first introduce arXivEdits, a new annotated corpus of 751 full papers from arXiv with gold sentence alignment across their multiple versions of revision, as well as fine-grained span-level edits and their underlying intentions for 1,000 sentence pairs. It supports our data-driven analysis to unveil the common strategies practiced by researchers for revising their papers. To scale up the analysis, we also develop automatic methods to extract revision at document-, sentence-, and word-levels. A neural CRF sentence alignment model trained on our corpus achieves 93.8 F1, enabling the reliable matching of sentences between different versions. We formulate the edit extraction task as a span alignment problem, and our proposed method extracts more fine-grained and explainable edits, compared to the commonly used diff algorithm. An intention classifier trained on our dataset achieves 78.9 F1 on the fine-grained intent classification task. Our data and system are released at tiny.one/arxivedits.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑