arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2108.02252cs.SI
收藏

利用编辑行为模式自动标注维基百科低质量内容

Automatically Labeling Low Quality Content on Wikipedia by Leveraging Patterns in Editing Behaviors

Sumit Asthana, Sabrina Tobar Thommel, Aaron Lee Halfaker, Nikola Banovic

摘要:

维基百科条目旨在成为百科内容的权威来源。然而,只有0.6%的维基百科文章具有高质量,根据其质量等级,由于维基百科编辑人数不足和大量的文章。有监督的机器学习(ML)质量改进方法可以自动识别和修复内容问题,依赖于单个维基百科句子质量的手动标签。然而,目前的标记方法是繁琐的,并产生嘈杂的标签。在这里,我们提出了一种自动标记方法,该方法识别语义类别(例如,添加引用、澄清),并使用编辑前修改的句子作为需要语义改进的示例。评分最高的文章句子是不再需要语义改进的例子。我们表明,在我们的标签上训练现有的句子质量分类算法,与在现有标签上训练它们相比,可以提高它们的性能。我们的工作表明,维基百科编辑的编辑行为提供了更好的标签,而不是缺乏背景来做出编辑会同意的判断的人群工作者产生的标签。

英文摘要:

Wikipedia articles aim to be definitive sources of encyclopedic content. Yet, only 0.6% of Wikipedia articles have high quality according to its quality scale due to insufficient number of Wikipedia editors and enormous number of articles. Supervised Machine Learning (ML) quality improvement approaches that can automatically identify and fix content issues rely on manual labels of individual Wikipedia sentence quality. However, current labeling approaches are tedious and produce noisy labels. Here, we propose an automated labeling approach that identifies the semantic category (e.g., adding citations, clarifications) of historic Wikipedia edits and uses the modified sentences prior to the edit as examples that require that semantic improvement. Highest-rated article sentences are examples that no longer need semantic improvements. We show that training existing sentence quality classification algorithms on our labels improves their performance compared to training them on existing labels. Our work shows that editing behaviors of Wikipedia editors provide better labels than labels generated by crowdworkers who lack the context to make judgments that the editors would agree with.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑