面向跨语言内容质量评估的维基百科文章语言无关建模
Language-Agnostic Modeling of Wikipedia Articles for Content Quality Assessment across Languages
AI总结:
针对维基百科多语言版本质量评估难以及时更新的问题,提出基于语言无关结构特征、通用权重和语言版本归一化准则的质量建模框架,构建全语言全修订版本质量数据集并开源,可支撑多类下游任务。
摘要:
维基百科是全球最大的免费知识网络知识库。志愿编辑者投入时间与精力,在300多个语言版本中创建并扩充条目。由于不同文章的内容质量参差不齐,编辑者还需花费大量时间依据特定标准对文章进行评级。然而,考虑到维基百科内容不断变化的特性,要维持这些评估的完整性与时效性几乎是不可能的。为克服这一局限,我们提出了一种用于维基百科文章质量建模的新型计算框架。\n当前最先进的维基百科文章质量建模方法均采用机器学习技术,并依赖语言特定特征。与之不同,我们的框架基于从文章中提取的语言无关结构特征、一组通用权重,以及针对各语言版本的归一化准则。因此,我们确保所有语言版本的维基百科都能从该框架中受益,即便那些没有自身质量评估体系的版本也不例外。借助该框架,我们构建了包含维基百科现有所有语言版本中全部文章所有修订版本的特征值与质量评分的数据集。我们对这些资源进行了描述性分析,并给出了框架的基准测试结果。此外,我们还探讨了这些数据集可支撑的潜在下游任务,相关数据集已公开发布供公众使用。
英文摘要:
Wikipedia is the largest web repository of free knowledge. Volunteer editors devote time and effort to creating and expanding articles in more than 300 language editions. As content quality varies from article to article, editors also spend substantial time rating articles with specific criteria. However, keeping these assessments complete and up-to-date is largely impossible given the ever-changing nature of Wikipedia. To overcome this limitation, we propose a novel computational framework for modeling the quality of Wikipedia articles. State-of-the-art approaches to model Wikipedia article quality have leveraged machine learning techniques with language-specific features. In contrast, our framework is based on language-agnostic structural features extracted from the articles, a set of universal weights, and a language version-specific normalization criterion. Therefore, we ensure that all language editions of Wikipedia can benefit from our framework, even those that do not have their own quality assessment scheme. Using this framework, we have built datasets with the feature values and quality scores of all revisions of all articles in the existing language versions of Wikipedia. We provide a descriptive analysis of these resources and a benchmark of our framework. In addition, we discuss possible downstream tasks to be addressed with these datasets, which are released for public use.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。