arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2211.05007cs.CL
收藏

不和谐问题:新闻报道多样性分析的计算方法

Discord Questions: A Computational Approach To Diversity Analysis in News Coverage

Salesforce AI Research(Salesforce人工智能研究院);UCLA(加州大学洛杉矶分校)

Philippe Laban, Chien-Sheng Wu, Lidiya Murakhovs'ka, Xiang 'Anthony' Chen, Caiming Xiong

摘要:

新闻读者访问不同的来源有许多潜在的好处。现代新闻聚合器做的是组织新闻的艰苦工作,为读者提供过多的来源选择,但选择阅读哪个来源仍然具有挑战性。我们提出了一个新的框架,以帮助读者识别源的差异,并获得新闻报道的多样性的理解。该框架是基于不和谐问题的生成:问题与不同的答案池,明确说明来源的差异。为了组装框架的原型,我们关注两个组件:(1)不一致问题生成,生成由源不同回答的问题的任务,为此我们提出了一种自动评分方法,并创建了一个模型,该模型将当前问题生成(QG)方法的性能提高了5%,(2)答案合并,对语义相似的问题的答案进行分组的任务,为此,我们收集数据并重新使用一种方法,该方法在我们的实际测试集上达到了81%的平衡准确率。我们通过一个原型接口说明了该框架的可行性。尽管模型在discord QG上的表现仍然落后于人类表现15%以上,但生成的问题被认为比事实问题更有趣,并且可以揭示新闻报道中来源的细节,情感和推理水平的差异。

英文摘要:

There are many potential benefits to news readers accessing diverse sources. Modern news aggregators do the hard work of organizing the news, offering readers a plethora of source options, but choosing which source to read remains challenging. We propose a new framework to assist readers in identifying source differences and gaining an understanding of news coverage diversity. The framework is based on the generation of Discord Questions: questions with a diverse answer pool, explicitly illustrating source differences. To assemble a prototype of the framework, we focus on two components: (1) discord question generation, the task of generating questions answered differently by sources, for which we propose an automatic scoring method, and create a model that improves performance from current question generation (QG) methods by 5%, (2) answer consolidation, the task of grouping answers to a question that are semantically similar, for which we collect data and repurpose a method that achieves 81% balanced accuracy on our realistic test set. We illustrate the framework's feasibility through a prototype interface. Even though model performance at discord QG still lags human performance by more than 15%, generated questions are judged to be more interesting than factoid questions and can reveal differences in the level of detail, sentiment, and reasoning of sources in news coverage.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑