arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2102.03671cs.CL
收藏

从网络评论中的毒性到美国新闻中的不文明:谨慎行事

From Toxicity in Online Comments to Incivility in American News: Proceed with Caution

University of Pennsylvania(宾夕法尼亚大学)

Anushree Hede, Oshin Agarwal, Linda Lu, Diana C. Mutz, Ani Nenkova

摘要:

对网络、新闻和国会辩论中的不文明行为进行量化的能力,引起了政治学家的极大兴趣。用于检测英语在线不文明行为的计算工具现在相当容易获得,并且有可能得到更广泛的应用。我们测试拼图透视API的能力,以检测我们开发的语料库,包括在美国新闻文明的手动注释的不文明程度。我们证明,毒性模型,举例来说,透视,是不足以分析新闻中的不文明行为。我们进行了错误分析,指出需要开发方法来消除新闻中经常提到的词之间的虚假相关性,特别是身份描述符和不礼貌。如果没有这样的改进,在新闻上应用Perspective或类似的模型很可能会导致错误的结论,这些结论与人类对不文明行为的感知不一致。

英文摘要:

The ability to quantify incivility online, in news and in congressional debates, is of great interest to political scientists. Computational tools for detecting online incivility for English are now fairly accessible and potentially could be applied more broadly. We test the Jigsaw Perspective API for its ability to detect the degree of incivility on a corpus that we developed, consisting of manual annotations of civility in American news. We demonstrate that toxicity models, as exemplified by Perspective, are inadequate for the analysis of incivility in news. We carry out error analysis that points to the need to develop methods to remove spurious correlations between words often mentioned in the news, especially identity descriptors and incivility. Without such improvements, applying Perspective or similar models on news is likely to lead to wrong conclusions, that are not aligned with the human perception of incivility.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑