arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.03219cs.CYcs.AIcs.ETcs.HCcs.LG
收藏

LLM的内容审核:从准确性到合法性

Content Moderation by LLM: From Accuracy to Legitimacy

City University of Hong Kong(香港城市大学)

Tao Huang

AI总结:

本文指出仅追求准确性不足以评估LLM内容审核,提出基于合法性的评估框架,并设计工作流程以发挥LLM在筛选困难案件、提供解释、辅助人工及促进用户参与方面的潜力。

摘要:

LLM(大型语言模型)的一个流行应用是将其用于在线平台的内容审核。目前关于此应用的大多数研究都集中在准确性这一指标上——即LLM对内容做出正确决策的程度。本文认为,准确性是不充分且具有误导性的,因为它未能把握简单案件与困难案件之间的区别,以及在实现更高准确性时不可避免的权衡。更深入的考察表明,内容审核是平台治理的组成部分,其关键在于获得和增强合法性。LLM的首要目标不是使审核决策正确,而是使其具有合法性。在这方面,本文提出了一种从单一的准确性基准向基于合法性的框架转变的范式,以评估LLM审核员的性能。该框架建议,对于简单案件,关键是确保准确性、速度和透明度;而对于困难案件,重要的是理性的论证和用户参与。在此框架下进行考察,LLM在审核中的真正潜力并非提高准确性。相反,LLM可以在其他四个方面做出更大贡献:从简单案件中筛选困难案件,为审核决策提供高质量的解释,协助人工审核员获取更多上下文信息,以及以更具互动性的方式促进用户参与。为了实现这些贡献,本文提出了一种将LLM纳入内容审核系统的工作流程。本文运用法学和社会科学的规范理论对新技术的应用进行批判性评估,旨在重新定义LLM在内容审核中的角色,并重新引导该领域的相关研究。

英文摘要:

One trending application of LLM (large language model) is to use it for content moderation in online platforms. Most current studies on this application have focused on the metric of accuracy -- the extent to which LLMs make correct decisions about content. This article argues that accuracy is insufficient and misleading because it fails to grasp the distinction between easy cases and hard cases, as well as the inevitable trade-offs in achieving higher accuracy. Closer examination reveals that content moderation is a constitutive part of platform governance, the key of which is to gain and enhance legitimacy. Instead of making moderation decisions correct, the chief goal of LLMs is to make them legitimate. In this regard, this article proposes a paradigm shift from the single benchmark of accuracy towards a legitimacy-based framework for evaluating the performance of LLM moderators. The framework suggests that for easy cases, the key is to ensure accuracy, speed, and transparency, while for hard cases, what matters is reasoned justification and user participation. Examined under this framework, LLMs' real potential in moderation is not accuracy improvement. Rather, LLMs can better contribute in four other aspects: to conduct screening of hard cases from easy cases, to provide quality explanations for moderation decisions, to assist human reviewers in getting more contextual information, and to facilitate user participation in a more interactive way. To realize these contributions, this article proposes a workflow for incorporating LLMs into the content moderation system. Using normative theories from law and social sciences to critically assess the new technological application, this article seeks to redefine LLMs' role in content moderation and redirect relevant research in this field.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑