arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2605.01416cs.CYcs.CL
收藏

谁决定什么是有害的?通过多智能体个性化推理框架进行内容审核政策

Who Decides What Is Harmful? Content Moderation Policy Through A Multi-Agent Personalised Inference Framework

Warsaw University of Technology(华沙技术大学)

Ewelina Gajewska, Michal Wawer, Katarzyna Budzynska, Jaroslaw A. Chudziak

AI总结:

本文提出基于LLM的多智能体个性化推理框架,通过用户敏感性档案过滤内容,提升审核准确性,并为平台治理提供政策相关洞察。

摘要:

随着在线平台规模和复杂性的增加,围绕有害内容、数字福祉和用户自主权的政策问题变得至关重要。传统内容审核系统依赖集中化、自上而下的规则,往往无法适应危害感知的主观性。本文提出基于LLM的多智能体个性化推理框架,根据用户独特的敏感性档案过滤内容。我们的架构结合了领域特定的专家代理、负责协调内容分析和代理选择的管理代理,以及模拟用户视角的鬼魂档案代理,以指导审核决策。在多种非个性化基准上评估后,系统在准确性上提高了高达32%,显示出与个体用户敏感性的更高一致性。除了技术性能外,我们的框架为平台治理提供了相关政策相关见解,提供了一种可扩展的方法,以协调审核政策与社会和个体的数字权利。

英文摘要:

The increasing scale and complexity of online platforms raises critical policy questions around harmful content, digital well-being, and user autonomy. Traditional content moderation systems rely on centralised, top-down rules, often failing to accommodate the subjective nature of harm perception. This paper proposes an LLM-based multi-agent personalised inference framework that filters content based on unique sensitivity profiles of individual users. Our architecture combines domain-specific Expert Agents, a Manager Agent for orchestrating content analysis and agent selection, and a Ghost Profile Agent for simulating user perspectives, to inform moderation decisions. Evaluated against a range of non-personalised baselines, the system demonstrates up to a 32% improvement in accuracy, showing increased alignment with individual user sensitivities. Beyond technical performance, our framework provides policy-relevant insights for platform governance, providing a scalable way to reconcile moderation policies with societal and individual digital rights

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑