arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2511.04588cs.AIcs.CY
收藏

质疑问题:在线辩论过程中的代表性审计

Question the Questions: Auditing Representation in Online Deliberative Processes

FAIR at Meta(Meta的FAIR)

Soham De, Lodewijk Gelauff, Ashish Goel, Smitha Milli, Ariel Procaccia, Alice Siu

AI总结:

本文提出基于公正代表概念的审计框架,用于评估辩论过程中问题集的代表性,通过算法和历史数据验证了LLM在支持辩论过程中的潜力与局限。

摘要:

许多辩论过程,如公民大会和辩论投票,的核心特征是参与者能够直接与专家互动。尽管参与者通常被邀请提出问题,但受时间限制,只有少量问题能被选择。本文引入了一种基于公正代表概念的审计框架,用于衡量问题集的代表性。我们提出了首个在一般效用设置下审计公正代表的算法,最高效的算法时间复杂度为O(mn log n)。我们应用这些方法到历史辩论中,比较了实际提出的问题、通过整数线性规划选择的问题以及由大型语言模型生成的总结问题的代表性。结果突显了LLM在支持辩论过程中的潜力与局限。通过将这些方法整合到一个已用于数百次辩论的在线辩论平台中,使从业者能够轻松审计并改进未来辩论中的代表性。

英文摘要:

A central feature of many deliberative processes, such as citizens' assemblies and deliberative polls, is the opportunity for participants to engage directly with experts. While participants are typically invited to propose questions for expert panels, only a limited number can be selected due to time constraints. This raises the challenge of how to choose a small set of questions that best represent the interests of all participants. We introduce an auditing framework for measuring the level of representation provided by a slate of questions, based on the social choice concept known as justified representation (JR). We present the first algorithms for auditing JR in the general utility setting, with our most efficient algorithm achieving a runtime of $O(mn\log n)$, where $n$ is the number of participants and $m$ is the number of proposed questions. We apply our auditing methods to historical deliberations, comparing the representativeness of (a) the actual questions posed to the expert panel (chosen by a moderator), (b) participants' questions chosen via integer linear programming, (c) summary questions generated by large language models (LLMs). Our results highlight both the promise and current limitations of LLMs in supporting deliberative processes. By integrating our methods into an online deliberation platform that has been used for over hundreds of deliberations across more than 50 countries, we make it easy for practitioners to audit and improve representation in future deliberations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑