多样却分化:大语言模型会夸大与错误信息危害相关的观点性别差异
Diverse, but Divisive: LLMs Can Exaggerate Gender Differences in Opinion Related to Harms of Misinformation
AI总结:
本研究构建TopicMisinfo数据集,探究大语言模型辅助事实核查优先级排序时的观点性别差异反映情况,发现GPT 3.5-Turbo会放大实证存在的观点性别差异,并公开数据集以支持相关研究。
摘要:
错误信息和虚假信息的广泛传播对社会构成了重大威胁。专业事实核查人员在应对这一威胁中发挥着关键作用,但问题的规模之大迫使他们优先分配有限的资源。这种优先级排序可能会考虑一系列因素,比如对特定人群造成的不同伤害风险。在本研究中,我们探究了使用大语言模型(LLM)辅助此类优先级排序的潜在影响。由于事实核查会影响社会中广泛的多元群体,因此在主张优先级排序过程中体现多元观点至关重要。本文以性别为核心变量,考察LLM在评估错误信息危害时是否能够反映不同群体的观点。我们提出两个核心问题:(1)带有明确性别指向的提示词,能在多大程度上反映美国民众在社会相关议题上的观点性别差异?(2)性别中立的提示词,与这些议题上的性别化观点契合度如何?为分析这些问题,我们构建了TopicMisinfo数据集,包含来自不同主题的160条经过事实核查的主张,并补充了近1600条带有主观感知和标注者人口统计信息的人工标注。通过分析针对特定性别提示词和中立提示词的回复,我们发现GPT 3.5-Turbo能够反映实证观察到的观点性别差异,但会放大这些差异的程度。这些发现阐明了AI在网络内容治理中的复杂作用,对事实核查人员、算法设计者以及众包标注人员的使用都具有启示意义。我们还发布了TopicMisinfo数据集,以支持学界的后续研究。
英文摘要:
The pervasive spread of misinformation and disinformation poses a significant threat to society. Professional fact-checkers play a key role in addressing this threat, but the vast scale of the problem forces them to prioritize their limited resources. This prioritization may consider a range of factors, such as varying risks of harm posed to specific groups of people. In this work, we investigate potential implications of using a large language model (LLM) to facilitate such prioritization. Because fact-checking impacts a wide range of diverse segments of society, it is important that diverse views are represented in the claim prioritization process. This paper examines whether a LLM can reflect the views of various groups when assessing the harms of misinformation, focusing on gender as a primary variable. We pose two central questions: (1) To what extent do prompts with explicit gender references reflect gender differences in opinion in the United States on topics of social relevance? and (2) To what extent do gender-neutral prompts align with gendered viewpoints on those topics? To analyze these questions, we present the TopicMisinfo dataset, containing 160 fact-checked claims from diverse topics, supplemented by nearly 1600 human annotations with subjective perceptions and annotator demographics. Analyzing responses to gender-specific and neutral prompts, we find that GPT 3.5-Turbo reflects empirically observed gender differences in opinion but amplifies the extent of these differences. These findings illuminate AI's complex role in moderating online communication, with implications for fact-checkers, algorithm designers, and the use of crowd-workers as annotators. We also release the TopicMisinfo dataset to support continuing research in the community.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。