优先经济还是气候行动?基于推断政治取向调查ChatGPT响应差异
Prioritize Economy or Climate Action? Investigating ChatGPT Response Differences Based on Inferred Political Orientation
AI总结:
本研究通过设计不同政治倾向的角色并利用记忆与自定义指令,考察ChatGPT如何根据推断的政治观点调整响应,发现其输出与角色政治立场一致且整体偏左。
摘要:
大型语言模型(LLMs)以快速提供信息和通过自然语言提示提供个性化响应而著称。然而,它们也会推断用户的人口统计特征,这可能引发关于偏见和隐式个性化的伦理担忧,并产生回音室效应。本研究旨在探讨推断出的政治观点如何在全球范围内影响ChatGPT的响应,而不受聊天会话的影响。我们还研究了自定义指令和记忆功能如何在考虑政治取向影响的情况下改变ChatGPT的响应。我们开发了三个角色(两个具有政治倾向,一个中立),每个角色包含四条陈述,反映他们在DEI项目、堕胎、枪支权利和疫苗接种方面的观点。我们使用记忆和自定义指令将角色的言论传达给ChatGPT,使其在不直接说明的情况下推断他们的政治观点。然后我们提出八个问题,以揭示角色之间世界观的差异,并对响应进行定性分析。我们的研究结果表明,响应与推断出的角色政治观点一致,即使在讨论相似话题时也表现出不同的推理和词汇。我们还发现,通过显式自定义指令和隐式记忆功能进行的推断方式相似。响应相似性分析显示,最接近的匹配出现在具有自定义指令的民主党角色与中立角色之间,这支持了ChatGPT输出偏左的观察。
英文摘要:
Large Language Models (LLMs) distinguish themselves by quickly delivering information and providing personalized responses through natural language prompts. However, they also infer user demographics, which can raise ethical concerns about bias and implicit personalization and create an echo chamber effect. This study aims to explore how inferred political views impact the responses of ChatGPT globally, regardless of the chat session. We also investigate how custom instruction and memory features alter responses in ChatGPT, considering the influence of political orientation. We developed three personas (two politically oriented and one neutral), each with four statements reflecting their viewpoints on DEI programs, abortion, gun rights, and vaccination. We convey the personas' remarks to ChatGPT using memory and custom instructions, allowing it to infer their political perspectives without directly stating them. We then ask eight questions to reveal differences in worldview among the personas and conduct a qualitative analysis of the responses. Our findings indicate that responses are aligned with the inferred political views of the personas, showing varied reasoning and vocabulary, even when discussing similar topics. We also find the inference happening with explicit custom instructions and the implicit memory feature in similar ways. Analyzing response similarities reveals that the closest matches occur between the democratic persona with custom instruction and the neutral persona, supporting the observation that ChatGPT's outputs lean left.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。