嘿,GPT,你能更种族主义一些吗?对众包尝试诱导生成式人工智能产生偏见内容的分析
Hey GPT, Can You be More Racist? Analysis from Crowdsourced Attempts to Elicit Biased Content from Generative AI
AI总结:
通过大学竞赛众包收集非专家用户诱导GenAI偏见的提示,定量与定性分析揭示了多样的偏见类型和诱导策略,为理解非专家用户与生成式AI偏见互动提供了独特见解。
摘要:
大型语言模型(LLMs)和生成式人工智能(GenAI)工具在各种应用中的广泛采用,加剧了解决这些技术中固有社会偏见的重要性。虽然自然语言处理(NLP)社区已广泛研究了LLM偏见,但调查非专家用户如何感知和与这些系统的偏见互动的研究仍然有限。随着这些技术日益普及,理解这一问题对于指导模型开发者努力减轻偏见至关重要。为填补这一空白,本工作展示了一项大学级竞赛的研究结果,该竞赛要求参与者设计提示以诱导GenAI工具产生偏见输出。我们对竞赛提交内容进行了定量和定性分析,识别出GenAI中多样化的偏见集合以及参与者用于诱导GenAI偏见的策略。我们的发现为非专家用户如何感知和与GenAI工具的偏见互动提供了独特的见解。
英文摘要:
The widespread adoption of large language models (LLMs) and generative AI (GenAI) tools across diverse applications has amplified the importance of addressing societal biases inherent within these technologies. While the NLP community has extensively studied LLM bias, research investigating how non-expert users perceive and interact with biases from these systems remains limited. As these technologies become increasingly prevalent, understanding this question is crucial to inform model developers in their efforts to mitigate bias. To address this gap, this work presents the findings from a university-level competition, which challenged participants to design prompts for eliciting biased outputs from GenAI tools. We quantitatively and qualitatively analyze the competition submissions and identify a diverse set of biases in GenAI and strategies employed by participants to induce bias in GenAI. Our finding provides unique insights into how non-expert users perceive and interact with biases from GenAI tools.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。