arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.19497cs.CLcs.AI

大语言模型中的包容性:科学摘要中的人格特质与性别偏见

Inclusivity in Large Language Models: Personality Traits and Gender Bias in Scientific Abstracts

Information Sciences Institute, University of Southern California(南加州大学信息科学学院);Iovine and Young Academy, University of Southern California(南加州大学约万与杨学院);In Vivo Group

Naseela Pervez, Alexander J. Titus

AI总结:

本文通过LIWC框架分析三个主流大语言模型在科学摘要生成中的风格特征,发现其虽接近人类写作但存在显著性别偏见,强调需保持写作风格多样性以促进学术包容性。

摘要:

大语言模型(LLMs)越来越多地被用于辅助科学和学术写作,帮助作者提升文章的连贯性。以往研究已指出LLM输出中存在的刻板印象和偏见,强调需要评估这些模型与人类叙事风格的一致性以及潜在的性别偏见。在本研究中,我们通过分析三个主流LLM——Claude 3 Opus、Mistral AI Large和Gemini 1.5 Flash——在科学摘要基准文本生成任务上的表现,评估它们与人类写作风格的一致性。我们采用语言查询与词频统计(LIWC)框架,从生成的文本中提取词汇、心理和社会特征。我们的研究结果表明,尽管这些模型通常能生成与人类作者内容高度相似的文本,但风格特征的差异表明存在显著的性别偏见。本研究强调了开发能够保持写作风格多样性的LLM的重要性,以促进学术话语中的包容性。

英文摘要:

Large language models (LLMs) are increasingly utilized to assist in scientific and academic writing, helping authors enhance the coherence of their articles. Previous studies have highlighted stereotypes and biases present in LLM outputs, emphasizing the need to evaluate these models for their alignment with human narrative styles and potential gender biases. In this study, we assess the alignment of three prominent LLMs - Claude 3 Opus, Mistral AI Large, and Gemini 1.5 Flash - by analyzing their performance on benchmark text-generation tasks for scientific abstracts. We employ the Linguistic Inquiry and Word Count (LIWC) framework to extract lexical, psychological, and social features from the generated texts. Our findings indicate that, while these models generally produce text closely resembling human authored content, variations in stylistic features suggest significant gender biases. This research highlights the importance of developing LLMs that maintain a diversity of writing styles to promote inclusivity in academic discourse.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑