arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2510.11434cs.CL

你是谁,ChatGPT?LLM生成内容中的人格与人口统计特征

Who are you, ChatGPT? Personality and Demographic Style in LLM-Generated Content

The Academic College of Tel Aviv--Yaffo(特拉维夫-亚法夫学术学院)

Dana Sotto Porat, Ella Rabinovich

AI总结:

本研究提出一种不依赖自我报告的数据驱动方法,通过自动分类器分析Reddit开放问答的模型回复,发现LLM表现出更高的宜人性和更低的神经质,并贡献了新数据集与大规模比较分析。

摘要:

生成式大型语言模型(LLMs)已成为日常生活的核心,在各个领域生成类人文本。越来越多的研究开始调查这些模型在语言中是否也表现出类似人格和人口统计学的特征。在本研究中,我们提出了一种新颖的、数据驱动的方法来评估LLM人格,不依赖自我报告问卷,而是应用自动人格和性别分类器来对从Reddit收集的开放性问题的模型回复进行建模。通过将六个广泛使用的模型与人类编写的回复进行比较,我们发现LLM系统性地表现出更高的宜人性(Agreeableness)和更低的神经质(Neuroticism),反映出合作和稳定的对话倾向。模型文本中的性别化语言模式总体上与人类作者相似,尽管变化较小,这与先前关于自动化代理的发现相呼应。我们贡献了一个包含人类和模型回复的新数据集,以及大规模的比较分析,为生成式AI的人格和人口统计模式这一主题提供了新的启示。

英文摘要:

Generative large language models (LLMs) have become central to everyday life, producing human-like text across diverse domains. A growing body of research investigates whether these models also exhibit personality- and demographic-like characteristics in their language. In this work, we introduce a novel, data-driven methodology for assessing LLM personality without relying on self-report questionnaires, applying instead automatic personality and gender classifiers to model replies on open-ended questions collected from Reddit. Comparing six widely used models to human-authored responses, we find that LLMs systematically express higher Agreeableness and lower Neuroticism, reflecting cooperative and stable conversational tendencies. Gendered language patterns in model text broadly resemble those of human writers, though with reduced variation, echoing prior findings on automated agents. We contribute a new dataset of human and model responses, along with large-scale comparative analyses, shedding new light on the topic of personality and demographic patterns of generative AI.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑