arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2408.04293cs.CLcs.CY
收藏

社会情感内在于大语言模型吗?一项关于跨人群情感提取的实证研究

Are Social Sentiments Inherent in LLMs? An Empirical Study on Extraction of Inter-demographic Sentiments

Graduate School of Informatics, Nagoya University(名古屋大学信息学研究科)

Kunitomo Tanaka, Ryohei Sasano, Koichi Takeda

AI总结:

本文通过向五个代表性大语言模型提问并与社会调查对比,实证检验了LLM能否捕捉和提取以国籍、宗教、种族定义的群体间情感,发现国籍和宗教情感与真实调查相关性较高。

摘要:

大语言模型(LLMs)被认为通过在大规模文本上训练模型来获取无意识的人类知识和情感,例如社会常识和偏见。然而,目前尚不清楚各种大语言模型能在多大程度上捕捉特定社会群体的情感。在本研究中,我们聚焦于以国籍、宗教和种族/族裔定义的社会群体,并验证社会群体之间的情感能在多大程度上被大语言模型捕捉和提取。具体而言,我们将关于一个群体对另一个群体情感的问题输入大语言模型,对回答应用情感分析,并将结果与社会调查进行比较。使用五个代表性大语言模型的验证结果显示,国籍和宗教的相关性较高,且p值相对较小,这两类数据点数量相对较多。这一结果表明,包含群体间情感的大语言模型回答与实际社会调查结果高度一致。

英文摘要:

Large language models (LLMs) are supposed to acquire unconscious human knowledge and feelings, such as social common sense and biases, by training models from large amounts of text. However, it is not clear how much the sentiments of specific social groups can be captured in various LLMs. In this study, we focus on social groups defined in terms of nationality, religion, and race/ethnicity, and validate the extent to which sentiments between social groups can be captured in and extracted from LLMs. Specifically, we input questions regarding sentiments from one group to another into LLMs, apply sentiment analysis to the responses, and compare the results with social surveys. The validation results using five representative LLMs showed higher correlations with relatively small p-values for nationalities and religions, whose number of data points were relatively large. This result indicates that the LLM responses including the inter-group sentiments align well with actual social survey results.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑