大型语言模型是否在社会经济地位上适应语言变异?
Do Large Language Models Adapt to Language Variation across Socioeconomic Status?
AI总结:
研究发现大型语言模型在不同社会经济地位社区中适应语言风格有限,可能加剧语言层级差异并影响社会模拟研究的有效性。
摘要:
人类会根据所面对的受众调整其语言风格。然而,大型语言模型(LLMs)在不同社会情境中适应的程度仍知之甚少。随着这些模型越来越多地介导人与人之间的交流,它们未能适应不同风格将加剧刻板印象,并边缘化那些语言规范与模型不相符的社区,从而巩固社会分层。我们研究了LLMs在不同社会经济地位(SES)社区中融入社交媒体交流的程度。我们从Reddit和YouTube收集了一个新的数据集,并按社会经济地位进行分层。我们用四个LLMs提示不完整的文本,并将LLMs生成的补全内容与原文沿94个社会语言学指标进行比较,包括语法、修辞和词汇特征。LLMs在社会经济地位方面只在很小程度上调节其风格,往往导致近似或刻板印象,并倾向于更有效地模仿上层社会经济地位的风格。我们的发现(1)显示LLMs可能加剧语言层级体系;(2)质疑其在基于代理的社会模拟、调查实验以及依赖语言风格作为社会信号的研究中的有效性。
英文摘要:
Humans adjust their linguistic style to the audience they are addressing. However, the extent to which LLMs adapt to different social contexts is largely unknown. As these models increasingly mediate human-to-human communication, their failure to adapt to diverse styles can perpetuate stereotypes and marginalize communities whose linguistic norms are less closely mirrored by the models, thereby reinforcing social stratification. We study the extent to which LLMs integrate into social media communication across different socioeconomic status (SES) communities. We collect a novel dataset from Reddit and YouTube, stratified by SES. We prompt four LLMs with incomplete text from that corpus and compare the LLM-generated completions to the originals along 94 sociolinguistic metrics, including syntactic, rhetorical, and lexical features. LLMs modulate their style with respect to SES to only a minor extent, often resulting in approximation or caricature, and tend to emulate the style of upper SES more effectively. Our findings (1) show how LLMs risk amplifying linguistic hierarchies and (2) call into question their validity for agent-based social simulation, survey experiments, and any research relying on language style as a social signal.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。