女性、臭名昭著者与异域存在:孟加拉语和印地语中维基百科与大型语言模型敬语使用的比较研究
Women, Infamous, and Exotic Beings: A Comparative Study of Honorific Usages in Wikipedia and LLMs for Bengali and Hindi
AI总结:
本研究首次大规模比较孟加拉语和印地语维基百科与六个大型语言模型在第三人称敬语使用上的差异,发现模型与人类使用存在系统性偏差,揭示了社会文化对齐的不足。
摘要:
第三人称敬语在多个南亚语言中具有强制性使用特征,编码了权力、年龄、性别、名望和社会距离等细微的社会语用线索。在本工作中,(i) 我们首次对10,000篇印地语和孟加拉语维基百科文章中的第三人称敬语代词和动词使用进行了大规模研究,并标注了与主体关键社会人口属性(包括性别、年龄段、名望和文化来源)相关的注释。(ii) 我们的分析揭示了系统性的语言内部规律,但存在显著的跨语言差异:敬语在孟加拉语中比在印地语中更为普遍,而在指代臭名昭著、未成年和异域文化实体时,非敬语占主导地位。值得注意的是,在两种语言中,且在印地语中更为突出,男性比女性更频繁地被使用敬语称呼。(iii) 为了检验大型语言模型(LLMs)是否内化了类似的社会语用规范,我们使用受控生成和翻译任务,对1,000个文化平衡实体探测了六个LLM。我们发现LLM与维基百科的使用方式存在分歧,在任务、语言和社会人口属性之间表现出对敬语选择的替代偏好。这些差异凸显了LLM在社会文化对齐方面的差距,并为研究LLM如何获取、适应或扭曲社会语言规范开辟了新方向。我们的代码和数据可在https://github.com/souro/honorific-wiki-llm公开获取。
英文摘要:
The obligatory use of third-person honorifics is a distinctive feature of several South Asian languages, encoding nuanced socio-pragmatic cues such as power, age, gender, fame, and social distance. In this work, (i) We present the first large-scale study of third-person honorific pronoun and verb usage across 10,000 Hindi and Bengali Wikipedia articles with annotations linked to key socio-demographic attributes of the subjects, including gender, age group, fame, and cultural origin. (ii) Our analysis uncovers systematic intra-language regularities but notable cross-linguistic differences: honorifics are more prevalent in Bengali than in Hindi, while non-honorifics dominate while referring to infamous, juvenile, and culturally exotic entities. Notably, in both languages, and more prominently in Hindi, men are more frequently addressed with honorifics than women. (iii) To examine whether large language models (LLMs) internalize similar socio-pragmatic norms, we probe six LLMs using controlled generation and translation tasks over 1,000 culturally balanced entities. We find that LLMs diverge from Wikipedia usage, exhibiting alternative preferences in honorific selection across tasks, languages, and socio-demographic attributes. These discrepancies highlight gaps in the socio-cultural alignment of LLMs and open new directions for studying how LLMs acquire, adapt, or distort social-linguistic norms. Our code and data are publicly available at https://github.com/souro/honorific-wiki-llm
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。