发表机构
Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学)
机构由 AI 辅助整理,请以论文原文为准。AI 中文总结
本研究针对现有社会权力计算研究的语言文化局限,提出基于社会科学理论的多语言对话社会权力推理框架,构建含15836个实例的双语语料库,评估6类大模型并发现其与人类推理的差距,为跨文化社会推理提供评估设置。
AI 中文摘要
社会权力在塑造人类互动中发挥着基础性作用,但对权力的计算研究仍局限于狭窄的语言和文化场景。现有数据集还缺乏开展稳健跨文化分析所需的人口统计与关系深度信息。为解决这一缺口,我们引入了一个基于社会科学理论的框架,用于通过电影剧本研究自然主义多语言对话中的社会权力。该框架整合了由社会科学理论指导的模式、经预研究优化的母语标注流程,以及用于可扩展跨语言分析的定制界面。利用该框架,我们构建了一个初始语料库,包含来自法语和埃及阿拉伯语电影100个场景的15836个标注实例。我们的分析显示,在可观察的人口统计和上下文属性上存在强一致性,而社会解释层面,如权力不对称和意图对齐,则更具争议性,凸显了不同文化中社会权力的复杂性。我们评估了6个大型语言模型(LLMs)和多模态大型语言模型在跨文化社会权力推理上的表现,发现人类与模型在关系及心智理论推理方面的一致性存在持续差距。本研究引入了首个可扩展的多语言对话社会权力研究框架,并提供了用于研究跨文化社会推理的初始评估设置。
英文摘要
Social power plays a fundamental role in shaping human interaction, yet computational studies of power remain limited to narrow linguistic and cultural settings. Existing datasets further lack the demographic and relational depth needed for robust cross-cultural analysis. To address this gap, we introduce a theoretically grounded framework for studying social power in naturalistic multilingual dialogue through movie screenplays. The framework integrates a schema informed by social science theory, a native speaker annotation pipeline refined through pilot studies, and a custom interface for scalable cross-lingual analysis. Using this framework, we constructed an initial corpus containing 15,836 annotated instances from 100 scenes in French and Egyptian Arabic movies. Our analysis reveals strong agreement on observable demographic and contextual attributes, while socially interpretive aspects, such as power asymmetry and intention alignment, remain more contested, highlighting the complexity of social power across cultures. We evaluated 6 Large Language Models (LLMs) and Multimodal LLMs on cross-cultural social power reasoning, finding persistent gaps between human and model agreement in relational and theory-of-mind reasoning. Our work introduces the first extensible multilingual framework for studying social power in dialogues and provides an initial evaluation setting for studying cross-cultural social reasoning.