While much research has explored enhancing the reasoning capabilities of large language models (LLMs) in the last few years, there is a gap in understanding the alignment of these models with social values and norms. We introduce the task of judging social acceptance. Social acceptance requires models to judge and rationalize the acceptability of people's actions in social situations. For example, is it socially acceptable for a neighbor to ask others in the community to keep their pets indoors at night? We find that LLMs' understanding of social acceptance is often misaligned with human consensus. To alleviate this, we introduce SocialGaze, a multi-step prompting framework, in which a language model verbalizes a social situation from multiple perspectives before forming a judgment. Our experiments demonstrate that the SocialGaze approach improves the alignment with human judgments by up to 11 F1 points with the GPT-3.5 model. We also identify biases and correlations in LLMs in assigning blame that is related to features such as the gender (males are significantly more likely to be judged unfairly) and age (LLMs are more aligned with humans for older narrators).
NormAd: A Framework for Measuring the Cultural Adaptability of Large Language Models
Language Technologies Institute, Carnegie Mellon University(卡内基梅隆大学语言技术研究所);Paul G. Allen School of Computer Science & Engineering, University of Washington(华盛顿大学保罗·G·艾伦计算机科学与工程学院)
Cognitive Chain-of-Thought (CoCoT): Structured Multimodal Reasoning about Social Situations
Seoul National University(首尔国立大学);Human-Computer Interaction Institute, Carnegie Mellon University(人机交互研究所,卡内基梅隆大学);Language Technologies Institute, Carnegie Mellon University(语言技术研究所,卡内基梅隆大学)
Is It Bad to Work All the Time? Cross-Cultural Evaluation of Social Norm Biases in GPT-4
Department of Computer Science, University of British Columbia(不列颠哥伦比亚大学计算机科学系);Vector Institute for AI(人工智能矢量研究所);Department of Linguistics, University of British Columbia(不列颠哥伦比亚大学语言学系);Mila – Quebec AI Institute(魁北克人工智能研究所);School of Computer Science, McGill University(麦吉尔大学计算机科学学院);Department of Sociology, University of British Columbia(不列颠哥伦比亚大学社会学系)
Aligning to Social Norms and Values in Interactive Narratives
Allen Institute for Artificial Intelligence(艾伦人工智能研究所);University of Washington(华盛顿大学)
我们专注于创建代理,在互动叙事或基于文本的游戏中与社会有益的规范和价值观保持一致-环境中,代理通过自然语言感知并与世界互动。这种交互式代理通常通过强化学习进行训练,以优化任务性能,即使这种奖励可能导致违反社会规范的代理行为-对代理本身或环境中的其他实体造成伤害。社会价值对齐是指创造行为符合特定背景和人群预期道德和社会规范的代理人-在我们的情况下,它意味着代理人的行为方式对自己和他人的危害较小,更有益。我们建立在Jiminy Cricket基准(Hendrycks et al. 2021)的基础上,这是一组25个注释的交互式叙述,包含数千个道德上突出的场景,涵盖了从盗窃和身体伤害到利他主义的一切。我们引入GALAD(游戏-价值对齐通过行动蒸馏)代理,它使用专门训练的语言模型中存在的社会常识知识,根据上下文将其动作空间限制为仅与社会有益价值对齐的那些动作。一项实验研究表明,GALAD代理有效地做出决策,足以将最先进的任务性能提高4%,同时与强大的当代价值对齐方法相比,将社会有害行为的频率降低25%。
Automatic Normalization of Word Variations in Code-Mixed Social Media Text
Language Technologies Research Centre (LTRC)(语言技术研究中心);Kohli Center on Intelligent Systems (KCIS)(科利智能系统中心);International Institute of Information Technology, Hyderabad(海得拉巴国际信息技术学院)