GRASP:一个用于评估观点中群体关联的分歧分析框架
GRASP: A Disagreement Analysis Framework to Assess Group Associations in Perspectives
AI总结:
本文提出 GRASP 分歧分析框架,通过标注者分歧衡量不同子群体的观点关联,并在安全与冒犯性标注数据集中识别系统性差异及关键人口统计维度。
摘要:
人工标注在机器学习中发挥着核心作用——例如用于监督模型的标注、生成式模型的安全护栏,以及强化学习中的人类反馈等。然而,这些人工标注中有许多本质上具有主观性,这一事实往往被忽视。近期研究表明,在特定任务和特定子群体中,忽略标注者主观性(通常会导致标注者分歧)是有问题的。能够利用标注者分歧、从而理解主观任务的社会文化倾向的可泛化方法仍然缺乏。本文提出 GRASP,这是一个综合的分歧分析框架,用于衡量不同标注者子群体之间在观点上的群体关联,并在两个数据集中展示其在评估系统性分歧程度方面的效用:(1)人类与聊天机器人对话的安全标注;(2)社交媒体帖子的冒犯性标注;二者均由跨越不同社会人口统计维度的多样化标注者群体完成标注。我们的框架(基于分歧指标)揭示了在某些任务上与其他群体存在显著不同观点的特定标注者群体,并有助于识别在特定任务情境中必须加以考虑的关键人口统计维度。
英文摘要:
Human annotation plays a core role in machine learning -- annotations for supervised models, safety guardrails for generative models, and human feedback for reinforcement learning, to cite a few avenues. However, the fact that many of these human annotations are inherently subjective is often overlooked. Recent work has demonstrated that ignoring rater subjectivity (typically resulting in rater disagreement) is problematic within specific tasks and for specific subgroups. Generalizable methods to harness rater disagreement and thus understand the socio-cultural leanings of subjective tasks remain elusive. In this paper, we propose GRASP, a comprehensive disagreement analysis framework to measure group association in perspectives among different rater sub-groups, and demonstrate its utility in assessing the extent of systematic disagreements in two datasets: (1) safety annotations of human-chatbot conversations, and (2) offensiveness annotations of social media posts, both annotated by diverse rater pools across different socio-demographic axes. Our framework (based on disagreement metrics) reveals specific rater groups that have significantly different perspectives than others on certain tasks, and helps identify demographic axes that are crucial to consider in specific task contexts.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。