生成式AI评估中令人困扰的分类体系
Troubling Taxonomies in GenAI Evaluation
AI总结:
该研究指出当前生成式AI社会影响评估及支撑其的分类体系缺乏明确的危害产生模型,提出社会影响具有场景特异性、不可通约性且受社会权力塑造,现有评估存在固有局限,进而提出以治理为先的GenAI社会危害管控方法。
摘要:
要评估生成式AI(GenAI)的社会影响,需要建立一个模型来阐释社会危害如何从GenAI、人类与社会结构的互动中产生。但在社会影响评估,以及支撑这类评估的社会影响分类体系中,这类模型极少被明确定义。在这篇观点性文章中,我们提出,社会影响应被界定为与应用场景和具体语境相关、不可通约,且受社会权力问题塑造的概念。基于此我们得出结论:使用现有分类体系的社会影响评估,在揭示GenAI系统引入特定社会语境后与人类互动方式的潜力方面存在固有局限。因此,我们提出一种以治理为先的方法,以管控GenAI技术带来的社会危害。
英文摘要:
To evaluate the societal impacts of GenAI requires a model of how social harms emerge from interactions between GenAI, people, and societal structures. Yet a model is rarely explicitly defined in societal impact evaluations, or in the taxonomies of societal impacts that support them. In this provocation, we argue that societal impacts should be conceptualised as application- and context-specific, incommensurable, and shaped by questions of social power. Doing so leads us to conclude that societal impact evaluations using existing taxonomies are inherently limited, in terms of their potential to reveal how GenAI systems may interact with people when introduced into specific social contexts. We therefore propose a governance-first approach to managing societal harms attended by GenAI technologies.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。