寻求人类安全共识:面向生成式AI价值安全的统一价值尺度
Seeking Human Security Consensus: A Unified Value Scale for Generative AI Value Safety
AI总结:
本文提出生成式AI价值安全尺度,通过生命周期视角构建价值安全风险分类和事件库,并通过基准测试揭示模型间价值安全性能差异,强调建立共享安全基础的重要性。
摘要:
生成式AI的快速发展将价值和伦理相关风险推向前台,使得价值安全成为关键问题,但缺乏统一的共识。本文提出一个国际包容且稳健的统一价值框架,即生成式AI价值安全尺度(GVS-Scale):基于生命周期视角,我们开发了生成式AI价值安全风险分类法,并构建了生成式AI价值安全事件库(GVSIR),并通过扎根理论和操作化方法推导出GVS-Scale,通过生成式AI价值安全基准(GVS-Bench)进行操作化。在主流文本生成模型上的实验揭示了模型间在价值安全性能上的显著差异,表明当前系统在价值对齐方面存在不均衡和碎片化的问题。我们的发现强调了通过对话建立共享安全基础的重要性,并推进技术安全机制超越反应性约束,向更灵活的方法发展。数据和评估指南可在https://github.com/acl2026/GVS-Bench获取。本文包含可能具有冒犯性或有害性的示例。
英文摘要:
The rapid development of generative AI has brought value- and ethics-related risks to the forefront, making value safety a critical concern while a unified consensus remains lacking. In this work, we propose an internationally inclusive and resilient unified value framework, the GenAI Value Safety Scale (GVS-Scale): Grounded in a lifecycle-oriented perspective, we develop a taxonomy of GenAI value safety risks and construct the GenAI Value Safety Incident Repository (GVSIR), and further derive the GVS-Scale through grounded theory and operationalize it via the GenAI Value Safety Benchmark (GVS-Bench). Experiments on mainstream text generation models reveal substantial variation in value safety performance across models and value categories, indicating uneven and fragmented value alignment in current systems. Our findings highlight the importance of establishing shared safety foundations through dialogue and advancing technical safety mechanisms beyond reactive constraints toward more flexible approaches. Data and evaluation guidelines are available at https://github.com/acl2026/GVS-Bench. This paper includes examples that may be offensive or harmful.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。