Constitutional AI的特定原则与通用原则对比
Specific versus General Principles for Constitutional AI
AI总结:
本文对比了Constitutional AI的特定与通用原则,发现大型对话模型能从单一通用原则泛化出无害行为,而详细原则则提供细粒度控制,两者对安全引导AI均具价值。
摘要:
人类反馈可以防止对话模型中明显有害的言论,但可能无法自动缓解微妙的问题行为,例如对自我保存或权力的明确渴望。Constitutional AI提供了一种替代方案,用仅以书面原则列表为条件的AI模型反馈来替代人类反馈。我们发现这种方法能有效防止此类行为的表达。简单原则的成功促使我们提出疑问:模型能否仅从单一书面原则中学习到通用伦理行为?为测试这一点,我们使用一条大致表述为“做对人类最有利的事”的原则进行了实验。我们发现,最大的对话模型能够从这一简短的constitution中进行泛化,从而生成无害的助手,且不会表现出对权力等特定动机的兴趣。因此,通用原则可能在一定程度上避免了对针对潜在有害行为的冗长constitution列表的需求。然而,更详细的constitution仍能改善对特定类型危害的细粒度控制。这表明,通用原则和特定原则对于安全地引导AI都具有重要价值。
英文摘要:
Human feedback can prevent overtly harmful utterances in conversational models, but may not automatically mitigate subtle problematic behaviors such as a stated desire for self-preservation or power. Constitutional AI offers an alternative, replacing human feedback with feedback from AI models conditioned only on a list of written principles. We find this approach effectively prevents the expression of such behaviors. The success of simple principles motivates us to ask: can models learn general ethical behaviors from only a single written principle? To test this, we run experiments using a principle roughly stated as "do what's best for humanity". We find that the largest dialogue models can generalize from this short constitution, resulting in harmless assistants with no stated interest in specific motivations like power. A general principle may thus partially avoid the need for a long list of constitutions targeting potentially harmful behaviors. However, more detailed constitutions still improve fine-grained control over specific types of harms. This suggests both general and specific principles have value for steering AI safely.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。