AI 中文总结
该立场论文指出现代AI对齐方法是两用技术，可能被恶意滥用，呼吁社区讨论其滥用风险并提出缓解策略。
AI 中文摘要
本篇立场论文指出，原本旨在防止有害输出的现代AI对齐方法是一种两用技术，可能被恶意行为者轻易滥用，用于审查和操纵。通过将当前的对齐技术与滥用的可能性及实际案例相对应，研究表明，对“完全对齐”模型的追求，无意中也为恶意行为者提供了不断改进的信息主导工具。当前，随着用户迅速将AI用作信息提供者、经济权力不对称，以及政治格局日益转向威权主义，这种风险正在加剧，因此我们现在就需要讨论这种两用潜力。最后，研究呼吁该社区考虑AI对齐机制的故意滥用问题，并提出缓解策略，以防范这种两用潜力。
英文摘要
This position paper argues that modern AI alignment methods - originally designed to prevent harmful output - are dual-use technologies that may easily be misused by malicious actors for censorship and manipulation. By mapping current alignment techniques to the possibility and actual cases of misuse, we show that the quest for a "perfectly aligned" model inadvertently also provides malicious actors with an ever-improving tool for informational dominance. We need to discuss this dual-use potential now, as its risk is exacerbated by rapid user adoption of AI as information provider, economic power asymmetries, and a political landscape that increasingly shifts towards authoritarianism. We conclude by urging the community to consider the intentional misuse of AI alignment mechanisms and propose mitigation strategies to safeguard against this dual-use potential.
CommentsAccepted as oral paper at ICML 2026
Journal refProceedings of the 43rd International Conference on Machine Learning, Seoul, South Korea. PMLR 306, 2026
