内在之狼:通过MLLM特工将恶意隐蔽注入MLLM社会
The Wolf Within: Covert Injection of Malice into MLLM Societies via an MLLM Operative
AI总结:
本文揭示了MLLM社会中恶意内容间接传播的新漏洞,展示了单个被操纵的MLLM智能体如何生成提示感染其他智能体并传播有害输出,强调了开发检测与缓解机制的紧迫性。
摘要:
由于在处理和响应各种类型数据方面具有前所未有的能力,多模态大语言模型(MLLMs)正在不断界定通用人工智能(AGI)的新边界。随着这些先进的生成模型日益形成用于复杂任务的协作网络,这些系统的完整性和安全性变得至关重要。我们的论文《内在之狼》探讨了MLLM社会中的一种新型漏洞——恶意内容的间接传播。与直接为MLLM生成有害输出不同,我们的研究展示了如何巧妙地影响单个MLLM智能体生成提示,进而诱导该社会中的其他MLLM智能体输出恶意内容。我们的发现表明,当MLLM智能体被操纵产生特定提示或指令时,它能有效地“感染”MLLM社会内的其他智能体。这种感染会导致在整个社会中生成并传播有害输出,例如危险指令或虚假信息。我们还展示了这些间接生成提示的可转移性,突显了它们通过智能体间通信传播恶意行为的可能性。本研究为MLLM构成的新维度威胁提供了关键洞察,其中单个智能体可成为广泛恶意影响的催化剂。我们的工作强调了迫切需要开发稳健机制来检测和缓解MLLM社会中的此类隐蔽操纵,确保其在社会应用中的安全与合乎伦理的使用。
英文摘要:
Due to their unprecedented ability to process and respond to various types of data, Multimodal Large Language Models (MLLMs) are constantly defining the new boundary of Artificial General Intelligence (AGI). As these advanced generative models increasingly form collaborative networks for complex tasks, the integrity and security of these systems are crucial. Our paper, ``The Wolf Within'', explores a novel vulnerability in MLLM societies - the indirect propagation of malicious content. Unlike direct harmful output generation for MLLMs, our research demonstrates how a single MLLM agent can be subtly influenced to generate prompts that, in turn, induce other MLLM agents in the society to output malicious content. Our findings reveal that, an MLLM agent, when manipulated to produce specific prompts or instructions, can effectively ``infect'' other agents within a society of MLLMs. This infection leads to the generation and circulation of harmful outputs, such as dangerous instructions or misinformation, across the society. We also show the transferability of these indirectly generated prompts, highlighting their possibility in propagating malice through inter-agent communication. This research provides a critical insight into a new dimension of threat posed by MLLMs, where a single agent can act as a catalyst for widespread malevolent influence. Our work underscores the urgent need for developing robust mechanisms to detect and mitigate such covert manipulations within MLLM societies, ensuring their safe and ethical utilization in societal applications.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。