Multimodal Large Language Models (MLLMs) have showcased impressive performance in a variety of multimodal tasks. On the other hand, the integration of additional image modality may allow the malicious users to inject harmful content inside the images for jailbreaking. Unlike text-based LLMs, where adversaries need to select discrete tokens to conceal their malicious intent using specific algorithms, the continuous nature of image signals provides a direct opportunity for adversaries to inject harmful intentions. In this work, we propose $\textbf{BaThe}$ ($\textbf{Ba}$ckdoor $\textbf{T}$rigger S$\textbf{h}$i$\textbf{e}$ld), a simple yet effective jailbreak defense mechanism. Our work is motivated by recent research on jailbreak backdoor attack and virtual prompt backdoor attack in generative language models. Jailbreak backdoor attack uses harmful instructions combined with manually crafted strings as triggers to make the backdoored model generate prohibited responses. We assume that harmful instructions can function as triggers, and if we alternatively set rejection responses as the triggered response, the backdoored model then can defend against jailbreak attacks. We achieve this by utilizing virtual rejection prompt, similar to the virtual prompt backdoor attack. We embed the virtual rejection prompt into the soft text embeddings, which we call ``wedge''. Our comprehensive experiments demonstrate that BaThe effectively mitigates various types of jailbreak attacks and is adaptable to defend against unseen attacks, with minimal impact on MLLMs' performance.
Mitigating Fine-tuning based Jailbreak Attack with Backdoor Enhanced Safety Alignment
University of Wisconsin-Madison（威斯康星大学麦迪逊分校）；University of Michigan-Ann Arbor（密歇根大学安娜堡分校）；Princeton University（普林斯顿大学）；University of California, Davis（加州大学戴维斯分校）；University of Chicago（芝加哥大学）
Compiling Activation Steering into Weights via Null-Space Constraints for Stealthy Backdoors
Zhejiang University（浙江大学）；Palo Alto Networks（帕洛阿尔托网络）；Ningbo Global Innovation Center, Zhejiang University（宁波全球创新中心，浙江大学）；OPPO Research Institute（OPPO研究院）；Qilu University of Technology（齐鲁大学）
Backdoor Attribution: Elucidating and Controlling Backdoor in Language Models
University of Science and Technology of China（中国科学技术大学）；Nanyang Technological University（南洋理工大学）；United Arab Emirates University（阿拉伯联合酋长国大学）；University of California San Diego（加州大学圣地亚哥分校）；Abel AI；National University of Singapore（新加坡国立大学）；Squirrel Ai Learning
Jailbreaking and Mitigation of Vulnerabilities in Large Language Models
Hunan University Changsha, PRC；Georgia Institute of Technology Atlanta, USA；Kyoto University Kyoto, Japan；Purdue University West Lafayette, USA；National Taiwan Normal University Taipei, ROC；University of Liverpool Suzhou, PRC；Hong Kong University of Science；University of Hawaii Honolulu, USA；The University of Texas at Dallas Dallas, USA；University of Wisconsin-Madison Madison, USA；Emory University Atlanta, USA；College of William \& Mary Williamsburg, USA
Safety in Embodied AI: A Survey of Risks, Attacks, and Defenses
Fudan University（复旦大学）；Shanghai Innovation Institute（上海创新研究院）；City University of Hong Kong（香港城市大学）；Jilin University（吉林大学）；Singapore Management University（新加坡管理大学）；Deakin University（德肯大学）；Tongji University（同济大学）；Nanyang Technological University（南洋理工大学）；Chinese Academy of Sciences（中国科学院）；The University of Melbourne（墨尔本大学）；Johns Hopkins University（约翰霍普金斯大学）
Safety at Scale: A Comprehensive Survey of Large Model and Agent Safety
Fudan University（复旦大学）；The University of Melbourne（墨尔本大学）；Singapore Management University（新加坡国立大学）；Deakin University（德肯大学）；Hong Kong University of Science and Technology（香港科学与技术大学）；City University of Hong Kong（香港城市大学）；University of Oxford（牛津大学）；Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳））；Shanghai Jiao Tong University（上海交通大学）；Nanyang Technological University（南洋理工大学）；The University of Sydney（悉尼大学）；Griffith University（格里菲斯大学）；University of California, Santa Cruz（加州大学圣克鲁兹分校）；Sea AI Lab（Sea AI实验室）；Tsinghua University（清华大学）；Virginia Tech（弗吉尼亚理工大学）；CISPA Helmholtz Center for Information Security（CISPA海德堡信息安全部）；University of Massachusetts Amherst（马萨诸塞大学阿姆赫斯特分校）；Purdue University（普渡大学）；Duke University（杜克大学）；University of Wisconsin - Madison（威斯康星大学麦迪逊分校）；RIKEN（理化学研究所）；The University of Tokyo（东京大学）
