Hide Your Malicious Goal Into Benign Narratives: Jailbreak Large Language Models through Carrier Articles
The Pennsylvania State University(宾夕法尼亚州立大学);Northern Arizona University(北亚利桑那大学);Worcester Polytechnic Institute(伍斯特理工学院);Carnegie Mellon University(卡内基梅隆大学)
Zhilong Wang, Haizhou Wang, Nanqing Luo, Lan Zhang, Xiaoyan Sun, Yebo Cao, Peng Liu
Large Language Model (LLM) jailbreak refers to a type of attack aimed to bypass the safeguard of an LLM to generate contents that are inconsistent with the safe usage guidelines. Based on the insights from the self-attention computation process, this paper proposes a novel blackbox jailbreak approach, which involves crafting the payload prompt by strategically injecting the prohibited query into a carrier article. The carrier article maintains the semantic proximity to the prohibited query, which is automatically produced by combining a hypernymy article and a context, both of which are generated from the prohibited query. The intuition behind the usage of carrier article is to activate the neurons in the model related to the semantics of the prohibited query while suppressing the neurons that will trigger the objectionable text. Carrier article itself is benign, and we leveraged prompt injection techniques to produce the payload prompt. We evaluate our approach using JailbreakBench, testing against four target models across 100 distinct jailbreak objectives. The experimental results demonstrate our method's superior effectiveness, achieving an average success rate of 63% across all target models, significantly outperforming existing blackbox jailbreak methods.
School of Information Management, Wuhan University(武汉大学信息管理学院);Nanyang Technological University(南洋理工大学);Torr Vision Group, University of Oxford(牛津大学Torr视觉组)
DELMAN: Dynamic Defense Against Large Language Model Jailbreaking with Model Editing
ShanghaiTech University(上海科技大学);The State Key Laboratory of Blockchain and Data Security, Zhejiang University(浙江大学区块链与数据安全全国重点实验室);The CoAI group, Tsinghua University(清华大学CoAI课题组)
Stealthy Jailbreak Attacks on Large Language Models via Benign Data Mirroring
Harbin Institute of Technology(哈尔滨工业大学);Central South University(中南大学);East China Normal University(华东师范大学);Beihang University(北京航空航天大学);LibrAI;MBZUAI;Tsinghua University(清华大学)
Bleeding Pathways: Vanishing Discriminability in LLM Hidden States Fuels Jailbreak Attacks
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络安全学院);Ant Group(蚂蚁集团)
EVA: Editing for Versatile Alignment against Jailbreaks
ShanghaiTech University(上海科技大学);Sun Yat-sen University(中山大学);State Key Laboratory of Blockchain and Data Security(区块链与数据安全国家重点实验室);Tsinghua University(清华大学)
AdaShield: Safeguarding Multimodal Large Language Models from Structure-based Attack via Adaptive Shield Prompting
Peking University(北京大学);University of Wisconsin–Madison(威斯康星大学麦迪逊分校);International Digital Economy Academy(国际数字经济学院);University of California Davis(加州大学戴维斯分校)
SAID: Safety-Aware Intent Defense via Prefix Probing for Large Language Models
Shenzhen Key Laboratory of Visual Object Detection and Recognition, Harbin Institute of Technology, Harbin Institute of Technology, Shenzhen, Shenzhen, China(深圳视觉目标检测与识别重点实验室,哈尔滨工业大学,哈尔滨工业大学,深圳,深圳,中国)
CCFC: Core & Core-Full-Core Dual-Track Defense for LLM Jailbreak Protection
Department. of Math & Statistics, Boston University(数学与统计学系,波士顿大学);Department. of Computer Science, University at Albany(计算机科学系,阿尔巴尼大学);Department. of ECE & Systems Eng., Department. of Biomedical Eng., Faculty of Computing & Data Sciences, Boston University(电子工程与系统工程系,生物医学工程系,计算与数据科学学院,波士顿大学)
HE-Guardrail: A Homomorphic Guardrail Against Jailbreak Attacks for Encrypted Large Language Model Inference
Pohang University of Science and Technology (POSTECH)(浦项科技大学);Inha University(仁荷大学);Daegu Gyeongbuk Institute of Science and Technology (DGIST)(大邱庆北科学技术院)
Jailbreaking Vision-Language Models Through the Visual Modality
Warsaw University of Technology(华沙理工大学);NASK National Research Institute(波兰国家研究研究院);University of Liverpool(利物浦大学);Indian Institute of Technology Roorkee(印度理工学院拉胡尔分校);Toyota Technological Institute at Chicago(芝加哥丰田技术研究所)
Graph-Regularized Sparse Autoencoders for LLM Safety Steering
ELLIS Institute Tübingen(图宾根ELLIS研究所);Max Planck Institute for Intelligent Systems(智能系统马克斯·普朗克研究所);Intesa Sanpaolo(Intesa Sanpaolo公司);University of Southern California(南加州大学)