Recently, several works have been conducted on jailbreaking Large Language Models (LLMs) with few-shot malicious demos. In particular, Zheng et al. focus on improving the efficiency of Few-Shot Jailbreaking (FSJ) by injecting special tokens into the demos and employing demo-level random search, known as Improved Few-Shot Jailbreaking (I-FSJ). Nevertheless, we notice that this method may still require a long context to jailbreak advanced models e.g. 32 shots of demos for Meta-Llama-3-8B-Instruct (Llama-3) \cite{llama3modelcard}. In this paper, we discuss the limitations of I-FSJ and propose Self-Instruct Few-Shot Jailbreaking (Self-Instruct-FSJ) facilitated with the demo-level greedy search. This framework decomposes the FSJ attack into pattern and behavior learning to exploit the model's vulnerabilities in a more generalized and efficient way. We conduct elaborate experiments to evaluate our method on common open-source models and compare it with baseline algorithms. Our code is available at https://github.com/iphosi/Self-Instruct-FSJ.
Jailbreaking the Matrix: Nullspace Steering for Controlled Model Subversion
Department of Computer & Information Science & Engineering, University of Florida(佛罗里达大学计算机与信息科学与工程系);School of Computer Science, University of Oklahoma(俄克拉荷马大学计算机科学学院);Computer Science Laboratory, SRI International(SRI国际计算机科学实验室)
Making Them Ask and Answer: Jailbreaking Large Language Models in Few Queries via Disguise and Reconstruction
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);RealAI;Tsinghua University(清华大学)
PiCo: Jailbreaking Multimodal Large Language Models via Pictorial Code Contextualization
School of Artificial Intelligence, Wuhan University(武汉大学人工智能学院);School of Electronic and Computer Engineering, Peking University(北京大学电子与计算机工程学院);Beijing Academy of Artificial Intelligence(北京人工智能研究院)
Red-teaming the Multimodal Reasoning: Jailbreaking Vision-Language Models via Cross-modal Entanglement Attacks
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);People’s Public Security University of China(中国人民公安大学)
Chain-of-Jailbreak Attack for Image Generation Models via Editing Step by Step
Renmin University of China(中国人民大学);Chinese University of Hong Kong(香港大学);Chinese University of Hong Kong, Shenzhen(香港大学(深圳));Johns Hopkins University(约翰霍普金斯大学);Tencent(腾讯);Hong Kong University of Science and Technology(香港科技大学)
Jailbreaking Vision-Language Models Through the Visual Modality
Warsaw University of Technology(华沙理工大学);NASK National Research Institute(波兰国家研究研究院);University of Liverpool(利物浦大学);Indian Institute of Technology Roorkee(印度理工学院拉胡尔分校);Toyota Technological Institute at Chicago(芝加哥丰田技术研究所)
MIDAS: Multi-Image Dispersion and Semantic Reconstruction for Jailbreaking MLLMs
Beijing University of Posts and Telecommunications(北京邮电大学);Nanyang Technological University(南洋理工大学);Guilin University of Electronic Technology(桂林电子科技大学)
FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual Prompts
Tsinghua University(清华大学);Carnegie Mellon University(卡内基梅隆大学);Zhongguancun Laboratory(中关村实验室);National Financial Cryptography Research Center(国家金融密码学研究中心);Shandong Institute of Blockchain(山东区块链研究院);Shandong University(山东大学)
LLM Self-Correction with DeCRIM: Decompose, Critique, and Refine for Enhanced Following of Instructions with Multiple Constraints
Amazon AGI Foundations(亚马逊AGI基础研究院);Télécom Paris(巴黎电信学院);Institut Polytechnique de Paris(巴黎综合理工学院);UNC Chapel Hill(北卡罗来纳大学教堂山分校);University of California, Los Angeles(加利福尼亚大学洛杉矶分校)