Large language models (LLMs) have significantly enhanced the performance of numerous applications, from intelligent conversations to text generation. However, their inherent security vulnerabilities have become an increasingly significant challenge, especially with respect to jailbreak attacks. Attackers can circumvent the security mechanisms of these LLMs, breaching security constraints and causing harmful outputs. Focusing on multi-turn semantic jailbreak attacks, we observe that existing methods lack specific considerations for the role of multiturn dialogues in attack strategies, leading to semantic deviations during continuous interactions. Therefore, in this paper, we establish a theoretical foundation for multi-turn attacks by considering their support in jailbreak attacks, and based on this, propose a context-based contextual fusion black-box jailbreak attack method, named Context Fusion Attack (CFA). This method approach involves filtering and extracting key terms from the target, constructing contextual scenarios around these terms, dynamically integrating the target into the scenarios, replacing malicious key terms within the target, and thereby concealing the direct malicious intent. Through comparisons on various mainstream LLMs and red team datasets, we have demonstrated CFA's superior success rate, divergence, and harmfulness compared to other multi-turn attack strategies, particularly showcasing significant advantages on Llama3 and GPT-4.
Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs
The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））；Guangzhou HKUST Fok Ying Tung Research Institute（广州香港科技大学霍英东研究院）；The Hong Kong University of Science and Technology（香港科技大学）；AI Thrust（AI 方向）
EasyJailbreak: A Unified Framework for Jailbreaking Large Language Models
School of Computer Science, Fudan University（复旦大学计算机科学学院）；Shanghai AI Laboratory（上海人工智能实验室）；Institute of Modern Languages and Linguistics, Fudan University（复旦大学现代语言与语言学学院）
SafeDialBench: A Fine-Grained Safety Evaluation Benchmark for Large Language Models in Multi-Turn Dialogues with Diverse Jailbreak Attacks
National Key Laboratory for Novel Software Technology, Nanjing University（南京大学新型软件技术国家重点实验室）；University of Liverpool（利物浦大学）；City University of Hong Kong（香港城市大学）；School of Intelligence Science and Technology, Nanjing University（南京大学智能科学与技术学院）；China Mobile Research Institute（中国移动研究院）；China Mobile (Suzhou) Software Technology Co., Ltd（中国移动苏州软件技术有限公司）
Stealthy Jailbreak Attacks on Large Language Models via Benign Data Mirroring
Harbin Institute of Technology（哈尔滨工业大学）；Central South University（中南大学）；East China Normal University（华东师范大学）；Beihang University（北京航空航天大学）；LibrAI；MBZUAI；Tsinghua University（清华大学）
AdaPPA: Adaptive Position Pre-Fill Jailbreak Attack Approach Targeting LLMs
Institute of Information Engineering, Chinese Academy of Sciences（中国科学院信息工程研究所）；School of Cyber Security, University of Chinese Academy of Sciences（中国科学院大学网络空间安全学院）
Test-Time Immunization: A Universal Defense Framework Against Jailbreaks for (Multimodal) Large Language Models
NLPR & MAIS, Institute of Automation, Chinese Academy of Sciences（国家工程实验室与人工智能研究所，中国科学院）；School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院）
JailMeter: An Evidence-Based Evaluation Framework for Jailbreak Attacks on Large Language Models
Institute of Information Engineering, Chinese Academy of Sciences（中国科学院信息工程研究所）；University of Chinese Academy of Sciences（中国科学院大学）；Renmin University of China（中国人民大学）；Boston University（波士顿大学）
Adversarial Tuning: Defending Against Jailbreak Attacks for LLMs
AI Thrust（AI 部）；The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））；Guangzhou HKUST Fok Ying Tung Research Institute（广州香港科技大学霍英东研究院）；The Hong Kong University of Science and Technology（香港科技大学）
Scalable Defense against In-the-wild Jailbreaking Attacks with Safety Context Retrieval
School of EECS, Peking University（电子工程系，北京大学）；School of Mathematical Sciences, Peking University（数学系，北京大学）；State Key Lab of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University（通用人工智能国家重点实验室，智能科学与技术学校，北京大学）；Institute for Artificial Intelligence, Peking University（人工智能研究院，北京大学）
Jailbreaking Large Vision Language Models in Intelligent Transportation Systems
KFSCIS, Florida International University（凯斯-西储大学信息科学学院）；Knight Foundation School of Computing and Information Sciences（骑士基金会计算与信息科学学院）；Learning for InterDependent Networks Laboratory (solid lab)（依赖网络学习实验室）
JailbreakLens: Visual Analysis of Jailbreak Attacks Against Large Language Models
State Key Lab of CAD&CG, Zhejiang University（浙江大学CAD与计算机图形学国家重点实验室）；Laboratory of Art and Archaeology Image (Zhejiang University), Ministry of Education（浙江大学艺术与考古图像实验室（教育部））；Hangzhou City University（杭州市大学）；Zhejiang University（浙江大学）
