Extensive efforts have been made before the public release of Large language models (LLMs) to align their behaviors with human values. However, even meticulously aligned LLMs remain vulnerable to malicious manipulations such as jailbreaking, leading to unintended behaviors. In this work, we propose a novel black-box jailbreak framework for automated red teaming of LLMs. We designed malicious content concealing and memory reframing with an iterative optimization algorithm to jailbreak LLMs, motivated by the research about the distractibility and over-confidence phenomenon of LLMs. Extensive experiments of jailbreaking both open-source and proprietary LLMs demonstrate the superiority of our framework in terms of effectiveness, scalability and transferability. We also evaluate the effectiveness of existing jailbreak defense methods against our attack and highlight the crucial need to develop more effective and practical defense strategies.
Jailbreaking for the Average Jane: Choosing Optimal Jailbreaks via Bandit Algorithms for Automatically Enhanced Queries
Centre for Machine Intelligence and Data Science, IIT Bombay（印度理工学院班加罗尔机器智能与数据科学中心）；Department of Computer Science and Engineering, IIT Bombay（印度理工学院班加罗尔计算机科学与工程系）
CCFC: Core & Core-Full-Core Dual-Track Defense for LLM Jailbreak Protection
Department. of Math & Statistics, Boston University（数学与统计学系，波士顿大学）；Department. of Computer Science, University at Albany（计算机科学系，阿尔巴尼大学）；Department. of ECE & Systems Eng., Department. of Biomedical Eng., Faculty of Computing & Data Sciences, Boston University（电子工程与系统工程系，生物医学工程系，计算与数据科学学院，波士顿大学）
SeqAR: Jailbreak LLMs with Sequential Auto-Generated Characters
Shanghai University of Finance and Economics（上海财经大学）；Southern University of Science and Technology（南方科技大学）；Ant Group（蚂蚁集团）；The Chinese University of Hong Kong（香港中文大学）
Adversarial Tuning: Defending Against Jailbreak Attacks for LLMs
AI Thrust（AI 部）；The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））；Guangzhou HKUST Fok Ying Tung Research Institute（广州香港科技大学霍英东研究院）；The Hong Kong University of Science and Technology（香港科技大学）
JailbreakLens: Visual Analysis of Jailbreak Attacks Against Large Language Models
State Key Lab of CAD&CG, Zhejiang University（浙江大学CAD与计算机图形学国家重点实验室）；Laboratory of Art and Archaeology Image (Zhejiang University), Ministry of Education（浙江大学艺术与考古图像实验室（教育部））；Hangzhou City University（杭州市大学）；Zhejiang University（浙江大学）
Hide Your Malicious Goal Into Benign Narratives: Jailbreak Large Language Models through Carrier Articles
The Pennsylvania State University（宾夕法尼亚州立大学）；Northern Arizona University（北亚利桑那大学）；Worcester Polytechnic Institute（伍斯特理工学院）；Carnegie Mellon University（卡内基梅隆大学）
AutoDAN-Turbo: A Lifelong Agent for Strategy Self-Exploration to Jailbreak LLMs
University of Wisconsin–Madison（威斯康星大学麦迪逊分校）；NVIDIA（NVIDIA公司）；Cornell University（康奈尔大学）；Washington University, St. Louis（圣路易斯华盛顿大学）；University of Michigan, Ann Arbor（安娜堡大学）；The Ohio State University（俄亥俄州立大学）；UIUC（伊利诺伊大学厄巴纳-香槟分校）
Medical large language models are easily distracted
NYU Langone Medical Center（纽约大学朗格尼医学中心）；The University of Texas at Austin（德克萨斯大学奥斯汀分校）；Washington University School of Medicine in St. Louis（圣路易斯华盛顿大学医学院）；New York University（纽约大学）
Exploiting the Index Gradients for Optimization-Based Jailbreaking on Large Language Models
School of Computer Science and Technology, Soochow University（苏州大学计算机科学与技术学院）；Dept. Computing Science, Alberta Machine Intelligence Institute (Amii)（阿尔伯塔大学计算科学系、阿尔伯塔机器智能研究所）；University of Alberta（阿尔伯塔大学）；Tencent（腾讯）
GUARD: Role-playing to Generate Natural-language Jailbreakings to Test Guideline Adherence of Large Language Models
School of Information Sciences University of Illinois at Urbana-Champaign（信息科学学院伊利诺伊大学厄巴纳-香槟分校）；Independent Researcher, Starc Institute（Starc研究所独立研究者）；Computer Science and Engineering HKUST（HKUST计算机科学与工程学院）；Computer Science Lapis Labs University of Illinois Urbana-Champaign（计算机科学Lapis Labs伊利诺伊大学厄巴纳-香槟分校）；School of Information Sciences University of Illinois Urbana-Champaign（信息科学学院伊利诺伊大学厄巴纳-香槟分校）
Jailbreaking Vision-Language Models Through the Visual Modality
Warsaw University of Technology（华沙理工大学）；NASK National Research Institute（波兰国家研究研究院）；University of Liverpool（利物浦大学）；Indian Institute of Technology Roorkee（印度理工学院拉胡尔分校）；Toyota Technological Institute at Chicago（芝加哥丰田技术研究所）
