Large language models (LLMs), known for their capability in understanding and following instructions, are vulnerable to adversarial attacks. Researchers have found that current commercial LLMs either fail to be "harmless" by presenting unethical answers, or fail to be "helpful" by refusing to offer meaningful answers when faced with adversarial queries. To strike a balance between being helpful and harmless, we design a moving target defense (MTD) enhanced LLM system. The system aims to deliver non-toxic answers that align with outputs from multiple model candidates, making them more robust against adversarial attacks. We design a query and output analysis model to filter out unsafe or non-responsive answers. %to achieve the two objectives of randomly selecting outputs from different LLMs. We evaluate over 8 most recent chatbot models with state-of-the-art adversarial queries. Our MTD-enhanced LLM system reduces the attack success rate from 37.5\% to 0\%. Meanwhile, it decreases the response refusal rate from 50\% to 0\%.
SafeSteer: Adaptive Subspace Steering for Efficient Jailbreak Defense in Vision-Language Models
Nanjing University of Science and Technology(南京理工大学);School of Cyber Science and Engineering, Nanjing University of Science and Technology(南京理工大学网络空间安全学院);Nanyang Technological University(南洋理工大学);National University of Singapore(新加坡国立大学)
Jailbreaking LLMs & VLMs: Mechanisms, Evaluation, and Unified Defense
School of Cyberspace Security, Beijing University of Posts and Telecommunications(北京邮电大学网络空间安全学院);China Academy of Information and Communications Technology(中国信息通信研究院)
TeleAI-Safety: A comprehensive LLM jailbreaking benchmark towards attacks, defenses, and evaluations
Institute of Artificial Intelligence (TeleAI) of China Telecom(中国电信人工智能研究院(TeleAI));Shanghai Jiao Tong University(上海交通大学);Sichuan University(四川大学);University of Chinese Academy of Sciences(中国科学院大学);Chinese Academy of Sciences(中国科学院);University of Science and Technology of China(中国科学技术大学);Peking University(北京大学);Harbin Institute of Technology(哈尔滨工业大学)
Fine-Tuning Jailbreaks under Highly Constrained Black-Box Settings: A Three-Pronged Approach
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络安全学院);State Key Laboratory of Cyberspace Security Defense(网络空间安全防御全国重点实验室)
Test-Time Immunization: A Universal Defense Framework Against Jailbreaks for (Multimodal) Large Language Models
NLPR & MAIS, Institute of Automation, Chinese Academy of Sciences(国家工程实验室与人工智能研究所,中国科学院);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
DELMAN: Dynamic Defense Against Large Language Model Jailbreaking with Model Editing
ShanghaiTech University(上海科技大学);The State Key Laboratory of Blockchain and Data Security, Zhejiang University(浙江大学区块链与数据安全全国重点实验室);The CoAI group, Tsinghua University(清华大学CoAI课题组)
DoubtProbe: Black-Box Jailbreak Defense via Structural Verification and Semantic Auditing
East China Normal University(东华大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所)
DARWIN: Evolving Jailbreak Adversary and Guardrail for LLM Safety Evaluation and Protection
The State Key Laboratory of Blockchain and Data Security, Zhejiang University(浙江大学区块链与数据安全全国重点实验室);Hangzhou High-Tech Zone (Binjiang) Institute of Blockchain and Data Security(杭州高新技术开发区(滨江)区块链与数据安全研究所);Shanghai AI Laboratory(上海人工智能实验室);East China Normal University(华东师范大学)
Enhancing Model Defense Against Jailbreaks with Proactive Safety Reasoning
School of Computing(计算学院);National University of Singapore(新加坡国立大学);School of Computer Science and Engineering(计算机科学与工程学院);Nanyang Technological University(南洋理工大学);Department of Computing(计算系);The Hong Kong Polytechnic University(香港理工大学)
Data to Defense: The Role of Curation in Customizing LLMs Against Jailbreaking Attacks
Stony Brook University(石溪大学);Binghamton University(宾汉姆顿大学);University of Iowa(爱荷华大学);Dartmouth College(达特茅斯学院);Georgia Institute of Technology(佐治亚理工学院)
GUARD-SLM: Token Activation-Based Defense Against Jailbreak Attacks for Small Language Models
Knight Foundation School of Computing and Information Sciences(奈特基金会计算与信息科学学院);Security, Optimization, and Learning for InterDependent networks laboratory (solid lab)(安全、优化与相互依赖网络学习实验室);Florida International University(佛罗里达国际大学)
CCFC: Core & Core-Full-Core Dual-Track Defense for LLM Jailbreak Protection
Department. of Math & Statistics, Boston University(数学与统计学系,波士顿大学);Department. of Computer Science, University at Albany(计算机科学系,阿尔巴尼大学);Department. of ECE & Systems Eng., Department. of Biomedical Eng., Faculty of Computing & Data Sciences, Boston University(电子工程与系统工程系,生物医学工程系,计算与数据科学学院,波士顿大学)
Scalable Defense against In-the-wild Jailbreaking Attacks with Safety Context Retrieval
School of EECS, Peking University(电子工程系,北京大学);School of Mathematical Sciences, Peking University(数学系,北京大学);State Key Lab of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University(通用人工智能国家重点实验室,智能科学与技术学校,北京大学);Institute for Artificial Intelligence, Peking University(人工智能研究院,北京大学)
Latent-space adversarial training with post-aware calibration for defending large language models against jailbreak attacks
Lab of Artificial Intelligence for Education, East China Normal University, Shanghai 200062, China(教育人工智能实验室,东华大学,上海200062,中国);Shanghai Institute of Artificial Intelligence for Education, East China Normal University, Shanghai 200062, China(教育人工智能研究所,东华大学,上海200062,中国);School of Computer Science and Technology, East China Normal University, Shanghai 200062, China(计算机科学与技术学院,东华大学,上海200062,中国)
SelfDefend: LLMs Can Defend Themselves against Jailbreaking in a Practical Manner
The Hong Kong University of Science and Technology(香港科技大学);University of Oregon(俄勒冈大学);Nanyang Technological University(南洋理工大学);City University of Hong Kong(香港城市大学);HSBC(汇丰银行)
SafePTR: Token-Level Jailbreak Defense in Multimodal LLMs via Prune-then-Restore Mechanism
Shenzhen Institute for Advanced Study, University of Electronic Science and Technology of China(电子科技大学深圳研究院);Southwestern University of Finance and Economics(西南财经大学);Engineering Research Center of Intelligent Finance, Ministry of Education(教育部智能金融工程研究中心);Tongji University(同济大学)