As large language models(LLMs) become commonplace in practical applications, the security issues of LLMs have attracted societal concerns. Although extensive efforts have been made to safety alignment, LLMs remain vulnerable to jailbreak attacks. We find that redundant computations limit the performance of existing jailbreak attack methods. Therefore, we propose DPP-based Stochastic Trigger Searching (DSTS), a new optimization algorithm for jailbreak attacks. DSTS incorporates diversity guidance through techniques including stochastic gradient search and DPP selection during optimization. Detailed experiments and ablation studies demonstrate the effectiveness of the algorithm. Moreover, we use the proposed algorithm to compute the risk boundaries for different LLMs, providing a new perspective on LLM safety evaluation.
ForgeDAN: An Evolutionary Framework for Jailbreaking Aligned Large Language Models
iFLYTEK Security Laboratory(iFLYTEK安全实验室);Anhui SparkShield Intelligent Technology Co., Ltd.(安徽SparkShield智能科技有限公司);Peking University(北京大学);School of Automation, University of Electronic Science and Technology of China(电子科技大学自动化学院);Northwest University(西北大学);University of New South Wales(新南威尔士大学);National Computer Network Emergency Response Technical Team/Coordination Center of China(中国国家计算机网络应急技术处置协调中心)
How Real is Your Jailbreak? Fine-grained Jailbreak Evaluation with Anchored Reference
Key Laboratory of Trustworthy Distributed Computing(可信分布式计算重点实验室);Service Beijing University of Posts(北京邮电大学);Artificial Intelligence Research Institute China Academy of Information(人工智能研究所信息与通信技术 academy)
School of Computer Science and Technology, Guangdong University of Technology(广东工业大学计算机科学与技术学院);School of Computer Science and Intelligence Education, Lingnan Normal University(岭南师范学院计算机与智能教育学院);College of Computer, National University of Defense Technology(国防科技大学计算机学院);School of Information Science and Technology, Guangdong University of Foreign Studies(广东外语外贸大学信息科学与技术学院)
X-Teaming: Multi-Turn Jailbreaks and Defenses with Adaptive Multi-Agents
University of California, Los Angeles(加州大学洛杉矶分校);University of Washington(华盛顿大学);Qatar Computing Research Institute(卡塔尔计算研究所);Google(谷歌);Stanford University(斯坦福大学)
Mass-Scale Analysis of In-the-Wild Conversations Reveals Complexity Bounds on LLM Jailbreaking
Valencian Research Institute for Artificial Intelligence (VRAIN), Universitat Politècnica de València, Valencia, Spain.(瓦伦西亚人工智能研究 institute,瓦伦西亚理工大学,西班牙瓦伦西亚);Department of Computer Science, The University of Chicago, Chicago, USA(计算机科学系,芝加哥大学,美国芝加哥);Center for Automation and Robotics, Spanish National Research Council, Madrid, Spain(自动化与机器人中心,西班牙国家研究委员会,西班牙马德里)
Steering Language Generation: Harnessing Contrastive Expert Guidance and Negative Prompting for Coherent and Diverse Synthetic Data Generation
Mathematical Sciences Institute, Australian National University(澳大利亚国立大学数学科学研究所);Research School of Astronomy & Astrophysics, Australian National University(澳大利亚国立大学天文与天体物理研究学院);School of Computing, Australian National University(澳大利亚国立大学计算学院);Department of Astronomy, The Ohio State University(俄亥俄州立大学天文学系)
Jailbreak-as-a-Service++: Unveiling Distributed AI-Driven Malicious Information Campaigns Powered by LLM Crowdsourcing
Institute of Computing Technology, CAS(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);China People’s Public Security University(中国人民公安大学);Tongji University(同济大学);South China Normal University(华南师范大学);Tsing Hua University(清华大学)
Selective Expert Guidance for Effective and Diverse Exploration in Reinforcement Learning of LLMs
School of Data Science, Fudan University(复旦大学数据科学学院);Shanghai Institute of Artificial Intelligence for Education, East China Normal University(华东师范大学上海智能教育研究院);College of Computer Science and Artificial Intelligence, Fudan University(复旦大学计算机科学与技术学院);Ant Group(蚂蚁集团)