大模型对齐与安全

Data to Defense: The Role of Curation in Customizing LLMs Against Jailbreaking Attacks

Xiaoqun Liu, Jiacheng Liang, Luoxi Tang, Muchao Ye, Weicheng Ma, Zhaohan Xi

专题命中 越狱攻击 ：jailbreak(abstract)；分类 cs.AI

G-Safeguard: A Topology-Guided Security Lens and Treatment on LLM-based Multi-agent Systems

Shilong Wang, Guibin Zhang, Miao Yu, Guancheng Wan, Fanci Meng, Chongye Guo, Kun Wang, Yang Wang

专题命中 越狱攻击 ：prompt injection(abstract)；分类 cs.LG

Prompt Inject Detection with Generative Explanation as an Investigative Tool

Jonathan Pan, Swee Liang Wong, Yidi Yuan, Xin Wei Chia

专题命中 越狱攻击 ：jailbreak(abstract)；分类 cs.AI

Comments 5 pages, 4 tables, 3 diagrams

Self-Instruct Few-Shot Jailbreaking: Decompose the Attack into Pattern and Behavior Learning

Jiaqi Hua, Wanxu Wei

专题命中 越狱攻击 ：jailbreak(abstract)；分类 cs.AI

Unleashing Worms and Extracting Data: Escalating the Outcome of Attacks against RAG-based Inference in Scale and Severity Using Jailbreaking

Stav Cohen, Ron Bitton, Ben Nassi

专题命中 越狱攻击 ：jailbreak(abstract)；分类 cs.AI

Comments for Github, see https://github.com/StavC/UnleashingWorms-ExtractingData . arXiv admin note: substantial text overlap with arXiv:2403.02817

Learning-based Detection of GPS Spoofing Attack for Quadrotors

Pengyu Wang, Zhaohua Yang, Jialu Li, Ling Shi

专题命中 越狱攻击 ：safety(abstract)；分类 cs.LG

Comments Accepted in IEEE Industrial Electronics Society Annual Online Conference

Jailbreaking? One Step Is Enough!

Weixiong Zheng, Peijian Zeng, Yiwei Li, Hongyan Wu, Nankai Lin, Junhao Chen, Aimin Yang, Yongmei Zhou

专题命中 越狱攻击 ：jailbreak(abstract)；分类 cs.CL

Comments 17 pages

Targeting the Core: A Simple and Effective Method to Attack RAG-based Agents via Direct LLM Manipulation

Xuying Li, Zhuo Li, Yuji Kosuga, Yasuhiro Yoshida, Victor Bian

专题命中 越狱攻击 ：safety(abstract)；分类 cs.AI

Recent Advances in Attack and Defense Approaches of Large Language Models

Jing Cui, Yishi Xu, Zhewei Huang, Shuchang Zhou, Jianbin Jiao, Junge Zhang

专题命中 越狱攻击 ：safety(abstract)；分类 cs.AI

Harnessing LLM to Attack LLM-Guarded Text-to-Image Models

Yimo Deng, Huangxun Chen

专题命中 越狱攻击 ：safety(abstract)；分类 cs.AI

Comments 10 pages, 7 figures, under review

Insights and Current Gaps in Open-Source LLM Vulnerability Scanners: A Comparative Analysis

Jonathan Brokman, Omer Hofman, Oren Rachmil, Inderjeet Singh, Vikas Pahuja, Rathina Sabapathy Aishvariya Priya, Amit Giloni, Roman Vainshtein, Hisashi Kojima

专题命中 越狱攻击 ：jailbreak(abstract)；分类 cs.LG

Comments 15 pages, 11 figures

Seeing is Deceiving: Exploitation of Visual Pathways in Multi-Modal Language Models

Pete Janowczyk, Linda Laurier, Ave Giulietta, Arlo Octavia, Meade Cleti

专题命中 越狱攻击 ：safety(abstract)；分类 cs.AI

Accelerating Greedy Coordinate Gradient and General Prompt Optimization via Probe Sampling

Yiran Zhao, Wenyue Zheng, Tianle Cai, Xuan Long Do, Kenji Kawaguchi, Anirudh Goyal, Michael Shieh

专题命中 越狱攻击 ：safety(abstract)；分类 cs.CL

Persistent Pre-Training Poisoning of LLMs

Yiming Zhang, Javier Rando, Ivan Evtimov, Jianfeng Chi, Eric Michael Smith, Nicholas Carlini, Florian Tramèr, Daphne Ippolito

专题命中 越狱攻击 ：DPO(abstract)；分类 cs.AI

Transforming In-Vehicle Network Intrusion Detection: VAE-based Knowledge Distillation Meets Explainable AI

Muhammet Anil Yagiz, Pedram MohajerAnsari, Mert D. Pese, Polat Goktas

专题命中 越狱攻击 ：trustworthy(abstract)；分类 cs.AI

Hallucinating AI Hijacking Attack: Large Language Models and Malicious Code Recommenders

David Noever, Forrest McKee

专题命中 越狱攻击 ：safety(abstract)；分类 cs.AI

Attention Shift: Steering AI Away from Unsafe Content

Shivank Garg, Manyana Tiwari

专题命中 越狱攻击 ：jailbreak(abstract)；分类 cs.LG

Revisiting Who's Harry Potter: Towards Targeted Unlearning from a Causal Intervention Perspective

Yujian Liu, Yang Zhang, Tommi Jaakkola, Shiyu Chang

专题命中 越狱攻击 ：jailbreak(abstract)；分类 cs.CL

Safeguarding Vision-Language Models Against Patched Visual Prompt Injectors

Jiachen Sun, Changsheng Wang, Jiongxiao Wang, Yiwei Zhang, Chaowei Xiao

专题命中 越狱攻击 ：prompt injection(abstract)；分类 cs.AI

Comments 15 pages

Malla: Demystifying Real-world Large Language Model Integrated Malicious Services

Zilong Lin, Jian Cui, Xiaojing Liao, XiaoFeng Wang

专题命中 越狱攻击 ：jailbreak(abstract)；分类 cs.AI

Comments Accepted at the 33rd USENIX Security Symposium (USENIX Security '24). The data and code are available at https://github.com/idllresearch/malicious-gpt

A Jailbroken GenAI Model Can Cause Substantial Harm: GenAI-powered Applications are Vulnerable to PromptWares

Stav Cohen, Ron Bitton, Ben Nassi

专题命中 越狱攻击 ：jailbreak(abstract)；分类 cs.AI

Comments Website, see https://sites.google.com/view/promptware

Human-Interpretable Adversarial Prompt Attack on Large Language Models with Situational Context

Nilanjana Das, Edward Raff, Manas Gaur

专题命中 越狱攻击 ：prompt injection(abstract)；分类 cs.CL

Defending Large Language Models Against Jailbreaking Attacks Through Goal Prioritization

Zhexin Zhang, Junxiao Yang, Pei Ke, Fei Mi, Hongning Wang, Minlie Huang

专题命中 越狱攻击 ：safety(abstract)；分类 cs.CL

Comments ACL 2024 Main Conference

Compositional Curvature Bounds for Deep Neural Networks

Taha Entesari, Sina Sharifi, Mahyar Fazlyab

专题命中 越狱攻击 ：safety(abstract)；分类 cs.LG

Comments Proceedings of the 41 st International Conference on Machine Learning (ICML 2024)

Transferable Availability Poisoning Attacks

Yiyong Liu, Michael Backes, Xiao Zhang

专题命中 越狱攻击 ：alignment(abstract)；分类 cs.LG

BruSLeAttack: A Query-Efficient Score-Based Black-Box Sparse Adversarial Attack

Viet Quoc Vo, Ehsan Abbasnejad, Damith C. Ranasinghe

专题命中 越狱攻击 ：safety(abstract)；分类 cs.LG

Comments Published as a conference paper at the International Conference on Learning Representations (ICLR 2024). Code is available at https://brusliattack.github.io/

Robust Collaborative Perception without External Localization and Clock Devices

Zixing Lei, Zhenyang Ni, Ruize Han, Shuo Tang, Dingju Wang, Chen Feng, Siheng Chen, Yanfeng Wang

专题命中 越狱攻击 ：alignment(abstract)；分类 cs.AI

Comments 6pages, accepted to ICRA 2024

Revisiting the Robust Generalization of Adversarial Prompt Tuning

Fan Yang, Mingxuan Xia, Sangzhou Xia, Chicheng Ma, Hui Hui

专题命中 越狱攻击 ：alignment(abstract)；分类 cs.AI

Can LLMs Deeply Detect Complex Malicious Queries? A Framework for Jailbreaking via Obfuscating Intent

Shang Shang, Xinqiang Zhao, Zhongjiang Yao, Yepeng Yao, Liya Su, Zijing Fan, Xiaodan Zhang, Zhengwei Jiang

专题命中 越狱攻击 ：jailbreak(abstract)；分类 cs.AI

SoK: On the Semantic AI Security in Autonomous Driving

Junjie Shen, Ningfei Wang, Ziwen Wan, Yunpeng Luo, Takami Sato, Zhisheng Hu, Xinyang Zhang, Shengjian Guo, Zhenyu Zhong, Kang Li, Ziming Zhao, Chunming Qiao, Qi Alfred Chen

专题命中 越狱攻击 ：safety(abstract)；分类 cs.AI

Comments Project website: https://sites.google.com/view/cav-sec/pass