Invisible to Humans, Triggered by Agents: Stealthy Jailbreak Attacks on Mobile Vision-Language Agents
School of Computer Science, Huazhong University of Science and Technology(华中科技大学计算机科学与技术学院);Dept. of Comp. Sci. and Tech., Institute for AI, Tsinghua-Bosch Joint ML Center, THBI Lab, BNRist Center, Tsinghua University(清华大学计算机科学与技术系、人工智能研究院、清华-博世机器学习联合中心、清华脑与智能实验室、北京国家信息科学与技术研究中心)
Renhua Ding, Xiao Yang, Zhengwei Fang, Jun Luo, Kun He, Jun Zhu
Large Vision-Language Models (LVLMs) empower autonomous mobile agents, yet their security under realistic mobile deployment constraints remains underexplored. While agents are vulnerable to visual prompt injections, stealthily executing such attacks without requiring system-level privileges remains challenging, as existing methods rely on persistent visual manipulations that are noticeable to users. We uncover a consistent discrepancy between human and agent interactions: automated agents generate near-zero contact touch signals. Building on this insight, we propose a new attack paradigm, agent-only perceptual injection, where malicious content is exposed only during agent interactions, while remaining not readily perceived by human users. To accommodate mobile UI constraints and one-shot interaction settings, we introduce HG-IDA*, an efficient one-shot optimization method for constructing jailbreak prompts that evade LVLM safety filters. Experiments demonstrate that our approach induces unauthorized cross-app actions, achieving 82.5% planning and 75.0% execution hijack rates on GPT-4o. Our findings highlight a previously underexplored attack surface in mobile agent systems and underscore the need for defenses that incorporate interaction-level signals.
The Fluorescent Veil: A Stealthy and Effective Physical Adversarial Patch Against Traffic Sign Recognition
University of Electronic Science and Technology of China(电子科学与技术大学);Nanjing University of Aeronautics and Astronautics(南京航空航天大学);City University of Hong Kong(香港城市大学);King Abdullah University of Science and Technology(卡布斯大学)
WebWeaver: Breaking Topology Confidentiality in LLM Multi-Agent Systems with Stealthy Context-Based Inference
Department of Electrical and Computer Engineering, Stevens Institute of Technology(斯蒂文斯理工学院电气与计算机工程系);Genentech(基因泰克);Department of Electrical and Computer Engineering, University of Houston(休斯顿大学电气与计算机工程系)
Engineering Programme, NUS Graduate School, National University of Singapore(国立新加坡大学整合科学与工程计划);Institute of Data Science (IDS), National University of Singapore(国立新加坡大学数据科学研究所);Department of Computer Science, School of Computing, National University of Singapore(国立新加坡大学计算机科学系)
Compiling Activation Steering into Weights via Null-Space Constraints for Stealthy Backdoors
Zhejiang University(浙江大学);Palo Alto Networks(帕洛阿尔托网络);Ningbo Global Innovation Center, Zhejiang University(宁波全球创新中心,浙江大学);OPPO Research Institute(OPPO研究院);Qilu University of Technology(齐鲁大学)
HE-Guardrail: A Homomorphic Guardrail Against Jailbreak Attacks for Encrypted Large Language Model Inference
Pohang University of Science and Technology (POSTECH)(浦项科技大学);Inha University(仁荷大学);Daegu Gyeongbuk Institute of Science and Technology (DGIST)(大邱庆北科学技术院)
GhostEncoder: Stealthy Backdoor Attacks with Dynamic Triggers to Pre-trained Encoders in Self-supervised Learning
Nanjing University of Aeronautics and Astronautics(南京航空航天大学);Nanjing University of Aeronautics and Astronautics Shenzhen Research Institute(南京航空航天大学深圳研究院);Zhejiang Lab(之江实验室);Wuhan University(武汉大学);Xi’an Jiaotong University(西安交通大学)
Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);The State Key Laboratory of Blockchain and Data Security, Zhejiang University(浙江大学区块链与数据安全国家重点实验室);College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算与数据科学学院);School of Computer Science, Wuhan University(武汉大学计算机学院);Tencent Data Platform(腾讯数据平台);Research Center of Artificial Intelligence, Peng Cheng Laboratory(鹏城实验室人工智能研究中心);School of Cyber Science and Engineering, Wuhan University(武汉大学网络安全学院)
Invisible for both Camera and LiDAR: Security of Multi-Sensor Fusion based Perception in Autonomous Driving Under Physical-World Attacks
University of Michigan(密歇根大学);NVIDIA Research(英伟达研究院);Arizona State University(亚利桑那州立大学);Inceptio(嬴彻科技);Baidu Research(百度研究院);National Engineering Laboratory of Deep Learning Technology and Application(深度学习技术及应用国家工程实验室);University of California, Irvine(加州大学欧文分校);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)