`From Prompt to Perturbation': An Adaptive Framework for Voice-Based Jailbreaks on Audio LLMs
School of Electrical and Computer Engineering, The University of Sydney(悉尼大学电气与计算机工程学院);University of Chicago(芝加哥大学);University of Texas at San Antonio(德克萨斯大学圣安东尼奥分校)
Linghan Huang, Bo Li, Huaming Chen, Kim-Kwang Raymond Choo
备注:
Accepted at the IEEE International Conference on Data Mining (ICDM 2026)
As large language models (LLMs) are increasingly integrated into audio-based applications, growing concerns have emerged regarding their vulnerability to audio-based adversarial attacks. These systems typically follow two architectural paradigms: cascaded pipelines, where automatic speech recognition converts audio inputs into text before LLM processing, and end-to-end large audio-language models (LALMs), which directly interpret raw audio signals. Beyond architectural differences, cascaded pipelines are primarily vulnerable to text-level jailbreak strategies delivered through speech, whereas end-to-end LALMs introduce additional acoustic-semantic attack vectors. However, existing studies often focus on a single paradigm and provide limited coverage of the broader audio attack space. To bridge this gap, we propose an adaptive jailbreak attack framework for systematic evaluation of both cascaded pipelines and LALMs under a unified experimental setting. At its core, the framework uses a feedback-guided mutation engine to automatically generate and refine jailbreak candidates across both textual prompts and audio perturbations, thereby expanding attack diversity and coverage. Experiments on six representative audio-based systems demonstrate that both paradigms remain substantially vulnerable to audio jailbreak attacks. Compared with state-of-the-art methods, our framework achieves consistently higher attack success rates across diverse audio-based LLM systems.
AudioJailbreak: Jailbreak Attacks against End-to-End Large Audio-Language Models
Wuhan University(武汉大学);Key Laboratory of System Software (Chinese Academy of Sciences)(中国科学院系统软件重点实验室);Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所);State Key Laboratory of Cryptology(密码学国家重点实验室);University of Chinese Academy of Sciences(中国科学院大学);Nanjing Institute of Software Technology(南京软件技术研究所);Ant Group(蚂蚁集团);Nanyang Technological University(南洋理工大学);Zhejiang Lab(浙江实验室);Pengcheng Laboratory(鹏城实验室)
JALMBench: Benchmarking Jailbreak Vulnerabilities in Audio Language Models
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));State Key Laboratory of Internet Architecture, Tsinghua University(清华大学互联网架构国家重点实验室);University of North Texas(北卡罗来纳州立大学);University of Science and Technology of China(中国科学技术大学);Fujian Normal University(福建师范大学);Nanjing University of Aeronautics and Astronautics(南京航空航天大学)
Acoustic Interference: A New Paradigm Weaponizing Acoustic Latent Semantic for Universal Jailbreak against Large Audio Language Models
The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));The Hong Kong Polytechnic University(香港理工大学);The Chinese University of Hong Kong(香港中文大学)
ALMGuard: Safety Shortcuts and Where to Find Them as Guardrails for Audio-Language Models
Beijing University of Posts and Telecommunications(北京邮电大学);National University of Singapore(新加坡国立大学);CSIRO’s Data61(CSIRO数据61);Responsible AI Research (RAIR) Centre, The University of Adelaide(负责任人工智能研究(RAIR)中心,阿德莱德大学);Tsinghua University(清华大学)
The Audio Auditor: User-Level Membership Inference in Internet of Things Voice Services
Swinburne University of Technology(斯威本科技大学);The University of Adelaide(阿德莱德大学);Deakin University(迪肯大学);The University of New South Wales(新南威尔士大学);CSIRO-Data61(澳大利亚联邦科学与工业研究组织数据61所);Macquarie University(麦考瑞大学);James Cook University(詹姆斯库克大学)