Two Frames Matter: A Temporal Attack for Text-to-Video Model Jailbreaking
College of Science, Mathematics and Technology, Wenzhou-Kean University(科学、数学与技术学院,温州市凯恩大学);State Key Laboratory of Complex & Critical Software Environment, Beihang University(复杂与关键软件环境国家重点实验室,北航);AI Security Lab(360人工智能安全实验室)
Recent text-to-video (T2V) models can synthesize complex videos from lightweight natural language prompts, raising urgent concerns about safety alignment in the event of misuse in the real world. Prior jailbreak attacks typically rewrite unsafe prompts into paraphrases that evade content filters while preserving meaning. Yet, these approaches often still retain explicit sensitive cues in the input text and therefore overlook a more profound, video-specific weakness. In this paper, we identify a temporal trajectory infilling vulnerability of T2V systems under fragmented prompts: when the prompt specifies only sparse boundary conditions (e.g., start and end frames) and leaves the intermediate evolution underspecified, the model may autonomously reconstruct a plausible trajectory that includes harmful intermediate frames, despite the prompt appearing benign to input or output side filtering. Building on this observation, we propose TFM. This fragmented prompting framework converts an originally unsafe request into a temporally sparse two-frame extraction and further reduces overtly sensitive cues via implicit substitution. Extensive evaluations across multiple open-source and commercial T2V models demonstrate that TFM consistently enhances jailbreak effectiveness, achieving up to a 12% increase in attack success rate on commercial systems. Our findings highlight the need for temporally aware safety mechanisms that account for model-driven completion beyond prompt surface form.
Token-Level Constraint Boundary Search for Jailbreaking Text-to-Image Models
School of Artificial Intelligence, Xidian University(西安电子科技大学人工智能学院);School of Computer Science and Technology, Xidian University(西安电子科技大学计算机科学与技术学院);Trustworthy and General Artificial Intelligence Laboratory, School of Engineering, Westlake University(之江实验室可信与通用人工智能实验室)
HTS-Attack: Heuristic Token Search for Jailbreaking Text-to-Image Models
Agency for Science, Technology and Research (A*STAR)(新加坡科技研究局);CFAR;IHPC;Mohammed Bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Nanyang Technological University(南洋理工大学);Alibaba Group(阿里巴巴集团);University of Oxford(牛津大学)
Making Every Step Effective: Jailbreaking Large Vision-Language Models Through Hierarchical KV Equalization
Southeast University(东南大学);University of California, Merced(加州大学默塞德分校);National University of Singapore(新加坡国立大学);Lancaster University(兰卡斯特大学);University of Queensland(昆士兰大学)
Scalable Defense against In-the-wild Jailbreaking Attacks with Safety Context Retrieval
School of EECS, Peking University(电子工程系,北京大学);School of Mathematical Sciences, Peking University(数学系,北京大学);State Key Lab of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University(通用人工智能国家重点实验室,智能科学与技术学校,北京大学);Institute for Artificial Intelligence, Peking University(人工智能研究院,北京大学)
Data to Defense: The Role of Curation in Customizing LLMs Against Jailbreaking Attacks
Stony Brook University(石溪大学);Binghamton University(宾汉姆顿大学);University of Iowa(爱荷华大学);Dartmouth College(达特茅斯学院);Georgia Institute of Technology(佐治亚理工学院)
Continuous Embedding Attacks via Clipped Inputs in Jailbreaking Large Language Models
University of New South Wales(新南威尔士大学);Delft University of Technology(代尔夫特理工大学);Nanyang Technological University(南洋理工大学);Huazhong University of Science and Technology(华中科技大学);Radboud University(拉德堡德大学)
Red-teaming the Multimodal Reasoning: Jailbreaking Vision-Language Models via Cross-modal Entanglement Attacks
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);People’s Public Security University of China(中国人民公安大学)
The State Key Laboratory of Blockchain and Data Security, Zhejiang University(区块链与数据安全国家重点实验室,浙江大学);Hangzhou High-Tech Zone (Binjiang) Institute of Blockchain and Data Security(杭州高新技术区(滨江)区块链与数据安全研究院);Nanyang Technological University(南洋理工大学);King Abdullah University of Science and Technology(国王阿卜杜勒阿齐兹科技大学);SUN YAT-SEN UNIVERSITY(孙中山大学)
TeleAI-Safety: A comprehensive LLM jailbreaking benchmark towards attacks, defenses, and evaluations
Institute of Artificial Intelligence (TeleAI) of China Telecom(中国电信人工智能研究院(TeleAI));Shanghai Jiao Tong University(上海交通大学);Sichuan University(四川大学);University of Chinese Academy of Sciences(中国科学院大学);Chinese Academy of Sciences(中国科学院);University of Science and Technology of China(中国科学技术大学);Peking University(北京大学);Harbin Institute of Technology(哈尔滨工业大学)
Mind the Trojan Horse: Image Prompt Adapter Enabling Scalable and Deceptive Jailbreaking
School of Computer Science and Engineering, Sun Yat-Sen University(中山大学计算机科学与工程学院);Nanyang Technological University(南洋理工大学);Guangdong Province Key Laboratory of Information Security Technology(广东省信息安全技术重点实验室)
Jailbreaking Attacks vs. Content Safety Filters: How Far Are We in the LLM Safety Arms Race?
CISPA Helmholtz Center for Information Security(CISPA 欧洲信息安全中心);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);Southern University of Science and Technology(南方科技大学)
Activation-Guided Local Editing for Jailbreaking Attacks
Beihang University(北航);Hangzhou Innovation Institute(杭州创新研究院);HKUST(香港科技大学);South China University of Technology(华南理工大学);Nanyang Technological University(南洋理工大学);Kunming University of Science and Technology(昆明理工大学)
Multi-step Jailbreaking Privacy Attacks on ChatGPT
Hong Kong University of Science and Technology(香港科技大学);Peking University(北京大学);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Notre Dame(圣母大学)
On Jailbreaking Quantized Language Models Through Fault Injection Attacks
Compumacy for Artificial Intelligence Solutions(人工智能解决方案公司);Electrical and Computer Engineering Department, George Mason University(乔治·马歇尔大学电气与计算机工程系);School of Electronics, Electrical Engineering and Computer Sciences, Queen’s University Belfast(女王大学贝尔法斯特电子、电气与计算机科学学院)
Jailbreaking Large Language Models through Iterative Tool-Disguised Attacks via Reinforcement Learning
School of Cyberspace Science and Technology, Beijing Institute of Technology(信息科学与技术学院,北京理工大学);School of Computer Science and Technology, Beijing Institute of Technology(计算机科学与技术学院,北京理工大学);School of Computer Science, University of Auckland(计算机科学学院,奥克兰大学);QAX Security Center, Qi-AnXin Technology Group Inc.(QAX安全中心,启安新科技集团);Qi-AnXin Technology Group Inc.(启安新科技集团);Zhongguancun Laboratory(中关村实验室)