Seed Hijacking of LLM Sampling and Quantum Random Number Defense
School of Electronic, Electrical and Physics, Fujian University of Technology(福建工程学院电子、电气与物理系);School of Humanities, Fujian University of Technology(福建工程学院人文学院);Department of Investigation, Fujian Police College(福建警察学院调查系);Institute of Applied Physics and Materials Engineering, University of Macau(澳门大学应用物理与材料工程研究院)
Large language models (LLMs) rely on deterministic pseudorandom number generators (PRNGs) for autoregressive sampling, creating a critical supply-chain attack surface overlooked by existing defenses. We present SeedHijack, a backdoor attack that manipulates PRNG outputs to force attacker-specified token selection without altering model logits. In a 540-trial benchmark on GPT-2 (124M), the attack achieves 99.6% exact token injection across 9 sampling configurations; it reaches 100% success on four aligned models (1.5B-7B, RLHF/SFT/reasoning distillation) and bypasses all alignment methods tested in this work. We further propose a defense based on a hardware quantum random number generator (QRNG), which neutralizes the attack in our evaluated threat model with negligible median overhead (+0.6% latency, +7.7 MB memory). Our work identifies a critical sampling-layer vulnerability and provides a practical, deployable QRNG-based defense.
Blind PRNG Hijacking: An Undetectable Integrity-Preserving Attack Against LLM Watermarking
Fujian Provincial Key Laboratory of Automotive Electronics and Electric Drive(福建省汽车电子与电力驱动重点实验室);School of Electronic, Electrical and Physics(电子、电气与物理学院);Fujian University of Technology(福建理工大学);School of Humanities(人文学院);Institute of Applied Physics and Materials Engineering(应用物理与材料工程学院);University of Macau(澳门大学)
Attacking LLMs and AI Agents: Advertisement Embedding Attacks Against Large Language Models
Department of Computer Science Texas A\&M University–Corpus Christi Corpus Christi, TX, USA;EECS Department University of Missouri Columbia, MO, USA;Department of Computer Engineering University of California–Riverside Riverside, CA, USA
CISPA Helmholtz Center for Information Security(CISPA亥姆霍兹信息安全中心);Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所);Nokia Bell Labs(诺基亚贝尔实验室)
ShadowCoT: Cognitive Hijacking for Stealthy Reasoning Backdoors in LLMs
School of Communication and Information Engineering, Shanghai University(上海大学通信与信息工程学院);College of Computer Science and Information Technology, IAU(国际应用技术大学计算机科学与信息学院);Center for AI Research (CAIR), University of Agder (UiA)(阿格德大学人工智能研究中心)
SeqAR: Jailbreak LLMs with Sequential Auto-Generated Characters
Shanghai University of Finance and Economics(上海财经大学);Southern University of Science and Technology(南方科技大学);Ant Group(蚂蚁集团);The Chinese University of Hong Kong(香港中文大学)
Mind the Trojan Horse: Image Prompt Adapter Enabling Scalable and Deceptive Jailbreaking
School of Computer Science and Engineering, Sun Yat-Sen University(中山大学计算机科学与工程学院);Nanyang Technological University(南洋理工大学);Guangdong Province Key Laboratory of Information Security Technology(广东省信息安全技术重点实验室)
Fuzz-Testing Meets LLM-Based Agents: An Automated and Efficient Framework for Jailbreaking Text-To-Image Generation Models
School of Cyber Science and Technology, Shandong University(山东大学网络科学与技术学院);Netflix Eyeline Studios;State Key Laboratory of Cryptography and Digital Economy Security, Shandong University(山东大学密码与数字经济安全国家重点实验室);Shandong Key Laboratory of Artificial Intelligence Security, Shandong University(山东省人工智能安全重点实验室)
Supply-Chain Poisoning Attacks Against LLM Coding Agent Skill Ecosystems
Griffith University(格里菲斯大学);The State Information Center(国家信息中心);Nanyang Technological University(南洋理工大学);University of New South Wales(新南威尔士大学);Wake Forest University(维克森林大学)
Send to which account? Evaluation of an LLM-based Scambaiting System
AI Research, Cybera Global Inc./ UNCW(AI研究、Cybera全球公司/UNCW);Department of Computer Science and Engineering, UC Denver(计算机科学与工程系,UC Denver);Department of Computer Science, UNCW(计算机科学系,UNCW)