Deep neural network models are massively deployed on a wide variety of hardware platforms. This results in the appearance of new attack vectors that significantly extend the standard attack surface, extensively studied by the adversarial machine learning community. One of the first attack that aims at drastically dropping the performance of a model, by targeting its parameters (weights) stored in memory, is the Bit-Flip Attack (BFA). In this work, we point out several evaluation challenges related to the BFA. First of all, the lack of an adversary's budget in the standard threat model is problematic, especially when dealing with physical attacks. Moreover, since the BFA presents critical variability, we discuss the influence of some training parameters and the importance of the model architecture. This work is the first to present the impact of the BFA against fully-connected architectures that present different behaviors compared to convolutional neural networks. These results highlight the importance of defining robust and sound evaluation methodologies to properly evaluate the dangers of parameter-based attacks as well as measure the real level of robustness offered by a defense.
Flipping Minds by Flipping Bits: Decision-Level Cognitive Hijacking of Large Language Models
Information Engineering University(信息工程大学);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);State Key Laboratory of Information Security, Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所信息安全国家重点实验室)
Attacking Graph Neural Networks with Bit Flips: Weisfeiler and Lehman Go Indifferent
University of Vienna(维也纳大学);Doctoral School Computer Science, Faculty of Computer Science, University of Vienna(维也纳大学计算机学院计算机科学博士学院);Christian Doppler Laboratory for Assurance and Transparency in Software Protection, Faculty of Computer Science, University of Vienna(维也纳大学计算机学院克里斯蒂安·多普勒软件保护保障与透明度实验室);Research Network Data Science, Faculty of Computer Science, University of Vienna(维也纳大学计算机学院数据科学研究网络)
该研究提出首个专门针对图神经网络的Injectivity Bit Flip Attack,通过攻击量化消息传递神经网络的邻域聚合函数削弱其结构区分能力,仅翻转少量比特就能让高表达力的图同构网络输出随机结果,破坏力优于迁移自CNN的位翻转攻击。
Targeted Attack against Deep Neural Networks via Flipping Limited Weight Bits
Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);PCL Research Center of Networks and Communications, Peng Cheng Laboratory(鹏城实验室PCL网络与通信研究中心);School of Data Science, The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳)数据科学学院);Secure Computing Lab of Big Data, Shenzhen Research Institute of Big Data(深圳大数据研究院大数据安全计算实验室);Tencent AI Lab(腾讯AI Lab)
Verification of Bit-Flip Attacks against Quantized Neural Networks
National University of Singapore(新加坡国立大学);ShanghaiTech University(上海科技大学);ByteDance Inc(字节跳动公司);Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所);University of Chinese Academy of Sciences(中国科学院大学);Nanjing Institute of Software Technology(南京软件技术研究院);Singapore Management University(新加坡管理大学)
PrisonBreak: Jailbreaking Large Language Models with at Most Twenty-Five Targeted Bit-flips
Oregon State University(俄勒冈州立大学);University of British Columbia(不列颠哥伦比亚大学);University of Toronto(多伦多大学);George Mason University(乔治·梅森大学);Rutgers University(罗格斯大学);University of Texas at Arlington(德克萨斯大学阿灵顿分校)
DeepNcode: Encoding-Based Protection against Bit-Flip Attacks on Neural Networks
Slovak University of Technology(斯洛伐克技术大学);Faculty of Informatics and Information Technologies(信息与信息技术学院);TTControl GmbH(TTControl有限公司);University of Novi Sad(诺威萨大学);Ethernal
Bit-Flip Attacks on Vision-Language-Action Models: Action-Decoding Architecture Shapes the Vulnerability
The Hong Kong University of Science and Technology(香港科技大学);Adelaide University(阿德莱德大学);Wuhan University(武汉大学);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);ETH Zurich(苏黎世联邦理工学院);China University of Petroleum (East China)(中国石油大学(华东))
Has the Two-Decade-Old Prophecy Come True? Artificial Bad Intelligence Triggered by Merely a Single-Bit Flip in Large Language Models
Henan Key Laboratory of Network Cryptography Technology, Information Engineering University(河南网络密码技术重点实验室,信息工程大学);State Key Laboratory of Information Security, Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所,信息安全国家重点实验室);Zhejiang University(浙江大学)
FaRAccel: FPGA-Accelerated Defense Architecture for Efficient Bit-Flip Attack Resilience in Transformer Models
Department of Electrical and Computer Engineering, University of California, Davis, CA, USA(电子工程系,加州大学戴维斯分校);Department of Electrical and Computer Engineering, University of Arizona, Tucson, AZ, USA(电子工程系,亚利桑那大学图森分校);Department of Computer Engineering and Computer Science, California State University, Long Beach, Long Beach, CA, USA(计算机工程与计算机科学系,加州州立大学长滩分校);Department of Computer Science, Simon Fraser University, Vancouver, Canada(计算机科学系,西蒙弗雷泽大学,温哥华,加拿大)
Model Poisoning Against Federated Model Adaptation with Chain of Bit-Flips
CEA-Leti, Mines Saint-Etienne, Equipe Commune SAS(CEA-莱蒂, Mines圣艾蒂安, 共同团队SAS);Univ. Grenoble Alpes, CEA-Leti(格勒诺布尔阿尔卑斯大学, CEA-莱蒂);Mines Saint-Etienne, CEA-Leti, Centre CMP, Equipe commune SAS(Mines圣艾蒂安, CEA-莱蒂, CMP中心, 共同团队SAS)