Programming errors, defective hardware components (such as hard disk spindle defects), and environmental hazards can lead to invalid memory operations. In addition, less predictable forms of environmental stress, such as radiation, thermal influence, and energy fluctuations, can induce hardware faults. Sometimes, a soft error can occur instead of a complete failure, such as a bit-flip. The 'natural' factors that can cause bit-flips are replicable through targeted attacks that result in significant compromises, including full privileged system access. Existing physical defense solutions have consistently been circumvented shortly after deployment. We will explore the concept of a novel software-based low-level layer that can protect vulnerable memory targeted by physical attack vectors related to bit-flip vulnerabilities.
TeleAI-Safety: A comprehensive LLM jailbreaking benchmark towards attacks, defenses, and evaluations
Institute of Artificial Intelligence (TeleAI) of China Telecom(中国电信人工智能研究院(TeleAI));Shanghai Jiao Tong University(上海交通大学);Sichuan University(四川大学);University of Chinese Academy of Sciences(中国科学院大学);Chinese Academy of Sciences(中国科学院);University of Science and Technology of China(中国科学技术大学);Peking University(北京大学);Harbin Institute of Technology(哈尔滨工业大学)
Model-Agnostic Lifelong LLM Safety via Externalized Attack-Defense Co-Evolution
City University of Hong Kong(香港城市大学);Beijing University of Posts and Telecommunications(北京邮电大学);Wuhan University(武汉大学);Beihang University(北京航空航天大学);Beijing Academy of Artificial Intelligence(北京人工智能研究院)
SoK: The Security-Safety Continuum of Multimodal Foundation Models through Information Flow and Global Game-Theoretic Analysis of Asymmetric Threats
CSIRO’s Data61(CSIRO数据61);University of New South Wales(新南威尔士大学);Johns Hopkins University(约翰斯·霍普金斯大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Adelaide University(阿德莱德大学);Responsible AI Research (RAIR) Centre, Adelaide University(阿德莱德大学负责任人工智能研究(RAIR)中心)
SafePTR: Token-Level Jailbreak Defense in Multimodal LLMs via Prune-then-Restore Mechanism
Shenzhen Institute for Advanced Study, University of Electronic Science and Technology of China(电子科技大学深圳研究院);Southwestern University of Finance and Economics(西南财经大学);Engineering Research Center of Intelligent Finance, Ministry of Education(教育部智能金融工程研究中心);Tongji University(同济大学)
Scalable Defense against In-the-wild Jailbreaking Attacks with Safety Context Retrieval
School of EECS, Peking University(电子工程系,北京大学);School of Mathematical Sciences, Peking University(数学系,北京大学);State Key Lab of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University(通用人工智能国家重点实验室,智能科学与技术学校,北京大学);Institute for Artificial Intelligence, Peking University(人工智能研究院,北京大学)
PandaGuard: Systematic Evaluation of LLM Safety against Jailbreaking Attacks
Beijing Institute of AI Safety and Governance (Beijing-AISI)(北京人工智能安全与治理研究院);Beijing Key Laboratory of Safe AI and Superalignment(北京安全人工智能与超对齐重点实验室);BrainCog Lab, CASIA(CASIA脑认知实验室)
CoopGuard: Stateful Cooperative Agents Safeguarding LLMs Against Evolving Multi-Round Attacks
School of Computer Science, Shanghai Jiao Tong University(上海交通大学计算机科学与工程学院);Department of Computer Science, University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校计算机科学系);Big Data Institute, Central South University(中南大学大数据研究院)
A Survey of Safety on Large Vision-Language Models: Attacks, Defenses and Evaluations
School of Computer Science, Wuhan University(武汉大学计算机学院);School of Cyber Science and Technology, University of Science and Technology of China(中国科学技术大学网络空间安全学院);College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算与数据科学学院)
DELMAN: Dynamic Defense Against Large Language Model Jailbreaking with Model Editing
ShanghaiTech University(上海科技大学);The State Key Laboratory of Blockchain and Data Security, Zhejiang University(浙江大学区块链与数据安全全国重点实验室);The CoAI group, Tsinghua University(清华大学CoAI课题组)
SysEvolve: An AI-native, safe, autonomous adversarial attack-defense co-evolutionary system
School of Computer Science, Peking University(北京大学计算机学院);Southeast University(东南大学);School of Computing, National University of Singapore(新加坡国立大学计算机学院)
ChannelGuard: From Borrowed Safety to Application-Controlled Defenses in Multi-Agent LLMs
College of Engineering and Computer Science, University of Central Florida(工程与计算机科学学院,中央佛罗里达大学);Department of Computer Science and Engineering, North South University(计算机科学与工程系,北南大学);Computer Science and Engineering, Ahsanullah University of Science and Technology(计算机科学与工程,阿沙努拉科学与技术大学);Department of Electrical and Computer Engineering, Purdue University Fort Wayne(电气与计算机工程系,普渡大学弗拉特沃恩分校)