Stop Tracking Me! Proactive Defense Against Attribute Inference Attack in LLMs
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);NLPR & MAIS, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
Recent studies have shown that large language models (LLMs) can infer private user attributes (e.g., age, location, gender) from user-generated text shared online, enabling rapid and large-scale privacy breaches. Existing anonymization-based defenses are coarse-grained, lacking word-level precision in anonymizing privacy-leaking elements. Moreover, they are inherently limited as altering user text to hide sensitive cues still allows attribute inference to occur through models' reasoning capabilities. To address these limitations, we propose a unified defense framework that combines fine-grained anonymization (TRACE) with inference-preventing optimization (RPS). TRACE leverages attention mechanisms and inference chain generation to identify and anonymize privacy-leaking textual elements, while RPS employs a lightweight two-stage optimization strategy to induce model rejection behaviors, thereby preventing attribute inference. Evaluations across diverse LLMs show that TRACE-RPS reduces attribute inference accuracy from around 50\% to below 5\% on open-source models. In addition, our approach offers strong cross-model generalization, prompt-variation robustness, and utility-privacy tradeoffs. Our code is available at https://github.com/Jasper-Yan/TRACE-RPS.
Toward Intelligent and Secure Cloud: Large Language Model Empowered Proactive Defense
School of Cyber Science and Engineering, Southeast University, Purple Mountain Laboratories, and Jiangsu Province Engineering Research Center of Security for Ubiquitous Network(网络安全学院、东南大学、紫山实验室以及江苏省物联网安全工程技术研究中心)
A Survey on Proactive Defense Strategies Against Misinformation in Large Language Models
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));The Hong Kong University of Science and Technology(香港科技大学);Harbin Institute of Technology(哈尔滨工业大学);Ant Group, Alibaba(蚂蚁集团,阿里巴巴);Northeast Forest University(东北林业大学)
SafeMCP: Proactive Power Regulation for LLM Agent Defense via Environment-Grounded Look-Ahead Reasoning
Beijing Institute of Technology(北京理工大学);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Institute for Artificial Intelligence, Peking University(北京大学人工智能研究院)
Proactive Adversarial Defense: Harnessing Prompt Tuning in Vision-Language Models to Detect Unseen Backdoored Images
University of West Florida(西佛罗里达大学);Florida Institute For Human and Machine Cognition (IHMC)(佛罗里达人机认知研究所);Center for Cybersecurity, University of West Florida(西佛罗里达大学网络安全中心)
Proactive Disentangled Modeling of Trigger-Object Pairings for Backdoor Defense
Department of Intelligent Systems and Robotics, University of West Florida(智能系统与机器人系,西佛罗里达大学);Florida Institute For Human and Machine Cognition (IHMC)(佛罗里达人类与机器认知研究所);Center for Cybersecurity, University of West Florida(网络安全中心,西佛罗里达大学)
Enhancing Model Defense Against Jailbreaks with Proactive Safety Reasoning
School of Computing(计算学院);National University of Singapore(新加坡国立大学);School of Computer Science and Engineering(计算机科学与工程学院);Nanyang Technological University(南洋理工大学);Department of Computing(计算系);The Hong Kong Polytechnic University(香港理工大学)
SAIGuard: Communication-State Simulation for Proactive Defense of LLM Multi-Agent Systems
School of Artificial Intelligence, Jilin University(吉林大学人工智能学院);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));School of Information and Communication Technology, Griffith University(格里菲斯大学信息与通信技术学院)
Enhanced Detective: A Dual-Stage Proactive Defense Against Internal Poisoning Attacks in Financial Fraud Detection Using Federated Learning
University of Bucharest(布加勒斯特大学);Luxembourg Institute of Science and Technology (LIST)(卢森堡科学与技术研究所);Research Institute of the University of Bucharest (ICUB)(布加勒斯特大学研究院)
SwarmSense-DNN: A Trustworthy and Decentralized Neural Framework for Proactive Anomaly Defense in Consumer IoT
Universiti Malaya(马来亚大学);Expedia Group(爱彼迎集团);King Faisal University(费萨尔国王大学);Northeastern University(东北大学);Northern Border University(北部边境大学);Benazir Bhutto Shaheed University Lyari(贝娜齐尔·布托沙希德莱阿里大学)
Fight Perturbations with Perturbations: Defending Adversarial Attacks via Neuron Influence
College of Information Engineering at Zhejiang University of Technology(浙江工业大学信息工程学院);School of Cyber Science and Technology at Zhejiang University(浙江大学网络空间安全学院)