Large language models (LLMs) exhibit remarkable capabilities in understanding and generating natural language. However, these models can inadvertently memorize private information, posing significant privacy risks. This study addresses the challenge of enabling LLMs to protect specific individuals' private data without the need for complete retraining. We propose \return, a Real-world pErsonal daTa UnleaRNing dataset, comprising 2,492 individuals from Wikipedia with associated QA pairs, to evaluate machine unlearning (MU) methods for protecting personal data in a realistic scenario. Additionally, we introduce the Name-Aware Unlearning Framework (NAUF) for Privacy Protection, which enables the model to learn which individuals' information should be protected without affecting its ability to answer questions related to other unrelated individuals. Our extensive experiments demonstrate that NAUF achieves a state-of-the-art average unlearning score, surpassing the best baseline method by 5.65 points, effectively protecting target individuals' personal data while maintaining the model's general capabilities.
Please refuse to answer me! Mitigating Over-Refusal in Large Language Models via Adaptive Contrastive Decoding
School of Cyber Science and Technology, Shenzhen Campus of Sun Yat-sen University(中山大学信息科学与技术学院深圳校区);School of Information, Central University of Finance and Economics(中央财经大学信息学院);School of Artificial Intelligence, Beijing Normal University(北京师范大学人工智能学院);School of Computing Technologies, RMIT University(皇家墨尔本理工大学计算技术学院)
Deactivating Refusal Triggers: Understanding and Mitigating Overrefusal in Safety Alignment
University of California, Santa Barbara(加州大学圣巴巴拉分校);Johns Hopkins University(约翰霍普金斯大学);Michigan State University(密歇根州立大学);University of Mississippi(密苏里州立大学)
RAG-CT: Mitigating Privacy Risks on Retrieval-Augmented Generation Systems via Scanning Prompt Distribution
University of Massachusetts Lowell(马萨诸塞大学洛厄尔分校);City University of Hong Kong(香港城市大学);Virginia Tech(弗吉尼亚理工大学);University of South Florida(南佛罗里达大学);Rochester Institute of Technology(罗切斯特理工学院)
The Double-edged Sword of LLM-based Data Reconstruction: Understanding and Mitigating Contextual Vulnerability in Word-level Differential Privacy Text Sanitization
Technical University of Munich School of Computation, Information(慕尼黑技术大学计算、信息与技术学院)
Shadow in the Cache: Unveiling and Mitigating Privacy Risks of KV-cache in LLM Inference
State Key Laboratory of Blockchain and Data Security(区块链与数据安全国家重点实验室);Zhejiang University(浙江大学);Huawei Technology(华为技术);Hangzhou High-Tech Zone (Binjiang) Institute of Blockchain and Data Security(杭州高新技术区(滨江)区块链与数据安全研究院)
Auditing and Mitigating Privacy Leakage in Cloud-Edge Collaborative Decoding
The Hong Kong Polytechnic University(香港理工大学);Institute for AI Industry Research, Tsinghua University(清华大学人工智能产业研究院);School of Software, Tsinghua University(清华大学软件学院)
Confuse the Model, Control the Flow: Understanding and Mitigating Privacy Leakage from LLM Agents with Information Flow Control
University of California, Irvine(加州大学欧文分校);University of California, Santa Cruz(加州大学圣克鲁兹分校);University of California, Davis(加州大学戴维斯分校);University of California, Santa Barbara(加州大学圣巴巴拉分校)
Protecting Bystander Privacy via Selective Hearing in Audio LLMs
VRAIN, Universitat Politècnica de València(VRAIN,瓦伦西亚理工大学);Department of Engineering, University of Cambridge(剑桥大学工程系);INGENIO (CSIC-Universitat Politècnica de València)(INGENIO(CSIC-瓦伦西亚理工大学))
Understanding and Mitigating Overrefusal in LLMs from an Unveiling Perspective of Safety Decision Boundary
The State Key Laboratory of Blockchain and Data Security(区块链与数据安全国家重点实验室);Hangzhou High-Tech Zone (Binjiang) Institute of Blockchain and Data Security(杭州高新技术区(滨江)区块链与数据安全研究院);Language and Machine Intelligence Department, Ant Group(蚂蚁集团语言与机器智能部门)
Mitigating Sensitive Information Leakage in LLMs4Code through Machine Unlearning
College of Computer Science and Technology, National University of Defense Technology, Changsha, Hunan, 410073, China(计算机科学与技术学院,国防科技大学,长沙,湖南,410073,中国);Xichang Satellite Launch Center, Xichang, Sichuan, 615000, China(西昌卫星发射中心,西昌,四川,615000,中国);Academy of Military Sciences, Beijing, 100091, China(军事科学院,北京,100091,中国)
Understanding and Mitigating Cross-lingual Privacy Leakage via Language-specific and Universal Privacy Neurons
King Abdullah University of Science and Technology(国王阿卜杜勒阿齐兹科学与技术大学);Provable Responsible AI and Data Analytics (PRADA) Lab(可证明负责任的人工智能与数据分析实验室);University of Copenhagen(哥本哈根大学);University of Science and Technology of China(中国科学技术大学);State University of New York at Buffalo(纽约州立大学布法罗分校);The Hong Kong Polytechnic University(香港理工大学);Zhejiang University(浙江大学)
Parameter-Efficient Fine-Tuning with Differential Privacy for Robust Instruction Adaptation in Large Language Models
Georgia Institute of Technology(佐治亚理工学院);University of Southern California(南加州大学);Dartmouth College(达特茅斯学院);University of Michigan(密歇根大学);University of Pennsylvania(宾夕法尼亚大学)