When Gradient Clipping Becomes a Control Mechanism for Differential Privacy in Deep Learning
当梯度裁剪成为深度学习中差分隐私的控制机制
机构 * Computer Science, University of California, Merced, CA 95343, USA(计算机科学,加州大学默塞德分校) ; Department of Applied Mathematics, University of California, Merced, CA 95343, USA(应用数学系,加州大学默塞德分校) ; Department of Innovation(创新部门) ; Research, North Carolina State University, Raleigh, NC, USA(研究,北卡罗来纳州立大学,拉洛城) ; Automation (MESA) Lab, Department of Mechanical Engineering, School of Engineering, University of California, Merced, CA 95343, USA(自动化(MESA)实验室,机械工程系,工程学院,加州大学默塞德分校)
AI总结 本文提出了一种基于控制机制的梯度裁剪策略,通过模型参数的谱诊断动态调整裁剪阈值,以在差分隐私训练中平衡隐私保护与模型性能。
Comments This manuscript is under review in the Engineering Applications of Artificial Intelligence journal