Companies increasingly expose machine learning (ML) models trained over sensitive user data to untrusted domains, such as end-user devices and wide-access model stores. We present Sage, a differentially private (DP) ML platform that bounds the cumulative leakage of training data through models. Sage builds upon the rich literature on DP ML algorithms and contributes pragmatic solutions to two of the most pressing systems challenges of global DP: running out of privacy budget and the privacy-utility tradeoff. To address the former, we develop block composition, a new privacy loss accounting method that leverages the growing database regime of ML workloads to keep training models endlessly on a sensitive data stream while enforcing a global DP guarantee for the stream. To address the latter, we develop privacy-adaptive training, a process that trains a model on growing amounts of data and/or with increasing privacy parameters until, with high probability, the model meets developer-configured quality criteria. They illustrate how a systems focus on characteristics of ML workloads enables pragmatic solutions that are not apparent when one focuses on individual algorithms, as most DP ML literature does.
Learning with Differentially Private (Sliced) Wasserstein Gradients
Universidad de Valladolid and IMUVA(巴利亚多利德大学和IMUVA);Institut de Mathématiques de Toulouse(图卢兹数学研究所);Université de Toulouse(图卢兹大学);ANITI & Regalia INRIA(ANITI与INRIA Regalia团队)
Pushing the (Decision) Boundaries: Dynamically Calibrating Differentially Private Noise to Explainability in Federated Learning
School of Industrial & Intelligent Systems Engineering, Tel Aviv University(特拉维夫大学工业与智能系统工程学院);School of Integrated Technology, Yonsei University(延世大学融合技术学院)
Deep Learning under Fractional-Order Differential Privacy
MESA Lab, Dept. of EECS University of California, Merced(加州大学默塞德分校电子工程与计算机科学系MESA实验室);Dept. of Applied Mathematics University of California, Merced(加州大学默塞德分校应用数学系)
SAGE: A sampling-aware global evaluation benchmark for species distribution modeling
University of Zurich(苏黎世大学);École Polytechnique Fédérale de Lausanne(洛桑联邦理工学院);Swiss Federal Institute for Forest, Snow and Landscape Research, WSL(瑞士联邦森林、雪与景观研究所);ETH Zürich(苏黎世联邦理工学院)
CityGuard: Graph-Aware Private Descriptors for Bias-Resilient Identity Search Across Urban Cameras
University of Macau(澳门大学);Tsinghua University(清华大学);Renmin University of China(中国人民大学);Shanghai AI Laboratory(上海人工智能实验室);The Hong Kong University of Science and Technology(香港科技大学);Juntendo University(顺天堂大学);Peking University(北京大学)
When Gradient Clipping Becomes a Control Mechanism for Differential Privacy in Deep Learning
Computer Science, University of California, Merced, CA 95343, USA(计算机科学,加州大学默塞德分校);Department of Applied Mathematics, University of California, Merced, CA 95343, USA(应用数学系,加州大学默塞德分校);Department of Innovation(创新部门);Research, North Carolina State University, Raleigh, NC, USA(研究,北卡罗来纳州立大学,拉洛城);Automation (MESA) Lab, Department of Mechanical Engineering, School of Engineering, University of California, Merced, CA 95343, USA(自动化(MESA)实验室,机械工程系,工程学院,加州大学默塞德分校)