New methods designed to preserve data privacy require careful scrutiny. Failure to preserve privacy is hard to detect, and yet can lead to catastrophic results when a system implementing a ``privacy-preserving'' method is attacked. A recent work selected for an Outstanding Paper Award at ICML 2022 (Dong et al., 2022) claims that dataset condensation (DC) significantly improves data privacy when training machine learning models. This claim is supported by theoretical analysis of a specific dataset condensation technique and an empirical evaluation of resistance to some existing membership inference attacks.
In this note we examine the claims in the work of Dong et al. (2022) and describe major flaws in the empirical evaluation of the method and its theoretical analysis. These flaws imply that their work does not provide statistically significant evidence that DC improves the privacy of training ML models over a naive baseline. Moreover, previously published results show that DP-SGD, the standard approach to privacy preserving ML, simultaneously gives better accuracy and achieves a (provably) lower membership attack success rate.
No Free Lunch Theorem for Security and Utility in Federated Learning
Hong Kong University of Science and Technology(香港科技大学);Webank(微众银行)
在联邦学习场景中,多方从各自的数据中联合学习模型,对于选择合适的算法存在两个相互冲突的目标。一方面,在\textit{semi-honest}合作伙伴在场的情况下,私人和敏感的训练数据必须尽可能地保持安全,而另一方面,为了学习效用,必须在不同方之间交换一定量的信息。这样的挑战需要隐私保护的联邦学习解决方案,它最大限度地提高了学习模型的效用,并保持了参与方的私人数据的可证明的隐私保证。本文阐述了一个一般框架,a)从统一的信息论角度阐述了隐私损失和效用损失之间的权衡,b)描绘了使用不同保护机制(包括随机化、稀疏性和同态加密)时隐私-效用权衡的定量界限。结果表明,在一般情况下,\textit{there is no free lunch for the privacy-utility trade-off}和一个交易的隐私保护与一定程度的降级效用。本文的定量分析对设计实用的联邦学习算法具有指导意义。
Free Lunch for Federated Remote Sensing Target Fine-Grained Classification: A Parameter-Efficient Framework
Guangdong-Hongkong-Macao Greater Bay Area Weather Research Center for Monitoring Warning and Forecasting (Shenzhen Institute of Meteorological Innovation)(粤港澳大湾区气象监测预警预报中心(深圳气象创新研究院));Australian Artificial Intelligence Institute, FEIT, University of Technology Sydney(悉尼科技大学工程与信息技术学院澳大利亚人工智能研究所);School of Electrical and Electronic Engineering, Nanyang Technological University(南洋理工大学电气与电子工程学院);School of Information and Communication Engineering, Hainan University(海南大学信息与通信工程学院);School of Computer, Electronics and Information, Guangxi University(广西大学计算机与电子信息学院)
Improving Clinical Dataset Condensation with Mode Connectivity-based Trajectory Surrogates
Institute of Biomedical Engineering, University of Oxford, UK(生物医学工程研究所,牛津大学,英国);GlaxoSmithKline, London, UK(葛兰素史克,伦敦,英国);Nuffield Department of Primary Care Health Sciences, University of Oxford, UK(初级保健健康科学尼弗尔部门,牛津大学,英国);Oxford-Suzhou Institute of Advanced Research (OSCAR), Suzhou, China(牛津-苏州先进研究所(OSCAR),苏州,中国)
Free Lunch in Medical Image Foundation Model Pre-training via Randomized Synthesis and Disentanglement
Department of Computer Science and Engineering, the Hong Kong University of Science and Technology, Hong Kong, China(香港科技大学计算机科学与工程系);Department of Biomedical Engineering, Case Western Reserve University, OH, USA(凯斯西储大学生物医学工程系);School of Data Science, Lingnan University, Hong Kong, China(岭南大学数据科学学院);Department of Chemical and Biological Engineering and Division of Life Science, Hong Kong University of Science and Technology, Hong Kong, China(香港科技大学化学与生物工程系);HKUST Shenzhen-Hong Kong Collaborative Innovation Research Institute, Futian, Shenzhen, China(香港科技大学深圳-香港协同创新研究院);State Key Laboratory of Nervous System Disorders, The Hong Kong University of Science and Technology, Hong Kong, China(香港科技大学神经系统疾病国家重点实验室)
Rethinking Federated Graph Learning: A Data Condensation Perspective
Computer Network Information Center, Chinese Academy of Sciences(中国科学院计算机网络信息中心);University of Chinese Academy of Sciences(中国科学院大学);Beijing Institute of Technology(北京理工大学);Sun Yat-sen University(中山大学)
Vicinal Feature Statistics Augmentation for Federated 3D Medical Volume Segmentation
Harvard Medical School(哈佛医学院);Harvard University(哈佛大学);Graduate School of Engineering, Tohoku University(东北大学工学研究生院);School of Biomedical Engineering, Anhui Medical University(安徽医科大学生物医学工程学院);Washington University in St. Louis(圣路易斯华盛顿大学);The Hong Kong Polytechnic University(香港理工大学)