As synthetic data becomes increasingly popular in machine learning tasks, numerous methods--without formal differential privacy guarantees--use synthetic data for training. These methods often claim, either explicitly or implicitly, to protect the privacy of the original training data. In this work, we explore four different training paradigms: coreset selection, dataset distillation, data-free knowledge distillation, and synthetic data generated from diffusion models. While all these methods utilize synthetic data for training, they lead to vastly different conclusions regarding privacy preservation. We caution that empirical approaches to preserving data privacy require careful and rigorous evaluation; otherwise, they risk providing a false sense of privacy.
Assessing Privacy Leakage in Synthetic 3-D PET Imaging using Transversal GAN
Data Science Institute, University of British Columbia(不列颠哥伦比亚大学数据科学研究所);BC Cancer Research Institute(不列颠哥伦比亚癌症研究所);University of British Columbia(不列颠哥伦比亚大学)
INRIA(法国国家信息与自动化研究所);Ecole Polytechnique(巴黎综合理工学院);Technische Universität Wien(维也纳工业大学);CentraleSupélec(中央理工-高等电力学院);CNRS(法国国家科学研究中心);Universite Paris-Saclay(巴黎萨克雷大学)
Balancing Fidelity, Utility, and Privacy in Synthetic Cardiac MRI Generation: A Comparative Study
University of Peradeniya, Sri Lanka(斯里兰卡大学);University of Maryland, College Park, USA(美国马里兰大学 College Park 分校);Tulane University School of Medicine, USA(美国 Tulane 大学医学院);Simula Research Laboratory, Norway(挪威 Simula 研究实验室);SimulaMet, Norway(挪威 SimulaMet)
A Comprehensive Evaluation Framework for Synthetic Trip Data Generation in Public Transport
Division of Transport Planning, Department of Civil and Architectural Engineering, KTH Royal Institute of Technology, Stockholm, Sweden(土木与建筑系运输规划部,皇家理工学院,斯德哥尔摩,瑞典);Digital Futures, KTH Royal Institute of Technology, Stockholm, Sweden(数字未来,皇家理工学院,斯德哥尔摩,瑞典)
Enhancing the Utility of Privacy-Preserving Cancer Classification using Synthetic Data
Universitat de Barcelona(巴塞罗那大学);Helmholtz Center Munich(慕尼黑亥姆霍兹中心);Technical University of Munich(慕尼黑工业大学);Imperial College London(伦敦帝国学院);Computer Vision Center(计算机视觉中心);Kings College London(伦敦国王学院);Institució Catalana de Recerca i Estudis Avançats (ICREA)(加泰罗尼亚高等研究院(ICREA))
Synthetic Data in Education: Empirical Insights from Traditional Resampling and Deep Generative Models
The Beacom College of Computer \& Cyber Sciences, Dakota State University Knight Foundation School of Computing \& Information Sciences, Florida International University
Synthetic Data: Revisiting the Privacy-Utility Trade-off
Dept. of Computer Science, University of Manitoba, Canada(曼尼托巴大学计算机科学系);Dept. of Computer Science and Software Engineering, Concordia University, Canada(Concordia大学计算机科学与软件工程系)
SMOTE-DP: Improving Privacy-Utility Tradeoff with Synthetic Data
University of Texas at Dallas Richardson, TX 75082(德克萨斯大学达拉斯分校);Vanderbilt University Medical Center Nashville, TN 37232(范德比尔特大学医学中心);Virginia Tech Blacksburg, VA 24061(弗吉尼亚理工大学)
TAPAS: a Toolbox for Adversarial Privacy Auditing of Synthetic Data
The Alan Turing Institute(艾伦·图灵研究所);The Office for National Statistics(英国国家统计局);University of Oxford(牛津大学);University of Glasgow(格拉斯哥大学);University of Edinburgh(爱丁堡大学)
When T2I Synthetic Data Backfires: Amplified Privacy Risks in Real-Synthetic Mix Training
Nanjing University of Science and Technology(南京理工大学);The University of Newcastle(纽卡斯尔大学);Southeast University(东南大学);Sungkyunkwan University(成均馆大学);The University of Western Australia(西澳大学)
Empirical Evaluation of Structured Synthetic Data Privacy Metrics: Novel experimental framework
Aindo SpA(Aindo公司);University of Trieste(的里雅斯特大学);Alma Mater Studiorum, University of Bologna(博洛尼亚大学);Vrije Universiteit Brussel(布鲁塞尔自由大学);Luiss University(卢伊斯大学)
Privacy Amplification Through Synthetic Data: Insights from Linear Regression
Craft AI;Université de Lille(里尔大学);Inria(法国国家信息与自动化研究所);CNRS(法国国家科学研究中心);Centrale Lille(里尔中央理工学院);Université de Montpellier(蒙彼利埃大学);INSERM(法国国家健康与医学研究院)
Privacy-Preserving Statistical Data Generation: Application to Sepsis Detection
Instituto de Ingeniería del Conocimiento(知识工程研究所);Hospital Universitario Son Llátzer(松利亚茨大学医院);Fundación Instituto de Investigación Sanitaria Illes Balears(巴利阿里群岛卫生研究所基金会);BBforTAI;Universidad Autónoma de Madrid(马德里自治大学)
Privacy-preserving data sharing via probabilistic modelling
Helsinki Institute for Information Technology HIIT(赫尔辛基信息技术研究所);University of Helsinki(赫尔辛基大学);University of Manchester(曼彻斯特大学);Aalto University(阿尔托大学)