利用合成数据增强隐私保护癌症分类的效用
Enhancing the Utility of Privacy-Preserving Cancer Classification using Synthetic Data
AI总结:
本研究探索了DP-SGD与合成数据增强在乳腺癌分类中的隐私-效用权衡,发现合成数据预训练加DP-SGD微调可提升模型性能,并公开了代码库。
摘要:
深度学习在为放射科医生提供乳腺癌检测辅助方面具有巨大潜力。然而,由于与患者隐私相关的数据可用性和共享限制,实现最优模型性能受到阻碍。传统深度学习模型可能无意中泄露敏感的训练信息,这进一步加剧了上述担忧。本研究通过探索和量化隐私保护深度学习技术的效用来解决这些挑战,具体包括:(i) 差分隐私随机梯度下降(DP-SGD)和(ii) 由我们提出的恶性肿瘤条件生成对抗网络生成的完全合成训练数据。我们通过使用Transformer模型对乳腺X线摄影肿块进行下游恶性肿瘤分类来评估这些方法。我们的实验结果表明,合成数据增强可以改善差分隐私模型训练中的隐私-效用权衡。此外,在合成数据上预训练模型取得了显著性能,且通过DP-SGD微调可在所有隐私保证下进一步提升性能。通过这项对乳腺影像中隐私保护深度学习的首次深入探索,我们满足了当前和新兴的临床隐私要求,并为采用高效用私有深度诊断模型铺平了道路。我们可复现的代码库已在https://github.com/RichardObi/mammo_dp公开提供。
英文摘要:
Deep learning holds immense promise for aiding radiologists in breast cancer detection. However, achieving optimal model performance is hampered by limitations in availability and sharing of data commonly associated to patient privacy concerns. Such concerns are further exacerbated, as traditional deep learning models can inadvertently leak sensitive training information. This work addresses these challenges exploring and quantifying the utility of privacy-preserving deep learning techniques, concretely, (i) differentially private stochastic gradient descent (DP-SGD) and (ii) fully synthetic training data generated by our proposed malignancy-conditioned generative adversarial network. We assess these methods via downstream malignancy classification of mammography masses using a transformer model. Our experimental results depict that synthetic data augmentation can improve privacy-utility tradeoffs in differentially private model training. Further, model pretraining on synthetic data achieves remarkable performance, which can be further increased with DP-SGD fine-tuning across all privacy guarantees. With this first in-depth exploration of privacy-preserving deep learning in breast imaging, we address current and emerging clinical privacy requirements and pave the way towards the adoption of private high-utility deep diagnostic models. Our reproducible codebase is publicly available at https://github.com/RichardObi/mammo_dp.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。