开发稳健且有效的医学人工智能(AI)模型需要访问大量患者数据。仅使用在大型多机构数据集上训练的 AI 模型可能有助于解决这一问题,但确保数据隐私的必要性仍然存在,尤其是成员推理可能危及患者保密性。作为一种拟议的补救措施,我们主张整合差分隐私(DP)。我们专门研究了在模型训练期间未曾见过的机构数据(即外部验证)上,使用 DP 训练的模型与未使用 DP 训练的模型相比的性能,这种情况反映了 AI 模型的临床使用。通过利用来自五家机构的超过 590,000 张胸部 X 光片,我们评估了 DP 增强领域迁移(DP-DT)在诊断心脏肥大、胸腔积液、肺炎、肺不张以及识别健康受试者方面的功效。我们将 DP-DT 与 non-DP-DT 进行对照,并以受试者工作特征曲线下面积(AUC)为主要指标,同时结合准确率、敏感性和特异性,检查诊断准确性和人口统计学公平性。结果表明,即使在极高隐私级别(epsilon 约为 1)下,DP-DT 的表现也与 non-DP-DT 相当(所有领域 P>0.119)。此外,相对于 non-DP-DT,DP-DT 在几乎所有亚组中仅导致不到 1% 的微小 AUC 差异。尽管一直有证据表明 DP 模型会在域内应用中造成显著性能下降,但我们证明域外性能几乎不受影响。因此,鉴于 DP 对性能影响极小,我们强烈主张在训练诊断性医疗 AI 模型时采用 DP。
英文摘要:
Developing robust and effective artificial intelligence (AI) models in medicine requires access to large amounts of patient data. The use of AI models solely trained on large multi-institutional datasets can help with this, yet the imperative to ensure data privacy remains, particularly as membership inference risks breaching patient confidentiality. As a proposed remedy, we advocate for the integration of differential privacy (DP). We specifically investigate the performance of models trained with DP as compared to models trained without DP on data from institutions that the model had not seen during its training (i.e., external validation) - the situation that is reflective of the clinical use of AI models. By leveraging more than 590,000 chest radiographs from five institutions, we evaluated the efficacy of DP-enhanced domain transfer (DP-DT) in diagnosing cardiomegaly, pleural effusion, pneumonia, atelectasis, and in identifying healthy subjects. We juxtaposed DP-DT with non-DP-DT and examined diagnostic accuracy and demographic fairness using the area under the receiver operating characteristic curve (AUC) as the main metric, as well as accuracy, sensitivity, and specificity. Our results show that DP-DT, even with exceptionally high privacy levels (epsilon around 1), performs comparably to non-DP-DT (P>0.119 across all domains). Furthermore, DP-DT led to marginal AUC differences - less than 1% - for nearly all subgroups, relative to non-DP-DT. Despite consistent evidence suggesting that DP models induce significant performance degradation for on-domain applications, we show that off-domain performance is almost not affected. Therefore, we ardently advocate for the adoption of DP in training diagnostic medical AI models, given its minimal impact on performance.
Benchmarking Differentially Private Residual Networks for Medical Imagery
OpenMined;Manifold Computing Group(曼尼福德计算集团);Ford R&A(福特研发部门);Harvard University(哈佛大学);Indian Institute of Technology Jodhpur(印度理工学院焦特布尔分校);University of Oxford(牛津大学)
Blockchain based Privacy-Preserved Federated Learning for Medical Images: A Case Study of COVID-19 CT Scans
University of Electronic Science and Technology of China(电子科技大学);Macau University of Science and Technology(澳门科技大学);Southwest Jiaotong University(西南交通大学);China Telecommunications Corporation(中国电信集团有限公司)
Homomorphic Encryption and Federated Learning based Privacy-Preserving CNN Training: COVID-19 Detection Use-Case
University of Stavanger(斯塔万格大学);Virginia Commonwealth University(弗吉尼亚联邦大学);Old Dominion University(奥尔多明尼昂大学);Norwegian University of Science and Technology(挪威科技大学)
Differential privacy for medical deep learning: methods, tradeoffs, and deployment implications
Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg(埃朗根-纽伦堡弗里德里希-亚历山大大学模式识别实验室);Department of Diagnostic and Interventional Radiology, University Hospital RWTH Aachen(亚琛大学诊断与介入放射科);Department of Radiology, Stanford University(斯坦福大学放射科);Department of Urology, Stanford University(斯坦福大学泌尿科)
Technical University of Munich(慕尼黑工业大学);Imperial College London(帝国理工学院);Arkhn;INRIA(法国国家信息与自动化研究所);ENS(巴黎高等师范学院);PSL University(巴黎文理研究大学);University of Oxford(牛津大学);Universidade Federal de Campina Grande(坎皮纳格兰德联邦大学);Cape Privacy
Differential privacy representation geometry for medical image analysis
Lab for AI in Medicine, RWTH Aachen University, Aachen, Germany(医学人工智能实验室,亚琛RWTH大学,亚琛,德国);Department of Diagnostic and Interventional Radiology, University Hospital RWTH Aachen, Aachen, Germany(诊断与介入放射学部门,RWTH亚琛大学医院,亚琛,德国);INDA Institute, RWTH Aachen University, Aachen, Germany(INDA研究所,亚琛RWTH大学,亚琛,德国)
Benchmarking Differential Privacy and Federated Learning for BERT Models
Manipal Institute of Technology(马尼帕尔理工学院);Carnegie Mellon University(卡内基梅隆大学);OpenMined;Yildiz Technical University(耶尔德兹技术大学);Ford Motor Company(福特汽车公司);University of California, San Diego(加州大学圣地亚哥分校)
TrustFed: Enabling Trustworthy Medical AI under Data Privacy Constraints
Department of Applied Mechanics(应用力学系);Indian Institute of Technology Delhi(印度理工学院德里);Grainger College of Engineering(工程学院);Nuclear, Plasma & Radiological Engineering Department(核物理与辐射工程系);National Center for Supercomputing Applications(国家超级计算应用中心);Yardi School of Artificial Intelligence (ScAI)(Yardi人工智能学院(ScAI));University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
Which Client is Reliable?: A Reliable and Personalized Prompt-based Federated Learning for Medical Image Question Answering
Graduate School of Information Science and Technology, Hokkaido University(北海道大学信息科学与技术研究院);Faculty of Information Science and Technology, Hokkaido University(北海道大学信息科学与技术学院)
Feasibility Study of Multi-Site Split Learning for Privacy-Preserving Medical Systems under Data Imbalance Constraints in COVID-19, X-Ray, and Cholesterol Dataset
Korea University(高丽大学);Hallym University(翰林大学);Dankook University(檀国大学)
Hierarchical Dual-Strategy Unlearning for Biomedical and Healthcare Intelligence Using Imperfect and Privacy-Sensitive Medical Data
Department of Neurosurgery, Qilu Hospital of Shandong University and Institute of Brain and Brain-Inspired Science(齐鲁医院山东大学神经外科和脑科学与脑启发科学研究院);Department of Neurosurgery, The Affiliated Hospital of Qingdao University(青岛大学附属医院神经外科);Department of Neurosurgery, Peking Union Medical College Hospital(北京地坛医院神经外科);School of Software and Microelectronics, Peking University(北京大学软件与微电子学院);College of Artificial Intelligence, Dalian Maritime University(大连海事大学人工智能学院);University of Colorado Boulder(科罗拉多大学波尔德分校);Zhengzhou University(郑州大学);The University of Hong Kong(香港大学);Georgia Institute of Technology(佐治亚理工学院)
Data Obfuscation through Latent Space Projection (LSP) for Privacy-Preserving AI Governance: Case Studies in Medical Diagnosis and Finance Fraud Detection
Fine-Tuning Foundation Models with Federated Learning for Privacy Preserving Medical Time Series Forecasting
University of Central Florida(中佛罗里达大学);KnowledgeVis, LLC(诺维吉斯有限责任公司);University of Michigan(密歇根大学);University of California, Davis(加州大学戴维斯分校);U.S. Army Institute of Surgical Research(美国陆军外科研究所);University of Central Florida College of Medicine(中佛罗里达大学医学院)
An Enhanced Privacy-preserving Federated Few-shot Learning Framework for Respiratory Disease Diagnosis
Key Laboratory of Smart Manufacturing in Energy Chemical Process, Ministry of Education, East China University of Science and Technology(能源化工过程智能制造重点实验室,教育部,东华大学);Research Institute of Intelligent Control and Systems, School of Astronautics, Harbin Institute of Technology(智能控制与系统研究所,航天学院,哈尔滨工业大学);Department of Emergency Medicine, Provincial Key Laboratory of Precise Diagnosis and Treatment of Abdominal Infection, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine(急诊科,腹部感染精准诊断与治疗省级重点实验室,邵氏医院,浙江大学医学院);School of Medicine, Shaoxing University(医学院,绍兴大学)