arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2209.02965cs.LGcs.AIcs.CVcs.CYeess.IV

胸部X线摄影深度学习基础模型的偏倚风险

Risk of Bias in Chest Radiography Deep Learning Foundation Models

Imperial College London(伦敦帝国学院)

Ben Glocker, Charles Jones, Melanie Roschewitz, Stefan Winzeck

AI总结:

该研究针对胸部X线摄影基础模型,通过CheXpert数据集验证其存在种族与性别相关偏倚,会导致不同患者亚组的疾病检测性能差异,提示其临床应用存在安全风险。

摘要:

目的:分析近期发表的一款胸部X线摄影基础模型中是否存在可能导致不同生理性别与种族亚组性能差异的偏倚。材料与方法:本回顾性研究使用了CheXpert数据集中2002年10月至2017年7月间收集的42884名患者的127118张胸部X线片(患者平均年龄63岁,标准差17岁;男性23623名,女性19261名)。为确定胸部X线摄影基础模型和基线深度学习模型生成的特征中是否存在偏倚,研究采用降维方法结合双样本Kolmogorov-Smirnov检验,检测跨性别与种族的分布偏移。随后开展全面的疾病检测性能分析,将特征中的任何偏倚与不同患者亚组分类性能的具体差异相关联。结果:在跨生理性别和种族的12组成对比较中,所研究的基础模型有10组显示出统计学显著差异,而基线模型仅有4组检验结果显著。在主要捕捉疾病信息的特征投影中,男性与女性之间(P < .001)、亚裔与黑人患者之间(P < .001)均存在显著差异。与所有亚组的平均模型性能相比,女性患者“无异常”标签的分类性能下降了6.8%至7.8%,黑人患者“胸腔积液”的检测性能下降了10.7%至11.6%。结论:所研究的胸部X线摄影基础模型存在种族和性别相关偏倚,会导致不同患者亚组间的性能差异,应用于临床可能存在安全风险。

英文摘要:

Purpose: To analyze a recently published chest radiography foundation model for the presence of biases that could lead to subgroup performance disparities across biological sex and race. Materials and Methods: This retrospective study used 127,118 chest radiographs from 42,884 patients (mean age, 63 [SD] 17 years; 23,623 male, 19,261 female) from the CheXpert dataset collected between October 2002 and July 2017. To determine the presence of bias in features generated by a chest radiography foundation model and baseline deep learning model, dimensionality reduction methods together with two-sample Kolmogorov-Smirnov tests were used to detect distribution shifts across sex and race. A comprehensive disease detection performance analysis was then performed to associate any biases in the features to specific disparities in classification performance across patient subgroups. Results: Ten out of twelve pairwise comparisons across biological sex and race showed statistically significant differences in the studied foundation model, compared with four significant tests in the baseline model. Significant differences were found between male and female (P < .001) and Asian and Black patients (P < .001) in the feature projections that primarily capture disease. Compared with average model performance across all subgroups, classification performance on the 'no finding' label dropped between 6.8% and 7.8% for female patients, and performance in detecting 'pleural effusion' dropped between 10.7% and 11.6% for Black patients. Conclusion: The studied chest radiography foundation model demonstrated racial and sex-related bias leading to disparate performance across patient subgroups and may be unsafe for clinical applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑