生物医学AI中的偏见视角:防止下游医疗保健差异
Perspective on Bias in Biomedical AI: Preventing Downstream Healthcare Disparities
AI总结:
本文通过分析2015-2024年4514篇组学出版物和大型数据集,揭示数据收集和研究中存在的严重人口偏见,并提出通过来源、开放性和评估透明度三个原则来预防下游医疗保健差异。
摘要:
医疗保健差异在社会经济边界上持续存在,通常归因于筛查、诊断和治疗的不平等获取。然而,本文观点强调,关键偏见可能在更早阶段出现,即在数据收集和研究优先级确定期间,远在临床实施之前,尤其是在关注分子和组学数据的研究中。大量研究专注于收集组学数据,但相关的人口统计信息往往未被报告,即使报告了,也显示出显著偏见。对2015年至2024年间PubMed索引的4514篇组学出版物的自动分析,检查了多个人口统计维度的报告情况,发现总体报告有限;例如,只有2.7%的研究报告了祖先或种族信息,地理来源报告仅限于2.5%。对常用于模型训练的大规模数据集(如CellxGene和GEO)的分析揭示了显著的人口偏见,其中欧洲血统数据占主导地位。随着生物医学基础模型成为生物医学发现的核心,其范式是基础模型在大数据集上预训练并反复用于许多不同的下游任务,这些模型有风险延续或放大这些早期阶段的偏见,导致监管干预无法完全逆转的级联不平等。我们提出社区范围内关注三个基本原则:来源、开放性和通过评估透明度的可靠性。这些原则共同有助于使偏见和局限性对模型开发者和用户更加可见,支持在生物医学AI中更明智的模型开发、评估和部署决策。
英文摘要:
Healthcare disparities persist across socioeconomic boundaries, often attributed to unequal access to screening, diagnostics, and therapeutics. However, this perspective highlights that critical biases can emerge much earlier, during data collection and research prioritization, long before clinical implementation, particularly in studies focused on molecular and omics data. A vast number of studies focus on collecting omics data, but the demographic information associated with these datasets is often not reported, and when it is reported, it reveals substantial biases. An automated analysis of 4514 PubMed-indexed omics publications from 2015 to 2024, examining reporting across multiple demographic dimensions, reveals limited reporting overall; for example, only 2.7% of studies report ancestry or ethnicity information and geographic origin reporting is limited to 2.5%. Analysis of large-scale datasets commonly used for model training, such as CellxGene and GEO, reveals substantial population bias where European-ancestry data dominates. As biomedical foundation models become central to biomedical discovery with a paradigm in which base models are pretrained on large datasets and reusing them repeatedly for many different downstream tasks, they risk perpetuating or amplifying these early-stage biases, leading to cascading inequities that regulatory interventions cannot fully reverse. We propose a community-wide focus on three foundational principles: Provenance, Openness, and Reliability through Evaluation Transparency. Together, these principles can help make biases and limitations more visible to model developers and users, supporting more informed model development, evaluation, and deployment decisions in biomedical AI.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。