通过人工智能减少医学课程内容中对少数群体的偏见以实现更公平的健康结果
Reducing Biases towards Minoritized Populations in Medical Curricular Content via Artificial Intelligence for Fairer Health Outcomes
AI总结:
本文提出BRICC首创举措,利用机器学习构建医学偏见分类器以识别课程中的偏见信息,并评估多种训练策略,为医学课程去偏见化奠定基础。
摘要:
有偏见的信息(近期被称为“bisinformation”)持续在医学课程中被教授,往往在其被驳斥很久之后仍然存在。在本文中,我们介绍了BRICC,这是一项首创性举措,旨在利用机器学习系统性地识别和标记具有潜在偏见的文本,以供后续以“专家在环”的方式进行审查,从而大大加速原本劳动密集型的流程。一个金标准BRICC数据集经过数年开发而成,包含超过12K页的教学材料。医学专家根据全面的编码指南对这些文档进行了细致的偏见标注,重点关注性别、生理性别、年龄、地理、族裔和种族。利用这一标注数据集,我们训练、验证和测试了医学偏见分类器。我们测试了三种分类器方法:二元类型特定分类器、通用偏见分类器、结合独立训练的偏见类型特定分类器的集成方法,以及一个多任务学习(MTL)模型,该模型的任务是同时预测通用偏见和类型特定偏见。虽然MTL在种族偏见检测的F1分数方面带来了一些改进,但它并未优于针对每个任务专门训练的二元分类器。在通用偏见检测上,二元分类器达到了最高0.923的AUC,比基线提高了27.8%。这项工作通过探索一个新颖的数据集并评估不同的训练模型策略,为医学课程去偏见化奠定了基础。因此,它为更细致、更有效地缓解bisinformation提供了新的路径。
英文摘要:
Biased information (recently termed bisinformation) continues to be taught in medical curricula, often long after having been debunked. In this paper, we introduce BRICC, a firstin-class initiative that seeks to mitigate medical bisinformation using machine learning to systematically identify and flag text with potential biases, for subsequent review in an expert-in-the-loop fashion, thus greatly accelerating an otherwise labor-intensive process. A gold-standard BRICC dataset was developed throughout several years, and contains over 12K pages of instructional materials. Medical experts meticulously annotated these documents for bias according to comprehensive coding guidelines, emphasizing gender, sex, age, geography, ethnicity, and race. Using this labeled dataset, we trained, validated, and tested medical bias classifiers. We test three classifier approaches: a binary type-specific classifier, a general bias classifier; an ensemble combining bias type-specific classifiers independently-trained; and a multitask learning (MTL) model tasked with predicting both general and type-specific biases. While MTL led to some improvement on race bias detection in terms of F1-score, it did not outperform binary classifiers trained specifically on each task. On general bias detection, the binary classifier achieves up to 0.923 of AUC, a 27.8% improvement over the baseline. This work lays the foundations for debiasing medical curricula by exploring a novel dataset and evaluating different training model strategies. Hence, it offers new pathways for more nuanced and effective mitigation of bisinformation.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。