数据和AI模型引起的健康不平等的量化
Quantifying Health Inequalities Induced by Data and AI Models
摘要:
人工智能技术在包括医疗保健在内的关键环境中得到越来越多的测试和应用。如果没有有效的方法来检测和减轻人工智能引起的不平等,人工智能可能弊大于利,可能导致潜在的不平等扩大。本文提出了一个通用的分配恶化框架,用于检测和量化人工智能引起的不平等。具体而言,AI引起的不平等被量化为两个分配恶化曲线之间的面积。为了评估该框架的性能,在HiRID生成的十个合成数据集(N> 33,000)上进行了实验-HiRID是一个真实世界的重症监护病房(ICU)数据集,显示了其准确检测和量化不平等与受控不平等成比例的能力。进行了广泛的分析,以量化健康不平等(a)嵌入在两个真实世界的ICU数据集中;(b)由两个资源分配场景训练的AI模型引起。结果显示,与男性相比,女性在进入HiRID ICU时,预后标志物的恶化程度高达33%。与白人患者相比,评估的所有四种AI模型均显示出非白人患者的显著不平等(2.45%至43.2%)。在8项评估中,有3项评估的模型显著加剧了数据中的不平等现象,其中一项评估的结果是9倍以上。代码库位于https://github.com/knowlab/DAindex-Framework。
英文摘要:
AI technologies are being increasingly tested and applied in critical environments including healthcare. Without an effective way to detect and mitigate AI induced inequalities, AI might do more harm than good, potentially leading to the widening of underlying inequalities. This paper proposes a generic allocation-deterioration framework for detecting and quantifying AI induced inequality. Specifically, AI induced inequalities are quantified as the area between two allocation-deterioration curves. To assess the framework's performance, experiments were conducted on ten synthetic datasets (N>33,000) generated from HiRID - a real-world Intensive Care Unit (ICU) dataset, showing its ability to accurately detect and quantify inequality proportionally to controlled inequalities. Extensive analyses were carried out to quantify health inequalities (a) embedded in two real-world ICU datasets; (b) induced by AI models trained for two resource allocation scenarios. Results showed that compared to men, women had up to 33% poorer deterioration in markers of prognosis when admitted to HiRID ICUs. All four AI models assessed were shown to induce significant inequalities (2.45% to 43.2%) for non-White compared to White patients. The models exacerbated data embedded inequalities significantly in 3 out of 8 assessments, one of which was >9 times worse. The codebase is at https://github.com/knowlab/DAindex-Framework.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。