arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2510.09162cs.AIcs.CY
收藏

Dr. Bias:AI 驱动的医疗指导中的社会差异

Dr. Bias: Social Disparities in AI-Powered Medical Guidance

Mila - Quebec AI Institute(魁北克人工智能研究所);Centre for Advanced Studies in Bioscience Innovation Law, Faculty of Law, University of Copenhagen(哥本哈根大学法学院生物科学创新研究中心);Center for the Study of Democratic Citizenship, Department of Political Science, McGill University(麦吉尔大学政治科学系民主公民研究所以及)

Emma Kondrup, Anne Imouza

AI总结:

本研究分析LLM生成的医疗建议,发现不同社会群体(尤其原住民和双性人)收到的回复存在系统性差异,呼吁开发者调查并缓解偏见。

摘要:

随着大型语言模型(LLMs)的快速发展,普通公众现在可以轻松且负担得起地使用能够以个性化方式回答大多数健康相关问题的应用程序。这些LLM日益展现出竞争力,在某些医疗能力上甚至已经超越专业人士。考虑到它们提供了广泛可及、近乎免费的医疗保健支持的可能性,它们在资源匮乏的环境中尤其具有前景。然而,推动这些动机的评估严重缺乏对医疗保健社会属性的洞察,忽视了社会群体之间的健康差异,以及偏见如何转化为LLM生成的医疗建议并影响用户。我们提供了一项探索性分析,针对涵盖关键临床领域的一系列医疗问题,模拟了由性别、年龄范围和种族不同的多个患者档案提出的这些问题。通过比较生成回复的自然语言特征,我们表明,当LLM用于医疗建议生成时,它们生成的回复在不同社会群体之间系统性地存在差异。特别是,原住民和双性人患者收到的建议可读性较低且更为复杂。我们观察到,当考虑交叉群体时,这些趋势会加剧。考虑到个人对这些模型日益增长的信任,我们主张提高AI素养,并迫切需要AI开发者进行调查和缓解,以确保这些系统性差异得以减少,并且不会转化为不公正的患者支持。我们的代码已在GitHub上公开。

英文摘要:

With the rapid progress of Large Language Models (LLMs), the general public now has easy and affordable access to applications capable of answering most health-related questions in a personalized manner. These LLMs are increasingly proving to be competitive, and now even surpass professionals in some medical capabilities. They hold particular promise in low-resource settings, considering they provide the possibility of widely accessible, quasi-free healthcare support. However, evaluations that fuel these motivations highly lack insights into the social nature of healthcare, oblivious to health disparities between social groups and to how bias may translate into LLM-generated medical advice and impact users. We provide an exploratory analysis of LLM answers to a series of medical questions spanning key clinical domains, where we simulate these questions being asked by several patient profiles that vary in sex, age range, and ethnicity. By comparing natural language features of the generated responses, we show that, when LLMs are used for medical advice generation, they generate responses that systematically differ between social groups. In particular, Indigenous and intersex patients receive advice that is less readable and more complex. We observe these trends amplify when intersectional groups are considered. Considering the increasing trust individuals place in these models, we argue for higher AI literacy and for the urgent need for investigation and mitigation by AI developers to ensure these systemic differences are diminished and do not translate to unjust patient support. Our code is publicly available on GitHub.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑