arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1806.10698cs.AIcs.LGstat.APstat.ML
收藏

人工智能和人类医生在分诊和诊断方面的比较研究

A comparative study of artificial intelligence and human doctors for the purpose of triage and diagnosis

Babylon Health(巴比伦健康);Imperial College London(帝国理工学院);Yale New Haven Health(耶鲁纽黑文健康);Stanford University(斯坦福大学)
Salman Razzaki, Adam Baker, Yura Perov, Katherine Middleton, Janie Baxter, Daniel Mullarkey, Davinder Sangar, Michael Taliercio, Mobasher Butt, Azeem Majeed, Ar… 展开作者

Salman Razzaki, Adam Baker, Yura Perov, Katherine Middleton, Janie Baxter, Daniel Mullarkey, Davinder Sangar, Michael Taliercio, Mobasher Butt, Azeem Majeed, Arnold DoRosario, Megan Mahoney, Saurabh Johri

摘要:

在线症状检查器在改善患者护理方面具有巨大潜力,但其可靠性和准确性仍然存在差异。我们假设,一个人工智能(AI)驱动的分诊和诊断系统在分诊和诊断准确性方面可以与人类医生相媲美。我们对人工智能分类和诊断系统的准确性和安全性进行了前瞻性验证研究。相同的病例由人工智能系统和人类医生进行评估。鉴别诊断和分诊结果由独立法官进行评估,该法官不知道结果的来源(AI系统或人类医生)。独立于这些病例,还评估了来自公共资源的小插曲,为以前的研究和MRCGP检查的诊断部分提供基准。总的来说,我们发现Babylon AI支持的分类和诊断系统能够识别临床小插曲模拟的疾病,其准确性与人类医生相当(在精确度和召回率方面)。此外,我们发现,与独立专家法官提供的可接受的分流范围相比,人工智能系统推荐的分流建议平均而言比人类医生更安全,适当性只有很小的降低。

英文摘要:

Online symptom checkers have significant potential to improve patient care, however their reliability and accuracy remain variable. We hypothesised that an artificial intelligence (AI) powered triage and diagnostic system would compare favourably with human doctors with respect to triage and diagnostic accuracy. We performed a prospective validation study of the accuracy and safety of an AI powered triage and diagnostic system. Identical cases were evaluated by both an AI system and human doctors. Differential diagnoses and triage outcomes were evaluated by an independent judge, who was blinded from knowing the source (AI system or human doctor) of the outcomes. Independently of these cases, vignettes from publicly available resources were also assessed to provide a benchmark to previous studies and the diagnostic component of the MRCGP exam. Overall we found that the Babylon AI powered Triage and Diagnostic System was able to identify the condition modelled by a clinical vignette with accuracy comparable to human doctors (in terms of precision and recall). In addition, we found that the triage advice recommended by the AI System was, on average, safer than that of human doctors, when compared to the ranges of acceptable triage provided by independent expert judges, with only a minimal reduction in appropriateness.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑