arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2305.15964cs.CV
收藏

ChatCAD+:利用大语言模型实现通用且可靠的交互式计算机辅助诊断

ChatCAD+: Towards a Universal and Reliable Interactive CAD using LLMs

School of Biomedical Engineering, ShanghaiTech University(上海科技大学生物医学工程学院);School of Biomedical Engineering, Shanghai Jiao Tong University(上海交通大学生物医学工程学院);Shanghai United Imaging Intelligence Co., Ltd.(上海联影智能医疗科技有限公司);Shanghai Clinical Research and Trial Center(上海临床研究与试验中心)

Zihao Zhao, Sheng Wang, Jinchen Gu, Yitao Zhu, Lanzhuju Mei, Zixu Zhuang, Zhiming Cui, Qian Wang, Dinggang Shen

AI总结:

针对现有大语言模型辅助CAD存在的适用影像领域受限、诊断能力不足、医学专业深度不够的问题,提出ChatCAD+,通过分层上下文学习的可靠报告生成模块和依托权威医学网站的交互模块,实现通用可靠的交互式医学辅助诊断。

摘要:

计算机辅助诊断(Computer-Aided Diagnosis, CAD)与大语言模型(Large Language Models, LLMs)的融合是临床应用中极具前景的前沿方向,尤其在实现放射科医生式的自动化诊断流程、提供类似虚拟家庭医生的问诊咨询方面潜力显著。尽管这种融合前景可观,但现有研究至少存在两方面局限:(1)从放射科医生视角看,现有研究的适用影像领域通常较为受限,无法满足不同患者的诊断需求;同时LLM的诊断能力不足,进一步降低了生成的医学报告的质量与可靠性。(2)当前LLM的医学专业知识深度不足,在患者问诊中提供的建议可能存在不可靠性,因此作为虚拟家庭医生的效果不佳。为解决上述局限,我们提出了兼具通用性与可靠性的ChatCAD+。具体而言,它包含两大核心模块:(1)可靠报告生成模块;(2)可靠交互模块。可靠报告生成模块可解读多领域的医学影像,并通过我们提出的分层上下文学习生成高质量医学报告。同时,交互模块利用权威医学网站的最新信息提供可靠的医学建议。两大模块协同作用,可紧密匹配人类医学专业人员的专业能力,提升影像解读与建议的一致性与可靠性。项目源代码可在https://github.com/zhaozh10/ChatCAD 获取。

英文摘要:

The integration of Computer-Aided Diagnosis (CAD) with Large Language Models (LLMs) presents a promising frontier in clinical applications, notably in automating diagnostic processes akin to those performed by radiologists and providing consultations similar to a virtual family doctor. Despite the promising potential of this integration, current works face at least two limitations: (1) From the perspective of a radiologist, existing studies typically have a restricted scope of applicable imaging domains, failing to meet the diagnostic needs of different patients. Also, the insufficient diagnostic capability of LLMs further undermine the quality and reliability of the generated medical reports. (2) Current LLMs lack the requisite depth in medical expertise, rendering them less effective as virtual family doctors due to the potential unreliability of the advice provided during patient consultations. To address these limitations, we introduce ChatCAD+, to be universal and reliable. Specifically, it is featured by two main modules: (1) Reliable Report Generation and (2) Reliable Interaction. The Reliable Report Generation module is capable of interpreting medical images from diverse domains and generate high-quality medical reports via our proposed hierarchical in-context learning. Concurrently, the interaction module leverages up-to-date information from reputable medical websites to provide reliable medical advice. Together, these designed modules synergize to closely align with the expertise of human medical professionals, offering enhanced consistency and reliability for interpretation and advice. The source code is available at https://github.com/zhaozh10/ChatCAD.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑