arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2405.03010cs.AI
收藏

循证医学中面向时间紧迫型推荐的高阶推理

High Order Reasoning for Time Critical Recommendation in Evidence-based Medicine

University of Queensland(昆士兰大学)

Manjiang Yu, Xue Li

AI总结:

本文提出一种基于大型语言模型的高阶推理框架,通过“what-if”“why-not”“so-what”“how-about”四类问题辅助ICU循证医学中的时间紧迫型决策,实验显示其在治疗方案相似度、替代方案选择、动机分析、跨疾病迁移及出院后生命状态预测等方面均取得显著效果。

摘要:

在时间紧迫的决策中,人类决策者可以与具备情境感知能力的人工智能软件进行交互,在极短时间内评估众多即将发生和可能发生的场景,检索数十亿条事实,并基于数万亿个参数估计不同结果。在高阶推理中,“what-if”问题可用于质疑推理的假设或前提条件,“why-not”问题可用于质疑推理中所采用的方法,“so-what”问题可用于质疑决策的目的,而“how-about”问题可用于质疑方法的适用性。当上述高阶推理问题被用于辅助人类决策时,能够帮助人类做出时间紧迫型决策,并避免假阴性或假阳性类型的错误。本文提出了一种高阶推理模型,用于在ICU应用中为循证医学提供时间紧迫型推荐。系统中使用了大型语言模型(LLM)。实验表明,LLM在“What-if”场景中表现出最优性能,与人类医生治疗方案的相似度达到88.52%。在“Why-not”场景中,表现最佳的模型在70%的病例中倾向于为从ICU出院后死亡的患者选择替代治疗方案。在“So-what”场景中,最优模型对ICU患者治疗方案的动机和意义进行了详细分析,其推理与实际诊断信息的相似度达到55.6%。在“How-about”场景中,表现最好的LLM在为相似疾病设计迁移治疗方案时,内容相似度达到66.5%。同时,LLM能够以70%的准确率预测患者从ICU出院后的生命状态。

英文摘要:

In time-critical decisions, human decision-makers can interact with AI-enabled situation-aware software to evaluate many imminent and possible scenarios, retrieve billions of facts, and estimate different outcomes based on trillions of parameters in a fraction of a second. In high-order reasoning, "what-if" questions can be used to challenge the assumptions or pre-conditions of the reasoning, "why-not" questions can be used to challenge on the method applied in the reasoning, "so-what" questions can be used to challenge the purpose of the decision, and "how-about" questions can be used to challenge the applicability of the method. When above high-order reasoning questions are applied to assist human decision-making, it can help humans to make time-critical decisions and avoid false-negative or false-positive types of errors. In this paper, we present a model of high-order reasoning to offer recommendations in evidence-based medicine in a time-critical fashion for the applications in ICU. The Large Language Model (LLM) is used in our system. The experiments demonstrated the LLM exhibited optimal performance in the "What-if" scenario, achieving a similarity of 88.52% with the treatment plans of human doctors. In the "Why-not" scenario, the best-performing model tended to opt for alternative treatment plans in 70% of cases for patients who died after being discharged from the ICU. In the "So-what" scenario, the optimal model provided a detailed analysis of the motivation and significance of treatment plans for ICU patients, with its reasoning achieving a similarity of 55.6% with actual diagnostic information. In the "How-about" scenario, the top-performing LLM demonstrated a content similarity of 66.5% in designing treatment plans transferring for similar diseases. Meanwhile, LLMs managed to predict the life status of patients after their discharge from the ICU with an accuracy of 70%.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑