arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2004.14254cs.AIcs.CL
收藏

Hierarchical Reinforcement Learning for Automatic Disease Diagnosis(面向自动疾病诊断的分层强化学习)

Hierarchical Reinforcement Learning for Automatic Disease Diagnosis

Fudan University(复旦大学);Alibaba Group(阿里巴巴集团);Microsoft Research(微软研究院)

Cheng Zhong, Kangenbei Liao, Wei Chen, Qianlong Liu, Baolin Peng, Xuanjing Huang, Jiajie Peng, Zhongyu Wei

AI总结:

针对现有扁平策略疾病诊断对话系统在真实场景下效率不足的问题,提出融入两层分层策略的诊断方法,在多数据集上取得更高准确率和症状召回率,并构建基准推动后续研究。

摘要:

研究背景与问题:面向疾病诊断的对话系统将交互式问诊过程建模为马尔可夫决策过程,并采用强化学习算法求解该问题。现有方法通常采用扁平策略结构,在决策时对所有症状和疾病同等对待。该策略在动作空间较小的简单场景下效果良好,但在真实环境中其效率会面临挑战。\n提出的方法与技术细节:受线下问诊流程启发,我们提出将两层分层策略结构融入对话系统以进行策略学习。高层策略由一个负责触发低层模型的主模型(master model)构成,低层策略包含若干症状检查器和一个疾病分类器。所提出的策略结构能够处理包含大量疾病和症状的诊断问题。\n实验设置与结果:在三个真实世界数据集和一个合成数据集上的实验结果表明,与现有系统相比,我们的分层框架在疾病诊断中实现了更高的准确率和症状召回率。我们构建了一个包含数据集和现有算法实现的基准(benchmark),以鼓励后续研究。\n可用性与补充信息:代码和数据可从https://github.com/FudanDISC/DISCOpen-MedBox-DialoDiagnosis 获取,联系邮箱为21210980124@m.fudan.edu.cn,补充数据可在Bioinformatics在线获取。

英文摘要:

Motivation: Disease diagnosis oriented dialogue system models the interactive consultation procedure as Markov Decision Process and reinforcement learning algorithms are used to solve the problem. Existing approaches usually employ a flat policy structure that treat all symptoms and diseases equally for action making. This strategy works well in the simple scenario when the action space is small, however, its efficiency will be challenged in the real environment. Inspired by the offline consultation process, we propose to integrate a hierarchical policy structure of two levels into the dialogue systemfor policy learning. The high-level policy consists of amastermodel that is responsible for triggering a low-levelmodel, the lowlevel policy consists of several symptom checkers and a disease classifier. The proposed policy structure is capable to deal with diagnosis problem including large number of diseases and symptoms. Results: Experimental results on three real-world datasets and a synthetic dataset demonstrate that our hierarchical framework achieves higher accuracy and symptom recall in disease diagnosis compared with existing systems. We construct a benchmark including datasets and implementation of existing algorithms to encourage follow-up researches. Availability: The code and data is available from https://github.com/FudanDISC/DISCOpen-MedBox-DialoDiagnosis Contact: 21210980124@m.fudan.edu.cn Supplementary information: Supplementary data are available at Bioinformatics online.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑