arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2008.10327cs.CLcs.AIcs.LG
收藏

知识驱动的中医阅读理解表示学习:任务、模型与资源

Knowledge-Empowered Representation Learning for Chinese Medical Reading Comprehension: Task, Model and Resources

East China Normal University(华东师范大学);Alibaba Group(阿里巴巴集团);DXY(丁香园)

Taolin Zhang, Chengyu Wang, Minghui Qiu, Bite Yang, Xiaofeng He, Jun Huang

摘要:

机器阅读理解(MRC)的目的是从文章中抽取问题的答案。近年来,它得到了广泛的研究,特别是在开放域中。然而,很少有人在闭域MRC上做出努力,主要是由于缺乏大规模的训练数据。本文提出了一种面向医学领域的多目标MRC任务,其目标是同时从医学信息源中预测医学问题的答案和相应的支持语句,以保证医学知识服务的高可靠性。为此,人工构建了一个高质量的数据集,命名为多任务中国医学MRC数据集(CMedMRC),并进行了详细的分析。提出了中医BERT任务模型(CMed BERT),通过异构特征动态融合机制和多任务学习策略,将医学知识融合到预先训练好的语言模型中。实验表明,CMedBERT通过融合上下文感知和知识感知的令牌表示,始终优于强基线。

英文摘要:

Machine Reading Comprehension (MRC) aims to extract answers to questions given a passage. It has been widely studied recently, especially in open domains. However, few efforts have been made on closed-domain MRC, mainly due to the lack of large-scale training data. In this paper, we introduce a multi-target MRC task for the medical domain, whose goal is to predict answers to medical questions and the corresponding support sentences from medical information sources simultaneously, in order to ensure the high reliability of medical knowledge serving. A high-quality dataset is manually constructed for the purpose, named Multi-task Chinese Medical MRC dataset (CMedMRC), with detailed analysis conducted. We further propose the Chinese medical BERT model for the task (CMedBERT), which fuses medical knowledge into pre-trained language models by the dynamic fusion mechanism of heterogeneous features and the multi-task learning strategy. Experiments show that CMedBERT consistently outperforms strong baselines by fusing context-aware and knowledge-aware token representations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑