TCM-SD:一个基于自然语言处理的中医辨证研究基准
TCM-SD: A Benchmark for Probing Syndrome Differentiation via Natural Language Processing
摘要:
中医药是一种天然、安全、有效的治疗方法,已在世界范围内推广和应用。独特的中医诊断和治疗系统需要对隐藏在以自由文本书写的临床记录中的患者症状进行全面分析。先前的研究表明,这一系统可以借助人工智能(AI)技术,如自然语言处理(NLP),实现信息化和智能化。然而,现有数据集的质量和数量都不足以支持中医药数据驱动人工智能技术的进一步发展。因此,本文围绕中医诊疗系统的核心任务--辨证论治,介绍了国内首个公开的大规模辨证论治数据集TCM-SD。我们的数据集包含54,152个真实世界的临床记录,涵盖148种综合征。在此基础上,我们收集了中医领域的大规模无标注文本语料,并提出了一个特定领域的预训练语言模型,称为ZY-BERT。我们使用深度神经网络进行了实验,以建立强大的性能基线,揭示SD中的各种挑战,并证明特定于领域的预训练语言模型的潜力。我们的研究和分析揭示了结合计算机科学和语言学知识来探索中医理论的实证有效性的机会。
英文摘要:
Traditional Chinese Medicine (TCM) is a natural, safe, and effective therapy that has spread and been applied worldwide. The unique TCM diagnosis and treatment system requires a comprehensive analysis of a patient's symptoms hidden in the clinical record written in free text. Prior studies have shown that this system can be informationized and intelligentized with the aid of artificial intelligence (AI) technology, such as natural language processing (NLP). However, existing datasets are not of sufficient quality nor quantity to support the further development of data-driven AI technology in TCM. Therefore, in this paper, we focus on the core task of the TCM diagnosis and treatment system -- syndrome differentiation (SD) -- and we introduce the first public large-scale dataset for SD, called TCM-SD. Our dataset contains 54,152 real-world clinical records covering 148 syndromes. Furthermore, we collect a large-scale unlabelled textual corpus in the field of TCM and propose a domain-specific pre-trained language model, called ZY-BERT. We conducted experiments using deep neural networks to establish a strong performance baseline, reveal various challenges in SD, and prove the potential of domain-specific pre-trained language model. Our study and analysis reveal opportunities for incorporating computer science and linguistics knowledge to explore the empirical validity of TCM theories.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。