非结构化视图主题相关超声报告生成的因子注意和嵌入
Factored Attention and Embedding for Unstructured-view Topic-related Ultrasound Report Generation
摘要:
超声心动图广泛用于临床实践中的诊断和治疗,例如,常见的先天性心脏病传统的人工操作容易出错,由于人员短缺,工作量过大,经验不足,导致迫切需要一个自动化的计算机辅助报告系统,以减轻超声医生的工作量,并帮助他们做出决策。尽管最近在自动医疗报告生成方面进行了一些成功的尝试,但它们被困在超声报告生成中,其中涉及非结构化视图图像和与主题相关的描述。为此,我们研究了非结构化视图主题相关的超声报告生成的任务,并提出了一种新的因子注意和嵌入模型(称为FAE-Gen)。拟议的FAE-Gen主要由两个模块组成,即,视角引导的因子注意和面向主题的因子嵌入,1)捕捉不同视角的同质和异质形态特征,2)生成不同主题的不同句法模式和不同语义内容的描述。在即将发布的大规模临床心血管超声数据集(CardUltData)上进行实验评估。定量比较和定性分析都证明了FAE-Gen在七个常用指标上的有效性和优越性。
英文摘要:
Echocardiography is widely used to clinical practice for diagnosis and treatment, e.g., on the common congenital heart defects. The traditional manual manipulation is error-prone due to the staff shortage, excess workload, and less experience, leading to the urgent requirement of an automated computer-aided reporting system to lighten the workload of ultrasonologists considerably and assist them in decision making. Despite some recent successful attempts in automatical medical report generation, they are trapped in the ultrasound report generation, which involves unstructured-view images and topic-related descriptions. To this end, we investigate the task of the unstructured-view topic-related ultrasound report generation, and propose a novel factored attention and embedding model (termed FAE-Gen). The proposed FAE-Gen mainly consists of two modules, i.e., view-guided factored attention and topic-oriented factored embedding, which 1) capture the homogeneous and heterogeneous morphological characteristic across different views, and 2) generate the descriptions with different syntactic patterns and different emphatic contents for different topics. Experimental evaluations are conducted on a to-be-released large-scale clinical cardiovascular ultrasound dataset (CardUltData). Both quantitative comparisons and qualitative analysis demonstrate the effectiveness and the superiority of FAE-Gen over seven commonly-used metrics.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。