arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1604.03443cs.CV
收藏

糖尿病和糖调节受损检测的多模态融合

Multi-modal Fusion for Diabetes Mellitus and Impaired Glucose Regulation Detection

Hong Kong Polytechnic University(香港理工大学);Harbin Institute of Technology Shenzhen Graduate School(哈尔滨工业大学深圳研究生院)

Jinxing Li, David Zhang, Yongcheng Li, Jian Wu

摘要:

近年来,有效、准确地诊断糖尿病(DM)及其早期糖调节受损(IGR)引起了人们的广泛关注。中医学[3]、[5]等证明舌、面、舌下诊断作为一种无创的方法是疾病检测的合理途径。然而,大多数以前的工作只集中在一个单一的模式(舌,脸或舌下)的诊断,虽然不同的模式可以提供互补的信息,糖尿病和糖耐量异常的诊断。在本文中,我们提出了一种新的多模态分类方法来区分糖尿病(或IGR)和健康对照。特别是,舌头,面部和舌下图像首先通过使用非侵入性的捕获设备采集。然后分别提取这三类图像的颜色、纹理和几何特征。最后,我们所谓的多模态相似和特定的学习(MMSSL)的方法,提出了结合舌,脸和舌下的特征,不仅利用相关性,但也提取其中的个别组件。在由192例健康人、198例糖尿病患者和114例糖耐量异常患者(所有样本均来自广东省中医院)组成的数据集上的实验结果证实了该方法诊断糖尿病和糖耐量异常的有效性和优越性,与使用单一模态的情况相比。

英文摘要:

Effective and accurate diagnosis of Diabetes Mellitus (DM), as well as its early stage Impaired Glucose Regulation (IGR), has attracted much attention recently. Traditional Chinese Medicine (TCM) [3], [5] etc. has proved that tongue, face and sublingual diagnosis as a noninvasive method is a reasonable way for disease detection. However, most previous works only focus on a single modality (tongue, face or sublingual) for diagnosis, although different modalities may provide complementary information for the diagnosis of DM and IGR. In this paper, we propose a novel multi-modal classification method to discriminate between DM (or IGR) and healthy controls. Specially, the tongue, facial and sublingual images are first collected by using a non-invasive capture device. The color, texture and geometry features of these three types of images are then extracted, respectively. Finally, our so-called multi-modal similar and specific learning (MMSSL) approach is proposed to combine features of tongue, face and sublingual, which not only exploits the correlation but also extracts individual components among them. Experimental results on a dataset consisting of 192 Healthy, 198 DM and 114 IGR samples (all samples were obtained from Guangdong Provincial Hospital of Traditional Chinese Medicine) substantiate the effectiveness and superiority of our proposed method for the diagnosis of DM and IGR, compared to the case of using a single modality.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑