DeepStroke:采用多模式对抗性深度学习的急诊室高效中风筛查框架
DeepStroke: An Efficient Stroke Screening Framework for Emergency Rooms with Multimodal Adversarial Deep Learning
摘要:
在急诊室(ER)环境中,中风分类或筛查是一个常见的挑战。由于MRI的低通量和高成本,通常使用快速CT代替MRI。在此过程中通常会参考临床测试,但误诊率仍然很高。我们提出了一种新的多模态深度学习框架DeepStroke,通过识别急性环境中疑似中风患者的轻微面部肌肉不协调和言语障碍模式,实现计算机辅助中风存在评估。我们提出的DeepStroke需要一分钟的面部视频数据和音频数据,这些数据在中风分类过程中随时可用,用于局部面瘫检测和全局语言障碍分析。采用迁移学习减少人脸属性偏差,提高泛化能力。我们利用多模态横向融合来结合低级和高级特征,并为联合训练提供相互正则化。引入新的对抗训练以获得无身份和笔划区分特征。在我们的视频-音频数据集上与实际ER患者进行的实验表明,DeepStroke优于最先进的模型,并且比分诊团队和ER医生的性能更好,当特异性对齐时,比传统的中风分诊高出10.94%的灵敏度和7.37%的准确度。同时,每个评估可以在不到六分钟的时间内完成,证明了该框架在临床翻译方面的巨大潜力。
英文摘要:
In an emergency room (ER) setting, stroke triage or screening is a common challenge. A quick CT is usually done instead of MRI due to MRI's slow throughput and high cost. Clinical tests are commonly referred to during the process, but the misdiagnosis rate remains high. We propose a novel multimodal deep learning framework, DeepStroke, to achieve computer-aided stroke presence assessment by recognizing patterns of minor facial muscles incoordination and speech inability for patients with suspicion of stroke in an acute setting. Our proposed DeepStroke takes one-minute facial video data and audio data readily available during stroke triage for local facial paralysis detection and global speech disorder analysis. Transfer learning was adopted to reduce face-attribute biases and improve generalizability. We leverage a multi-modal lateral fusion to combine the low- and high-level features and provide mutual regularization for joint training. Novel adversarial training is introduced to obtain identity-free and stroke-discriminative features. Experiments on our video-audio dataset with actual ER patients show that DeepStroke outperforms state-of-the-art models and achieves better performance than both a triage team and ER doctors, attaining a 10.94% higher sensitivity and maintaining 7.37% higher accuracy than traditional stroke triage when specificity is aligned. Meanwhile, each assessment can be completed in less than six minutes, demonstrating the framework's great potential for clinical translation.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。