arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.08930cs.LGcs.AI
收藏

心血管系统信号中的高效多视图融合与对视图缺失的灵活适配

Efficient Multi-View Fusion and Flexible Adaptation to View Missing in Cardiovascular System Signals

Center for Biomedical Engineering, School of Information Science and Technology, Fudan University(复旦大学信息科学与工程学院生物医学工程中心)

Qihan Hu, Daomiao Wang, Hong Wu, Jian Liu, Cuiwei Yang

AI总结:

针对心血管多视图信号的异步异质性与视图缺失问题,提出VCT、M2AE及提示适配方法,在三类健康监测任务上验证了更优融合性能与缺失鲁棒性。

摘要:

深度学习的发展和传感器的广泛采用促进了有关心血管系统(CVS)信号的自动化多视图融合(MVF)。然而,主流MVF模型架构往往将来自相同时间步但不同视图的CVS信号合并为统一表示,忽视了心血管事件的异步特性以及各视图之间固有的异质性,从而导致灾难性的视图混淆。为获得全面表示而专门为MVF模型定制的高效训练策略也需要同时加以考虑。关键在于,现实世界数据经常以不完整视图的形式出现,而这一方面很少受到研究人员关注。因此,本文专门设计了以视图为中心的Transformer(View-Centric Transformer,VCT)和多任务掩码自编码器(Multitask Masked Autoencoder,M2AE),以强调每个视图的中心性,并利用未标注数据获得更优的融合表示。此外,我们首次系统性地定义了缺失视图问题,并引入提示技术来帮助预训练MVF模型灵活适配各种缺失视图场景。涉及房颤检测、血压估计和睡眠分期这三类典型健康监测任务的严格实验表明,与现有主流方法相比,我们的方法在MVF方面具有显著优势。值得注意的是,该提示技术只需微调整个模型中不到3%的数据,就在避免完全重新训练的同时,显著增强了模型对视图缺失的韧性。结果证明了我们方法的有效性,凸显了其在心血管健康监测实际应用中的潜力。代码和模型已发布于URL。

英文摘要:

The progression of deep learning and the widespread adoption of sensors have facilitated automatic multi-view fusion (MVF) about the cardiovascular system (CVS) signals. However, prevalent MVF model architecture often amalgamates CVS signals from the same temporal step but different views into a unified representation, disregarding the asynchronous nature of cardiovascular events and the inherent heterogeneity across views, leading to catastrophic view confusion. Efficient training strategies specifically tailored for MVF models to attain comprehensive representations need simultaneous consideration. Crucially, real-world data frequently arrives with incomplete views, an aspect rarely noticed by researchers. Thus, the View-Centric Transformer (VCT) and Multitask Masked Autoencoder (M2AE) are specifically designed to emphasize the centrality of each view and harness unlabeled data to achieve superior fused representations. Additionally, we systematically define the missing-view problem for the first time and introduce prompt techniques to aid pretrained MVF models in flexibly adapting to various missing-view scenarios. Rigorous experiments involving atrial fibrillation detection, blood pressure estimation, and sleep staging-typical health monitoring tasks-demonstrate the remarkable advantage of our method in MVF compared to prevailing methodologies. Notably, the prompt technique requires finetuning less than 3% of the entire model's data, substantially fortifying the model's resilience to view missing while circumventing the need for complete retraining. The results demonstrate the effectiveness of our approaches, highlighting their potential for practical applications in cardiovascular health monitoring. Codes and models are released at URL.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑