多模态信息融合 - arXivDaily 专题

2501.11276 2025-01-22 eess.IV cs.CV 62%

ITCFN: Incomplete Triple-Modal Co-Attention Fusion Network for Mild Cognitive Impairment Conversion Prediction

Xiangyang Hu, Xiangyu Shen, Yifei Sun, Xuhao Shan, Wenwen Min, Liyilei Su, Xiaomao Fan, Ahmed Elazab, Ruiquan Ge, Changmiao Wang, Xiaopeng Fan

专题命中医学影像融合：multimodal fusion(abstract)；分类 cs.CV、eess.IV

Comments 5 pages, 1 figure, accepted by IEEE ISBI 2025

2404.02394 2024-12-30 eess.IV cs.CV 62%

Cohort-Individual Cooperative Learning for Multimodal Cancer Survival Analysis

Huajun Zhou, Fengtao Zhou, Hao Chen

专题命中医学影像融合：multimodal fusion(abstract)；分类 cs.CV、eess.IV

Comments 10 pages, 9 figures

2411.15233 2024-12-10 eess.IV cs.CV 62%

Learning Volumetric Neural Deformable Models to Recover 3D Regional Heart Wall Motion from Multi-Planar Tagged MRI

Meng Ye, Bingyu Xin, Bangwei Guo, Leon Axel, Dimitris Metaxas

专题命中医学影像融合：information fusion(abstract)；分类 cs.CV、eess.IV

2403.06801 2024-07-08 eess.IV cs.CV 62%

CT2Rep: Automated Radiology Report Generation for 3D Medical Imaging

Ibrahim Ethem Hamamci, Sezgin Er, Bjoern Menze

专题命中医学影像融合：multi-modal fusion(abstract)；分类 cs.CV、eess.IV

2405.01658 2024-05-06 eess.IV cs.CV 62%

MMIST-ccRCC: A Real World Medical Dataset for the Development of Multi-Modal Systems

Tiago Mota, M. Rita Verdelho, Alceu Bissoto, Carlos Santiago, Catarina Barata

专题命中医学影像融合：multi-modal fusion(abstract)；分类 cs.CV、eess.IV

Comments Accepted in DCA in MI Workshop@CVPR2024

2404.07473 2024-04-12 eess.IV cs.CV cs.LG 62%

LUCF-Net: Lightweight U-shaped Cascade Fusion Network for Medical Image Segmentation

Songkai Sun, Qingshan She, Yuliang Ma, Rihui Li, Yingchun Zhang

专题命中医学影像融合：information fusion(abstract)；分类 cs.CV、eess.IV

2404.00144 2024-04-02 eess.IV cs.CV 62%

An Interpretable Cross-Attentive Multi-modal MRI Fusion Framework for Schizophrenia Diagnosis

Ziyu Zhou, Anton Orlichenko, Gang Qu, Zening Fu, Vince D Calhoun, Zhengming Ding, Yu-Ping Wang

专题命中医学影像融合：multi-modal fusion(abstract)；分类 cs.CV、eess.IV

2306.16324 2024-03-29 eess.IV cs.CV 62%

DoseDiff: Distance-aware Diffusion Model for Dose Prediction in Radiotherapy

Yiwen Zhang, Chuanpu Li, Liming Zhong, Zeli Chen, Wei Yang, Xuetao Wang

专题命中医学影像融合：information fusion(abstract)；分类 cs.CV、eess.IV

2311.10798 2023-11-21 cs.LG cs.AI cs.CV eess.IV 62%

INSPECT: A Multimodal Dataset for Pulmonary Embolism Diagnosis and Prognosis

Shih-Cheng Huang, Zepeng Huo, Ethan Steinberg, Chia-Chun Chiang, Matthew P. Lungren, Curtis P. Langlotz, Serena Yeung, Nigam H. Shah, Jason A. Fries

专题命中医学影像融合：multimodal fusion(abstract)；分类 cs.CV、eess.IV

2311.01308 2023-11-03 eess.IV cs.CV 62%

Hybrid-Fusion Transformer for Multisequence MRI

Jihoon Cho, Jinah Park

专题命中医学影像融合：hybrid fusion(abstract)；分类 cs.CV、eess.IV

Comments 10 pages, 4 figures

2310.02690 2023-10-05 eess.IV cs.CV 62%

Multi-Dimension-Embedding-Aware Modality Fusion Transformer for Psychiatric Disorder Clasification

Guoxin Wang, Xuyang Cao, Shan An, Fengmei Fan, Chao Zhang, Jinsong Wang, Feng Yu, Zhiren Wang

专题命中医学影像融合：information fusion(abstract)；分类 cs.CV、eess.IV

2307.07807 2023-07-18 eess.IV cs.CV 62%

MUVF-YOLOX: A Multi-modal Ultrasound Video Fusion Network for Renal Tumor Diagnosis

Junyu Li, Han Huang, Dong Ni, Wufeng Xue, Dongmei Zhu, Jun Cheng

专题命中医学影像融合：multi-modal fusion(abstract)；分类 cs.CV、eess.IV

Comments MICCAI 2023

2307.00873 2023-07-04 eess.IV cs.CV 62%

End-To-End Prediction of Knee Osteoarthritis Progression With Multi-Modal Transformers

Egor Panfilov, Simo Saarakkala, Miika T. Nieminen, Aleksei Tiulpin

专题命中医学影像融合：multi-modal fusion(abstract)；分类 cs.CV、eess.IV

2304.02883 2023-04-07 eess.IV cs.CV 62%

GA-HQS: MRI reconstruction via a generically accelerated unfolding approach

Jiawei Jiang, Yuchao Feng, Honghui Xu, Wanjun Chen, Jianwei Zheng

专题命中医学影像融合：information fusion(abstract)；分类 cs.CV、eess.IV

2302.03537 2023-02-08 eess.IV cs.CV 62%

Aligning Multi-Sequence CMR Towards Fully Automated Myocardial Pathology Segmentation

Wangbin Ding, Lei Li, Junyi Qiu, Sihan Wang, Liqin Huang, Yinyin Chen, Shan Yang, Xiahai Zhuang

专题命中医学影像融合：information fusion(abstract)；分类 cs.CV、eess.IV

2302.01788 2023-02-06 eess.IV cs.CV 62%

IMPORTANT-Net: Integrated MRI Multi-Parameter Reinforcement Fusion Generator with Attention Network for Synthesizing Absent Data

Tianyu Zhang, Tao Tan, Luyi Han, Xin Wang, Yuan Gao, Jonas Teuwen, Regina Beets-Tan, Ritse Mann

专题命中医学影像融合：information fusion(abstract)；分类 cs.CV、eess.IV

2209.02126 2022-09-07 eess.IV cs.CV 62%

Domain Generalization for Prostate Segmentation in Transrectal Ultrasound Images: A Multi-center Study

Sulaiman Vesal, Iani Gayo, Indrani Bhattacharya, Shyam Natarajan, Leonard S. Marks, Dean C Barratt, Richard E. Fan, Yipeng Hu, Geoffrey A. Sonn, Mirabela Rusu

专题命中医学影像融合：image fusion(abstract)；分类 cs.CV、eess.IV

Comments Accepted to the journal of Medical Image Analysis (MedIA)

2208.14876 2022-09-01 eess.IV cs.CV 62%

NestedFormer: Nested Modality-Aware Transformer for Brain Tumor Segmentation

Zhaohu Xing, Lequan Yu, Liang Wan, Tong Han, Lei Zhu

专题命中医学影像融合：multi-modal fusion(abstract)；分类 cs.CV、eess.IV

Comments MICCAI2022

2207.02094 2022-07-06 eess.IV cs.CV 62%

Is a PET all you need? A multi-modal study for Alzheimer's disease using 3D CNNs

Marla Narazani, Ignacio Sarasua, Sebastian Pölsterl, Aldana Lizarraga, Igor Yakushev, Christian Wachinger

专题命中医学影像融合：multi-modal fusion(abstract)；分类 cs.CV、eess.IV

2206.14746 2022-06-30 eess.IV cs.CV 62%

Placenta Segmentation in Ultrasound Imaging: Addressing Sources of Uncertainty and Limited Field-of-View

Veronika A. Zimmer, Alberto Gomez, Emily Skelton, Robert Wright, Gavin Wheeler, Shujie Deng, Nooshin Ghavami, Karen Lloyd, Jacqueline Matthew, Bernhard Kainz, Daniel Rueckert, Joseph V. Hajnal, Julia A. Schnabel

专题命中医学影像融合：image fusion(abstract)；分类 cs.CV、eess.IV

Comments 21 pages (18 + appendix), 13 figures (9 + appendix)

2112.04984 2021-12-10 eess.IV cs.CV cs.LG 62%

Robust Weakly Supervised Learning for COVID-19 Recognition Using Multi-Center CT Images

Qinghao Ye, Yuan Gao, Weiping Ding, Zhangming Niu, Chengjia Wang, Yinghui Jiang, Minhao Wang, Evandro Fei Fang, Wade Menpes-Smith, Jun Xia, Guang Yang

专题命中医学影像融合：information fusion(abstract)；分类 cs.CV、eess.IV

Comments 32 pages, 8 figures, Applied Soft Computing

2111.11665 2021-11-30 eess.IV cs.CV 62%

RadFusion: Benchmarking Performance and Fairness for Multimodal Pulmonary Embolism Detection from CT and EHR

Yuyin Zhou, Shih-Cheng Huang, Jason Alan Fries, Alaa Youssef, Timothy J. Amrhein, Marcello Chang, Imon Banerjee, Daniel Rubin, Lei Xing, Nigam Shah, Matthew P. Lungren

专题命中医学影像融合：multimodal fusion(abstract)；分类 cs.CV、eess.IV

Comments RadFusion dataset: https://stanfordaimi.azurewebsites.net/datasets/3a7548a4-8f65-4ab7-85fa-3d68c9efc1bd

2011.00694 2020-11-03 cs.CV eess.IV 62%

Multi-Modal Active Learning for Automatic Liver Fibrosis Diagnosis based on Ultrasound Shear Wave Elastography

Lufei Gao, Ruisong Zhou, Changfeng Dong, Cheng Feng, Zhen Li, Xiang Wan, Li Liu

专题命中医学影像融合：multi-modal fusion(abstract)；分类 cs.CV、eess.IV

2002.05322 2020-02-18 eess.IV cs.CV cs.LG 62%

Physical Accuracy of Deep Neural Networks for 2D and 3D Multi-Mineral Segmentation of Rock micro-CT Images

Ying Da Wang, Mehdi Shabaninejad, Ryan T. Armstrong, Peyman Mostaghimi

专题命中医学影像融合：hybrid fusion(abstract)；分类 cs.CV、eess.IV

Comments 16 figures

2002.05000 2020-02-13 cs.CV eess.IV 62%

Hi-Net: Hybrid-fusion Network for Multi-modal MR Image Synthesis

Tao Zhou, Huazhu Fu, Geng Chen, Jianbing Shen, Ling Shao

专题命中医学影像融合：multi-modal fusion(abstract)；分类 cs.CV、eess.IV

Comments has been accepted by IEEE TMI

2608.16962 2026-08-19 eess.IV 新提交 57%

Clinical Pathways Matter for Multimodal Deep Learning in Early Alzheimers Disease Detection

临床路径对早期阿尔茨海默病检测中的多模态深度学习至关重要

Yao Lu, Solveig Kristina Hammonds, Alvaro Fernandez-Quilez

专题命中医学影像融合：multimodal fusion(abstract)；分类 eess.IV

AI总结该研究提出基于SigLIP的零样本多模态框架，结合结构MRI与常规临床变量，在ADNI队列中实现早期阿尔茨海默病风险分层，性能优于传统模型，且可扩展至纵向数据。

Comments Published

2509.22874 2026-08-06 cs.CV 版本更新 57%

Deformable Medical Image Registration with KAN-based Implicit Neural Representations

基于KAN的隐式神经表示的可变形医学图像配准

Nikita Drozdov, Marat Zinovev, Dmitry Sorokin

机构 * Lomonosov Moscow State University（罗蒙诺索夫莫斯科国立大学）

专题命中医学影像融合：multi-modal fusion(abstract)；分类 cs.CV

AI总结提出基于KAN的INR框架KAN-IDIR与RandKAN-IDIR，用于无需数据集级训练的逐对优化可变形医学图像配准，在多模态医学图像上实现高准确性、低开销与稳定性，适用于临床研究。

Comments Accepted at Machine Learning and Knowledge Extraction

2607.07091 2026-07-09 cs.CV cs.AI 新提交 57%

AT-Attn: Temporal-Aware Cross-Attention for Longitudinal Multimodal Alzheimer's Disease Diagnosis

AT-Attn：用于纵向多模态阿尔茨海默病诊断的时间感知交叉注意力机制

Xinyue Du, Yibo Liu, Zhenglei Zhou, Xuancheng Yao, Weimin Zhong, Qiuhui Chen

机构 * Xinyue Du1, Yibo Liu2, Zhenglei Zhou3, Xuancheng Yao2, Weimin Zhong1, Qiuhui Chen14（未知）

专题命中医学影像融合：multimodal fusion(abstract)；分类 cs.CV

AI总结研究针对纵向AD诊断中多模态信息整合难题，提出AT-Attn框架，结合多种技术整合MRI与临床信息，在患者级五折交叉验证中，该模型多项指标优于单模态和简单融合基线，为AD诊断提供临床相关补充信息。

Comments Submitted to IEEE BIBM 2026. 8 pages, 4 figures

2607.07027 2026-07-09 cs.LG cs.AI cs.CV 新提交 57%

Latent graph encoding of multimodal neuroimaging features with generative AI architectures

基于生成式人工智能架构的多模态神经影像特征的潜在图编码

Ishaan Batta, Meenu Ajith, Vince Calhoun

机构 * Center for Translational Research in Neuroimaging and Data Science (TReNDS)（转化神经影像与数据科学研究中心）

专题命中医学影像融合：multimodal fusion(abstract)；分类 cs.CV

AI总结研究旨在设计多模态生成框架用于神经影像特征分析，通过评估多种策略和模型，利用GMV和sFNC特征分析多个生成框架，提出的gMMVAE在多指标上超替代变体，有潜力用于稳健的多模态神经影像分析。

Comments 6 pages, accepted in IEEE International Conference on Image Processing (ICIP) 2026

2604.10702 2026-06-25 cs.CV cs.AI 版本更新 57%

Backbone-Conditional Behavior of Modality Gating in Multi-Modal Prostate MRI Segmentation: A 5-Fold Cross-Validation and Gate Mechanism Analysis

模态隔离门控融合：用于稳健多模态前列腺MRI分割的架构无关方法

Yongbo Shu, Wenzhao Xie, Shanhu Yao, Zirui Xin, Luo Lei, Kewen Chen, Aijing Luo

机构 * The Second Xiangya Hospital of Central South University（中南大学湘雅医学院第二医院）； The Third Xiangya Hospital of Central South University（中南大学湘雅医学院第三医院）； School of Life Sciences, Central South University（中南大学生命科学学院）； Hunan Provincial Key Laboratory of Medical Information Research (Central South University)（湖南省医学信息研究重点实验室（中南大学））； Hunan Provincial Clinical Medical Research Center for Cardiovascular Intelligent Medicine（湖南省心血管智能医学临床医学研究中心）

专题命中医学影像融合：multi-modal fusion(abstract)；分类 cs.CV

AI总结本文提出模态隔离门控融合（MIGF）方法，通过独立编码流和门控阶段提升多模态前列腺MRI分割的鲁棒性，实验表明其在不同模态缺失和伪影情况下均有效。

Comments Major revision. Single-fold analysis replaced by 5-fold cross-validation (180 trained models) plus a direct gate-mechanism analysis; conclusions updated to show that modality gating is backbone-conditional. Supersedes v1

1. 医学影像融合 154 篇

ITCFN: Incomplete Triple-Modal Co-Attention Fusion Network for Mild Cognitive Impairment Conversion Prediction

Cohort-Individual Cooperative Learning for Multimodal Cancer Survival Analysis

Learning Volumetric Neural Deformable Models to Recover 3D Regional Heart Wall Motion from Multi-Planar Tagged MRI

CT2Rep: Automated Radiology Report Generation for 3D Medical Imaging

MMIST-ccRCC: A Real World Medical Dataset for the Development of Multi-Modal Systems

LUCF-Net: Lightweight U-shaped Cascade Fusion Network for Medical Image Segmentation

An Interpretable Cross-Attentive Multi-modal MRI Fusion Framework for Schizophrenia Diagnosis

DoseDiff: Distance-aware Diffusion Model for Dose Prediction in Radiotherapy

INSPECT: A Multimodal Dataset for Pulmonary Embolism Diagnosis and Prognosis

Hybrid-Fusion Transformer for Multisequence MRI

Multi-Dimension-Embedding-Aware Modality Fusion Transformer for Psychiatric Disorder Clasification

MUVF-YOLOX: A Multi-modal Ultrasound Video Fusion Network for Renal Tumor Diagnosis

End-To-End Prediction of Knee Osteoarthritis Progression With Multi-Modal Transformers

GA-HQS: MRI reconstruction via a generically accelerated unfolding approach

Aligning Multi-Sequence CMR Towards Fully Automated Myocardial Pathology Segmentation

IMPORTANT-Net: Integrated MRI Multi-Parameter Reinforcement Fusion Generator with Attention Network for Synthesizing Absent Data

Domain Generalization for Prostate Segmentation in Transrectal Ultrasound Images: A Multi-center Study

NestedFormer: Nested Modality-Aware Transformer for Brain Tumor Segmentation

Is a PET all you need? A multi-modal study for Alzheimer's disease using 3D CNNs

Placenta Segmentation in Ultrasound Imaging: Addressing Sources of Uncertainty and Limited Field-of-View

Robust Weakly Supervised Learning for COVID-19 Recognition Using Multi-Center CT Images

RadFusion: Benchmarking Performance and Fairness for Multimodal Pulmonary Embolism Detection from CT and EHR

Multi-Modal Active Learning for Automatic Liver Fibrosis Diagnosis based on Ultrasound Shear Wave Elastography

Physical Accuracy of Deep Neural Networks for 2D and 3D Multi-Mineral Segmentation of Rock micro-CT Images

Hi-Net: Hybrid-fusion Network for Multi-modal MR Image Synthesis

Clinical Pathways Matter for Multimodal Deep Learning in Early Alzheimers Disease Detection

Deformable Medical Image Registration with KAN-based Implicit Neural Representations

AT-Attn: Temporal-Aware Cross-Attention for Longitudinal Multimodal Alzheimer's Disease Diagnosis

Latent graph encoding of multimodal neuroimaging features with generative AI architectures

Backbone-Conditional Behavior of Modality Gating in Multi-Modal Prostate MRI Segmentation: A 5-Fold Cross-Validation and Gate Mechanism Analysis