医学 AI

Cross-modal dependence analysis with asynchronous longitudinal multimodal data

异步纵向多模态数据的跨模态依赖分析

Kun Qian, Hyung G. Park

专题命中 医疗多模态 ：diagnosis(abstract)；biomedical(abstract)

AI总结 提出一种贝叶斯潜变量模型，用于估计异步观测的多模态数据中协变量辅助的依赖结构，并应用于阿尔茨海默病神经影像学倡议数据，揭示临床有意义的纵向跨模态生物标志物依赖模式。

Toward Personalized Digital Twins for Cognitive Decline Assessment: A Multimodal, Uncertainty-Aware Framework

迈向认知下降评估的个性化数字孪生：一种多模态、不确定性感知的框架

Bulent Soykan, Gulsah Hancerliogullari Koksalmis, Hsin-Hsiung Huang, Laura J. Brattain

机构 * Department of Mechanical, Industrial \& Manufac. Eng. The University of Toledo Toledo, OH, USA ； Department of Industrial Eng. ； Mngt. Systems University of Central Florida Orlando, FL, USA ； Department of Statistics ； Data Science University of Central Florida Orlando, FL, USA ； Department of Internal Medicine University of Central Florida Orlando, FL, USA 纠错

专题命中 医疗多模态 ：MRI(abstract,abstract_cn)

AI总结 本文提出了一种多模态、不确定性感知的框架，用于从稀疏、噪声和不规则的纵向数据中建模患者特定的疾病轨迹，通过结合潜在状态空间模型、多模态融合和不确定性感知验证，实现对认知下降的个性化评估。

Comments 6 pages, 6 figures

MRG-R1: Reinforcement Learning for Clinically Aligned Medical Report Generation

MRG-R1：用于临床对齐的医学报告生成的强化学习

Pengyu Wang, Shuchang Ye, Usman Naseem, Jinman Kim

机构 * The University of Sydney（悉尼大学） ； Macquarie University（麦考瑞大学） 纠错

专题命中 医疗多模态 ：medical image(abstract)；radiology(abstract)

AI总结 本文提出MRG-R1框架，通过语义驱动的强化学习提升医学报告的临床准确性，改进了生成报告中相关发现的准确性和覆盖范围。

Comments 10 pages

Mixture of Multicenter Experts in Multimodal AI for Debiased Radiotherapy Target Delineation

Yujin Oh, Sangjoon Park, Xiang Li, Pengfei Jin, Yi Wang, Jonathan Paly, Jason Efstathiou, Annie Chan, Jun Won Kim, Hwa Kyung Byun, Ik Jae Lee, Jaeho Cho, Chan Woo Wee, Peng Shu, Peilong Wang, Nathan Yu, Jason Holmes, Jong Chul Ye, Quanzheng Li, Wei Liu, Woong Sub Koom, Jin Sung Kim, Kyungsang Kim

机构 * Center for Advanced Medical Computing and Analysis (CAMCA), Department of Radiology, Massachusetts General Hospital (MGH) and Harvard Medical School（先进医学计算与分析中心（CAMCA）、放射科、麻省总医院（MGH）和哈佛医学院） ； Department of Radiation Oncology, Yonsei University College of Medicine（燕京大学医学院放射肿瘤科） ； Institute for Innovation in Digital Healthcare, Yonsei University（数字医疗创新研究所、燕京大学） ； Department of Radiation Oncology, Massachusetts General Hospital（麻省总医院放射肿瘤科） ； Department of Radiation Oncology, Gangnam Severance Hospital（江南松云医院放射肿瘤科） ； Department of Radiation Oncology, Yongin Severance Hospital（永兴松云医院放射肿瘤科） ； School of Computing, University of Georgia（佐治亚大学计算机学院） ； Department of Radiation Oncology, Mayo Clinic（梅奥诊所放射肿瘤科） ； Kim Jaechul Graduate School of AI, Korea Advanced Institute of Science and Technology（金 Jaechul人工智能研究生院、韩国科学技术院） 纠错

专题命中 医疗多模态 ：medical AI(abstract)；分类 cs.CV、cs.LG、eess.IV

Comments 12 pages, 5 figures, 4 tables, 1 supplementary material

Enhancing Radiographic Disease Detection with MetaCheX, a Context-Aware Multimodal Model

Nathan He, Cody Chen

专题命中 医疗多模态 ：radiology(abstract)；分类 cs.CV、cs.LG、eess.IV

Comments All authors contributed equally, 5 pages, 2 figures, 1 table

Architecting Clinical Collaboration: Multi-Agent Reasoning Systems for Multimodal Medical VQA

Karishma Thakrar, Shreyas Basavatia, Akshay Daftardar

机构 * Georgia Institute of Technology Atlanta, GA, USA（佐治亚理工学院） 纠错

专题命中 医疗多模态 ：medical AI(abstract)；diagnosis(abstract)

MedBLINK: Probing Basic Perception in Multimodal Language Models for Medicine

Mahtab Bigverdi, Wisdom Ikezogwo, Kevin Zhang, Hyewon Jeong, Mingyu Lu, Sungjae Cho, Linda Shapiro, Ranjay Krishna

机构 * University of Washington（华盛顿大学） ； Massachusetts Institute of Technology（麻省理工学院） ； Seoul National University（首尔国立大学） 纠错

专题命中 医疗多模态 ：medical image(abstract)；CT(abstract)

OmniV-Med: Scaling Medical Vision-Language Model for Universal Visual Understanding

Songtao Jiang, Yuan Wang, Sibo Song, Yan Zhang, Zijie Meng, Bohan Lei, Jian Wu, Jimeng Sun, Zuozhu Liu

机构 * Zhejiang University（浙江大学） ； Alibaba Group（阿里巴巴集团） ； UIUC（伊利诺伊大学香槟分校） 纠错

专题命中 医疗多模态 ：medical image(abstract)；CT(abstract)

CLIMB: Data Foundations for Large Scale Multimodal Clinical Foundation Models

Wei Dai, Peilin Chen, Malinda Lu, Daniel Li, Haowen Wei, Hejie Cui, Paul Pu Liang

专题命中 医疗多模态 ：clinical AI(abstract)；分类 cs.CV、cs.LG、eess.SP

Advancing Medical Representation Learning Through High-Quality Data

Negin Baghbanzadeh, Adibvafa Fallahpour, Yasaman Parhizkar, Franklin Ogidi, Shuvendu Roy, Sajad Ashkezari, Vahid Reza Khazaie, Michael Colacci, Ali Etemad, Arash Afkanpour, Elham Dolatabadi

专题命中 医疗多模态 ：medical AI(abstract)；分类 cs.CV、cs.LG、eess.IV

A Novel Ophthalmic Benchmark for Evaluating Multimodal Large Language Models with Fundus Photographs and OCT Images

Xiaoyi Liang, Mouxiao Bian, Moxin Chen, Lihao Liu, Junjun He, Jie Xu, Lin Li

专题命中 医疗多模态 ：medical image(abstract)；diagnosis(abstract)

Foundation-Model-Boosted Multimodal Learning for fMRI-based Neuropathic Pain Drug Response Prediction

Wenrui Fan, L. M. Riza Rizky, Jiayang Zhang, Chen Chen, Haiping Lu, Kevin Teh, Dinesh Selvarajah, Shuo Zhou

专题命中 医疗多模态 ：MRI(abstract)；分类 cs.CV、cs.LG、eess.SP

Specialized curricula for training vision-language models in retinal image analysis

Robbie Holland, Thomas R. P. Taylor, Christopher Holmes, Sophie Riedl, Julia Mai, Maria Patsiamanidi, Dimitra Mitsopoulou, Paul Hager, Philip Müller, Hendrik P. N. Scholl, Hrvoje Bogunović, Ursula Schmidt-Erfurth, Daniel Rueckert, Sobha Sivaprasad, Andrew J. Lotery, Martin J. Menten

专题命中 医疗多模态 ：medical image(abstract)；diagnosis(abstract)

Comments Under review at npj Digital Medicine

Medical Multimodal Model Stealing Attacks via Adversarial Domain Alignment

Yaling Shen, Zhixiong Zhuang, Kun Yuan, Maria-Irina Nicolae, Nassir Navab, Nicolas Padoy, Mario Fritz

专题命中 医疗多模态 ：medical image(abstract)；radiology(abstract)

Comments Accepted at AAAI 2025

A Systematic Review of Machine Learning Methods for Multimodal EEG Data in Clinical Application

Siqi Zhao, Wangyang Li, Xiru Wang, Stevie Foglia, Hongzhao Tan, Bohan Zhang, Ameer Hamoodi, Aimee Nelson, Zhen Gao

专题命中 医疗多模态 ：diagnosis(abstract)；分类 cs.CV、cs.LG、eess.SP

Comments This paper includes 4 figures, 6 tables, and totals 18 pages

A Multimodal Approach to The Detection and Classification of Skin Diseases

Allen Yang, Edward Yang

专题命中 医疗多模态 ：diagnosis(abstract)；分类 cs.CV、cs.LG、eess.IV

Multimodal growth and development assessment model

Ying Li, Zichen Song, Zijie Gong, Sitan Huang, Jiewei Ge

专题命中 医疗多模态 ：diagnosis(abstract)；radiology(abstract)

Comments 7 Pages 7 Figures

How Does Diverse Interpretability of Textual Prompts Impact Medical Vision-Language Zero-Shot Tasks?

Sicheng Wang, Che Liu, Rossella Arcucci

专题命中 医疗多模态 ：medical image(abstract)；分类 cs.CV、cs.LG、eess.IV

Comments Accepted by NeurIPS'24 Advancements In Medical Foundation Models: Explainability, Robustness, Security, and Beyond Workshop

An Early Investigation into the Utility of Multimodal Large Language Models in Medical Imaging

Sulaiman Khan, Md. Rafiul Biswas, Alina Murad, Hazrat Ali, Zubair Shah

专题命中 医疗多模态 ：medical image(abstract)；分类 cs.CV、cs.LG、eess.IV

Comments Accepted in Fifth IEEE Workshop on Artificial Intelligence for HealthCare, IEEE 25th International Conference on Information Reuse and Integration for Data Science

Comprehensive Multimodal Deep Learning Survival Prediction Enabled by a Transformer Architecture: A Multicenter Study in Glioblastoma

Ahmed Gomaa, Yixing Huang, Amr Hagag, Charlotte Schmitter, Daniel Höfler, Thomas Weissmann, Katharina Breininger, Manuel Schmidt, Jenny Stritzelberger, Daniel Delev, Roland Coras, Arnd Dörfler, Oliver Schnell, Benjamin Frey, Udo S. Gaipl, Sabine Semrau, Christoph Bert, Rainer Fietkau, Florian Putz

专题命中 医疗多模态 ：MRI(abstract)；分类 cs.CV、cs.LG、eess.IV

Medical Vision-Language Pre-Training for Brain Abnormalities

Masoud Monajatipoor, Zi-Yi Dou, Aichi Chien, Nanyun Peng, Kai-Wei Chang

专题命中 医疗多模态 ：clinical AI(abstract)；medical image(abstract)

Improved Automatic Diabetic Retinopathy Severity Classification Using Deep Multimodal Fusion of UWF-CFP and OCTA Images

Mostafa El Habib Daho, Yihao Li, Rachid Zeghlache, Yapo Cedric Atse, Hugo Le Boité, Sophie Bonnin, Deborah Cosette, Pierre Deman, Laurent Borderie, Capucine Lepicard, Ramin Tadayoni, Béatrice Cochener, Pierre-Henri Conze, Mathieu Lamard, Gwenolé Quellec

专题命中 医疗多模态 ：diagnosis(abstract)；分类 cs.CV、cs.LG、eess.IV

Comments Accepted preprint for presentation at MICCAI-OMIA 20023, Vancouver, Canada

Stone Needle: A General Multimodal Large-scale Model Framework towards Healthcare

Weihua Liu, Yong Zuo

专题命中 医疗多模态 ：medical image(abstract)；diagnosis(abstract)

OneCAD: One Classifier for All image Datasets using multimodal learning

Shakti N. Wadekar, Eugenio Culurciello

专题命中 医疗多模态 ：medical image(abstract)；分类 cs.CV、cs.LG、eess.IV

Comments 8 pages, 6 figures

Multimodal Information Fusion for Glaucoma and DR Classification

Yihao Li, Mostafa El Habib Daho, Pierre-Henri Conze, Hassan Al Hajj, Sophie Bonnin, Hugang Ren, Niranchana Manivannan, Stephanie Magazzeni, Ramin Tadayoni, Béatrice Cochener, Mathieu Lamard, Gwenolé Quellec

专题命中 医疗多模态 ：diagnosis(abstract)；分类 cs.CV、cs.LG、eess.IV

Comments Accepted preprint for presentation at MICCAI-OMIA

EMIXER: End-to-end Multimodal X-ray Generation via Self-supervision

Siddharth Biswal, Peiye Zhuang, Ayis Pyrros, Nasir Siddiqui, Sanmi Koyejo, Jimeng Sun

专题命中 医疗多模态 ：diagnosis(abstract)；分类 cs.CV、cs.LG、eess.IV

CoMIR: Contrastive Multimodal Image Representation for Registration

Nicolas Pielawski, Elisabeth Wetzer, Johan Öfverstedt, Jiahao Lu, Carolina Wählby, Joakim Lindblad, Nataša Sladoje

专题命中 医疗多模态 ：biomedical(abstract)；分类 cs.CV、cs.LG、eess.IV

Comments 21 pages, 11 figures

Journal ref NeurIPS 2020

Unsupervised learning of multimodal image registration using domain adaptation with projected Earth Move's discrepancies

Mattias P Heinrich, Lasse Hansen

专题命中 医疗多模态 ：MRI(abstract)；分类 cs.CV、cs.LG、eess.IV

Comments Medical Imaging with Deep Learning (accepted short paper) https://openreview.net/forum?id=wbZM-DcJB9

Normative Modeling using Multimodal Variational Autoencoders to Identify Abnormal Brain Structural Patterns in Alzheimer Disease

基于多模态变分自编码器的规范建模用于识别阿尔茨海默病异常脑结构模式

Sayantan Kumar, Philip Payne, Aristeidis Sotiras

专题命中 医疗多模态 ：MRI(abstract)；分类 cs.LG、eess.IV；diagnosis(journal_ref)

AI总结 本文提出基于多模态变分自编码器的规范建模框架，用于识别阿尔茨海默病中异常脑结构模式，通过联合分布建模提高疾病阶段检测的敏感性和准确性。

Comments Medical Imaging Meets NeurIPS workshop in NeurIPS 2022

Journal ref Proc. SPIE 12465, Medical Imaging 2023: Computer-Aided Diagnosis, 1246503 (7 April 2023)

Deep Multimodal Fusion of Data with Heterogeneous Dimensionality via Projective Networks

José Morano, Guilherme Aresta, Christoph Grechenig, Ursula Schmidt-Erfurth, Hrvoje Bogunović

专题命中 医疗多模态 ：diagnosis(abstract)；分类 cs.CV、eess.IV；biomedical(comments)

Comments Accepted for publication in the IEEE Journal of Biomedical and Health Informatics (JBHI)