医学 AI

ADAPT: Multimodal Learning for Detecting Physiological Changes under Missing Modalities

Julie Mordacq, Leo Milecki, Maria Vakalopoulou, Steve Oudot, Vicky Kalogeiton

专题命中 医疗多模态 ：biomedical(abstract)；分类 cs.CV、cs.LG

Comments Accepted at MIDL 2024

MMGPL: Multimodal Medical Data Analysis with Graph Prompt Learning

Liang Peng, Songyue Cai, Zongqian Wu, Huifang Shang, Xiaofeng Zhu, Xiaoxiao Li

专题命中 医疗多模态 ：diagnosis(abstract)；分类 cs.CV、cs.LG

Integrating Medical Imaging and Clinical Reports Using Multimodal Deep Learning for Advanced Disease Analysis

Ziyan Yao, Fei Lin, Sheng Chai, Weijie He, Lu Dai, Xinghui Fei

专题命中 医疗多模态 ：medical image(abstract)；分类 cs.CV、cs.LG

Vision-Language Synthetic Data Enhances Echocardiography Downstream Tasks

Pooria Ashrafian, Milad Yazdani, Moein Heidari, Dena Shahriari, Ilker Hacihaliloglu

专题命中 医疗多模态 ：medical image(abstract)；分类 cs.CV、eess.IV

Comments Submitted as a conference paper to MICCAI 2024

LLM-CXR: Instruction-Finetuned LLM for CXR Image Understanding and Generation

Suhyeon Lee, Won Jun Kim, Jinho Chang, Jong Chul Ye

专题命中 医疗多模态 ：medical image(abstract)；分类 cs.CV、cs.LG

Comments 21 pages, 8 figures; ICLR 2024 (poster)

Demographic Bias of Expert-Level Vision-Language Foundation Models in Medical Imaging

Yuzhe Yang, Yujia Liu, Xin Liu, Avanti Gulhane, Domenico Mastrodicasa, Wei Wu, Edward J Wang, Dushyant W Sahani, Shwetak Patel

专题命中 医疗多模态 ：diagnosis(abstract)；分类 cs.CV、cs.LG

Comments Code and data are available at https://github.com/YyzHarry/vlm-fairness

Review of multimodal machine learning approaches in healthcare

Felix Krones, Umar Marikkar, Guy Parsons, Adam Szmul, Adam Mahdi

专题命中 医疗多模态 ：diagnosis(abstract)；分类 cs.CV、cs.LG

Comments 5 figures, 5 tables

Examining Modality Incongruity in Multimodal Federated Learning for Medical Vision and Language-based Disease Detection

Pramit Saha, Divyanshu Mishra, Felix Wagner, Konstantinos Kamnitsas, J. Alison Noble

专题命中 医疗多模态 ：radiology(abstract)；分类 cs.CV、cs.LG

Comments 42 pages

Disentangled Multimodal Brain MR Image Translation via Transformer-based Modality Infuser

Jihoon Cho, Xiaofeng Liu, Fangxu Xing, Jinsong Ouyang, Georges El Fakhri, Jinah Park, Jonghye Woo

专题命中 医疗多模态 ：diagnosis(abstract)；分类 cs.CV、eess.IV

Comments 6 pages

Freeze the backbones: A Parameter-Efficient Contrastive Approach to Robust Medical Vision-Language Pre-training

Jiuming Qin, Che Liu, Sibo Cheng, Yike Guo, Rossella Arcucci

专题命中 医疗多模态 ：medical image(abstract)；分类 cs.CV、cs.LG

Comments Accepted by ICASSP 2024

Quantifying & Modeling Multimodal Interactions: An Information Decomposition Framework

Paul Pu Liang, Yun Cheng, Xiang Fan, Chun Kai Ling, Suzanne Nie, Richard Chen, Zihao Deng, Nicholas Allen, Randy Auerbach, Faisal Mahmood, Ruslan Salakhutdinov, Louis-Philippe Morency

专题命中 医疗多模态 ：pathology(abstract)；分类 cs.CV、cs.LG

Comments NeurIPS 2023. Code available at: https://github.com/pliang279/PID

TTMFN: Two-stream Transformer-based Multimodal Fusion Network for Survival Prediction

Ruiquan Ge, Xiangyang Hu, Rungen Huang, Gangyong Jia, Yaqi Wang, Renshu Gu, Changmiao Wang, Elazab Ahmed, Linyan Wang, Juan Ye, Ye Li

专题命中 医疗多模态 ：diagnosis(abstract)；分类 cs.CV、eess.IV

Automated Cardiovascular Record Retrieval by Multimodal Learning between Electrocardiogram and Clinical Report

Jielin Qiu, Jiacheng Zhu, Shiqi Liu, William Han, Jingqi Zhang, Chaojing Duan, Michael Rosenberg, Emerson Liu, Douglas Weber, Ding Zhao

专题命中 医疗多模态 ：diagnosis(abstract)；分类 cs.CV、eess.SP

Comments Accepted to the ML4H 2023 Proceedings track

Improved Multimodal Fusion for Small Datasets with Auxiliary Supervision

Gregory Holste, Douwe van der Wal, Hans Pinckaers, Rikiya Yamashita, Akinori Mitani, Andre Esteva

专题命中 医疗多模态 ：diagnosis(abstract)；分类 cs.CV、eess.IV

Comments IEEE ISBI 2023 (see http://2023.biomedicalimaging.org/en/)

M-FLAG: Medical Vision-Language Pre-training with Frozen Language Models and Latent Space Geometry Optimization

Che Liu, Sibo Cheng, Chen Chen, Mengyun Qiao, Weitong Zhang, Anand Shah, Wenjia Bai, Rossella Arcucci

专题命中 医疗多模态 ：medical image(abstract)；分类 cs.CV、cs.LG

Comments Accepted by MICCAI 2023

Knowledge Boosting: Rethinking Medical Contrastive Vision-Language Pre-Training

Xiaofei Chen, Yuting He, Cheng Xue, Rongjun Ge, Shuo Li, Guanyu Yang

专题命中 医疗多模态 ：diagnosis(abstract)；分类 cs.CV、cs.LG

Comments accepted by MICCAI 2023

Competence-based Multimodal Curriculum Learning for Medical Report Generation

Fenglin Liu, Shen Ge, Yuexian Zou, Xian Wu

专题命中 医疗多模态 ：medical image(abstract)；分类 cs.CV、cs.LG

Comments Accepted by ACL 2021 (Oral)

A Multimodal Deep Network for the Reconstruction of T2W MR Images

Antonio Falvo, Danilo Comminiello, Simone Scardapane, Michele Scarpiniti, Aurelio Uncini

专题命中 医疗多模态 ：diagnosis(abstract)；分类 cs.LG、eess.SP

Comments 29th Italian Neural Networks Workshop (WIRN 2019)

Journal ref Progresses in Artificial Intelligence and Neural Systems. Smart Innovation, Systems and Technologies, vol 184. Springer, Singapore, Jul. 2020

RoentGen: Vision-Language Foundation Model for Chest X-ray Generation

Pierre Chambon, Christian Bluethgen, Jean-Benoit Delbrouck, Rogier Van der Sluijs, Małgorzata Połacin, Juan Manuel Zambrano Chaves, Tanishq Mathew Abraham, Shivanshu Purohit, Curtis P. Langlotz, Akshay Chaudhari

专题命中 医疗多模态 ：radiology(abstract)；分类 cs.CV、cs.LG

Comments 19 pages

EBMs vs. CL: Exploring Self-Supervised Visual Pretraining for Visual Question Answering

Violetta Shevchenko, Ehsan Abbasnejad, Anthony Dick, Anton van den Hengel, Damien Teney

专题命中 医疗多模态 ：diagnosis(abstract)；分类 cs.CV、cs.LG

ContIG: Self-supervised Multimodal Contrastive Learning for Medical Imaging with Genetics

Aiham Taleb, Matthias Kirchler, Remo Monti, Christoph Lippert

专题命中 医疗多模态 ：medical image(abstract)；分类 cs.CV、cs.LG

Auto-Encoding Knowledge Graph for Unsupervised Medical Report Generation

Fenglin Liu, Chenyu You, Xian Wu, Shen Ge, Sheng Wang, Xu Sun

专题命中 医疗多模态 ：medical image(abstract)；分类 cs.CV、cs.LG

Multimodal Feature Fusion and Knowledge-Driven Learning via Experts Consult for Thyroid Nodule Classification

Danilo Avola, Luigi Cinque, Alessio Fagioli, Sebastiano Filetti, Giorgio Grani, Emanuele Rodolà

专题命中 医疗多模态 ：diagnosis(abstract)；分类 cs.LG、eess.IV

SalientSleepNet: Multimodal Salient Wave Detection Network for Sleep Staging

Ziyu Jia, Youfang Lin, Jing Wang, Xuehui Wang, Peiyi Xie, Yingbin Zhang

专题命中 医疗多模态 ：diagnosis(abstract)；分类 cs.LG、eess.SP

Comments Accepted by IJCAI 2021. The SOLE copyright holder is IJCAI (International Joint Conferences on Artificial Intelligence), all rights reserved

DeepOpht: Medical Report Generation for Retinal Images via Deep Models and Visual Explanation

Jia-Hong Huang, Chao-Han Huck Yang, Fangyu Liu, Meng Tian, Yi-Chieh Liu, Ting-Wei Wu, I-Hung Lin, Kang Wang, Hiromasa Morikawa, Hernghua Chang, Jesper Tegner, Marcel Worring

专题命中 医疗多模态 ：diagnosis(abstract)；分类 cs.CV、cs.LG

Comments Accepted to IEEE WACV 2021

Adversarial Uni- and Multi-modal Stream Networks for Multimodal Image Registration

Zhe Xu, Jie Luo, Jiangpeng Yan, Ritvik Pulya, Xiu Li, William Wells, Jayender Jagadeesan

专题命中 医疗多模态 ：CT(abstract)；分类 cs.CV、eess.IV

Comments accepted by MICCAI 2020

Leveraging Medical Visual Question Answering with Supporting Facts

Tomasz Kornuta, Deepta Rajan, Chaitanya Shivade, Alexis Asseman, Ahmet S. Ozcan

专题命中 医疗多模态 ：radiology(abstract)；分类 cs.CV、cs.LG

Comments Working notes from the ImageCLEF 2019 VQA-Med competition

Multimodal Densenet

Faisal Mahmood, Ziyun Yang, Thomas Ashley, Nicholas J. Durr

专题命中 医疗多模态 ：diagnosis(abstract)；分类 cs.CV、cs.LG

Comments 10 pages, 6 figures

Robust Heartbeat Detection from Multimodal Data via CNN-based Generalizable Information Fusion

B S Chandra, C S Sastry, S Jana

专题命中 医疗多模态 ：diagnosis(abstract)；分类 cs.CV、eess.SP

Label-driven weakly-supervised learning for multimodal deformable image registration

Yipeng Hu, Marc Modat, Eli Gibson, Nooshin Ghavami, Ester Bonmati, Caroline M. Moore, Mark Emberton, J. Alison Noble, Dean C. Barratt, Tom Vercauteren

专题命中 医疗多模态 ：medical image(abstract)；分类 cs.CV、cs.LG

Comments Accepted to ISBI 2018