医学 AI - arXivDaily 专题

2412.06212 2024-12-10 cs.LG cs.AI 57%

A Self-guided Multimodal Approach to Enhancing Graph Representation Learning for Alzheimer's Diseases

Zhepeng Wang, Runxue Bao, Yawen Wu, Guodong Liu, Lei Yang, Liang Zhan, Feng Zheng, Weiwen Jiang, Yanfu Zhang

专题命中医疗多模态：diagnosis(abstract)；分类 cs.LG

2412.00481 2024-12-03 eess.SP 57%

MaintAGT:Sim2Real-Guided Multimodal Large Model for Intelligent Maintenance with Chain-of-Thought Reasoning

Hongliang He, Jinfeng Huang, Qi Li, Xu Wang, Feibin Zhang, Kangding Yang, Li Meng, Fulei Chu

专题命中医疗多模态：diagnosis(abstract)；分类 eess.SP

2411.04118 2024-11-21 cs.CL cs.AI cs.LG 57%

Medical Adaptation of Large Language and Vision-Language Models: Are We Making Progress?

Daniel P. Jeong, Saurabh Garg, Zachary C. Lipton, Michael Oberst

专题命中医疗多模态：biomedical(abstract)；分类 cs.LG

Comments This version was published at EMNLP 2024 Main Conference as a Long Paper (Oral). See the extended version (arXiv:2411.08870) for additional results on QA tasks based on clinical notes and evaluations in the supervised fine-tuning regime

2411.10100 2024-11-18 cs.CV cs.AI 57%

Multi-Task Adversarial Variational Autoencoder for Estimating Biological Brain Age with Multimodal Neuroimaging

Muhammad Usman, Azka Rehman, Abdullah Shahid, Abd Ur Rehman, Sung-Min Gho, Aleum Lee, Tariq M. Khan, Imran Razzak

专题命中医疗多模态：MRI(abstract)；分类 cs.CV

2411.07871 2024-11-13 cs.AI eess.IV 57%

Leveraging Multimodal Models for Enhanced Neuroimaging Diagnostics in Alzheimer's Disease

Francesco Chiumento, Mingming Liu

专题命中医疗多模态：radiology(abstract)；分类 eess.IV

Comments The paper has been accepted by the conference: "2024 International Conference on Big Data (IEEE Big Data 2024)"

2410.16261 2024-11-08 cs.CV 57%

Mini-InternVL: A Flexible-Transfer Pocket Multimodal Model with 5% Parameters and 90% Performance

Zhangwei Gao, Zhe Chen, Erfei Cui, Yiming Ren, Weiyun Wang, Jinguo Zhu, Hao Tian, Shenglong Ye, Junjun He, Xizhou Zhu, Lewei Lu, Tong Lu, Yu Qiao, Jifeng Dai, Wenhai Wang

专题命中医疗多模态：medical image(abstract)；分类 cs.CV

Comments Technical report

2406.07542 2024-11-06 cs.LG cs.AI 57%

Cognitive Insights Across Languages: Enhancing Multimodal Interview Analysis

David Ortiz-Perez, Jose Garcia-Rodriguez, David Tomás

专题命中医疗多模态：diagnosis(abstract)；分类 cs.LG

Comments GitHub repository: https://github.com/davidorp/taukadial

Journal ref Interspeech 2024, pages 952-956

2405.10301 2024-11-06 stat.ML cs.AI cs.LG 57%

Conformal Alignment: Knowing When to Trust Foundation Models with Guarantees

Yu Gui, Ying Jin, Zhimei Ren

专题命中医疗多模态：radiology(abstract)；分类 cs.LG

2404.18947 2024-11-04 cs.LG cs.AI 57%

Multimodal Fusion on Low-quality Data: A Comprehensive Survey

Qingyang Zhang, Yake Wei, Zongbo Han, Huazhu Fu, Xi Peng, Cheng Deng, Qinghua Hu, Cai Xu, Jie Wen, Di Hu, Changqing Zhang

专题命中医疗多模态：diagnosis(abstract)；分类 cs.LG

Comments Feel free to comment on our manuscript: qingyangzhang@tju$.$edu$.$cn

2410.23822 2024-11-01 cs.CV cs.AI 57%

Parameter-Efficient Fine-Tuning Medical Multimodal Large Language Models for Medical Visual Grounding

Jinlong He, Pengfei Li, Gang Liu, Shenjun Zhong

专题命中医疗多模态：medical image(abstract)；分类 cs.CV

2410.21969 2024-10-30 cs.CV 57%

BenchX: A Unified Benchmark Framework for Medical Vision-Language Pretraining on Chest X-Rays

Yang Zhou, Tan Li Hui Faith, Yanyu Xu, Sicong Leng, Xinxing Xu, Yong Liu, Rick Siow Mong Goh

专题命中医疗多模态：medical image(abstract)；分类 cs.CV

Comments Accepted to NeurIPS24 Datasets and Benchmarks Track

2410.15881 2024-10-22 cs.CV cs.AI 57%

MI-VisionShot: Few-shot adaptation of vision-language models for slide-level classification of histopathological images

Pablo Meseguer, Rocío del Amor, Valery Naranjo

专题命中医疗多模态：pathology(abstract)；分类 cs.CV

Comments Manuscript accepted for oral presentation at KES-InnovationInMedicine 2024 held on Madeira, Portugal

2410.15642 2024-10-22 cs.CL cs.AI cs.CV 57%

Resource-Efficient Medical Report Generation using Large Language Models

Abdullah, Ameer Hamza, Seong Tae Kim

专题命中医疗多模态：radiology(abstract)；分类 cs.CV

2406.00977 2024-10-16 cs.CV cs.AI 57%

Dragonfly: Multi-Resolution Zoom-In Encoding Enhances Vision-Language Models

Rahul Thapa, Kezhen Chen, Ian Covert, Rahul Chalamala, Ben Athiwaratkun, Shuaiwen Leon Song, James Zou

专题命中医疗多模态：biomedical(abstract)；分类 cs.CV

2410.05361 2024-10-10 cs.LG cs.AI cs.SD eess.AS 57%

RespLLM: Unifying Audio and Text with Multimodal LLMs for Generalized Respiratory Health Prediction

Yuwei Zhang, Tong Xia, Aaqib Saeed, Cecilia Mascolo

专题命中医疗多模态：diagnosis(abstract)；分类 cs.LG

2410.04521 2024-10-08 cs.CV 57%

MC-CoT: A Modular Collaborative CoT Framework for Zero-shot Medical-VQA with LLM and MLLM Integration

Lai Wei, Wenkai Wang, Xiaoyu Shen, Yu Xie, Zhihao Fan, Xiaojin Zhang, Zhongyu Wei, Wei Chen

专题命中医疗多模态：medical image(abstract)；分类 cs.CV

Comments 21 pages, 14 figures, 6 tables

2404.12372 2024-10-08 cs.CV 57%

MedThink: Explaining Medical Visual Question Answering via Multimodal Decision-Making Rationale

Xiaotang Gai, Chenyi Zhou, Jiaxiang Liu, Yang Feng, Jian Wu, Zuozhu Liu

专题命中医疗多模态：medical image(abstract)；分类 cs.CV

2409.17055 2024-10-02 cs.AI cs.LG 57%

DRIM: Learning Disentangled Representations from Incomplete Multimodal Healthcare Data

Lucas Robinet, Ahmad Berjaoui, Ziad Kheil, Elizabeth Cohen-Jonathan Moyal

专题命中医疗多模态：MRI(abstract)；分类 cs.LG

2409.19684 2024-10-01 cs.CV 57%

MedViLaM: A multimodal large language model with advanced generalizability and explainability for medical data understanding and generation

Lijian Xu, Hao Sun, Ziyu Ni, Hongsheng Li, Shaoting Zhang

专题命中医疗多模态：radiology(abstract)；分类 cs.CV

2305.10415 2024-09-10 cs.CV 57%

PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answering

Xiaoman Zhang, Chaoyi Wu, Ziheng Zhao, Weixiong Lin, Ya Zhang, Yanfeng Wang, Weidi Xie

专题命中医疗多模态：medical image(abstract)；分类 cs.CV

2404.10237 2024-09-04 cs.CV cs.CL 57%

Med-MoE: Mixture of Domain-Specific Experts for Lightweight Medical Vision-Language Models

Songtao Jiang, Tuo Zheng, Yan Zhang, Yeying Jin, Li Yuan, Zuozhu Liu

专题命中医疗多模态：medical image(abstract)；分类 cs.CV

2408.16769 2024-08-30 cs.CV cs.CR 57%

PromptSmooth: Certifying Robustness of Medical Vision-Language Models via Prompt Learning

Noor Hussein, Fahad Shamshad, Muzammal Naseer, Karthik Nandakumar

专题命中医疗多模态：medical image(abstract)；分类 cs.CV

Comments Accepted to MICCAI 2024

2408.14723 2024-08-28 cs.CV cs.IR 57%

Snap and Diagnose: An Advanced Multimodal Retrieval System for Identifying Plant Diseases in the Wild

Tianqi Wei, Zhi Chen, Xin Yu

专题命中医疗多模态：diagnosis(abstract)；分类 cs.CV

2311.14902 2024-08-27 cs.CV 57%

Parkinson's Disease Classification Using Contrastive Graph Cross-View Learning with Multimodal Fusion of SPECT Images and Clinical Features

Jun-En Ding, Chien-Chin Hsu, Feng Liu

专题命中医疗多模态：medical image(abstract)；分类 cs.CV

2408.06357 2024-08-14 cs.CV cs.AI 57%

Algorithm Research of ELMo Word Embedding and Deep Learning Multimodal Transformer in Image Description

Xiaohan Cheng, Taiyuan Mei, Yun Zi, Qi Wang, Zijun Gao, Haowei Yang

专题命中医疗多模态：medical image(abstract)；分类 cs.CV

2407.14277 2024-07-23 cs.CV 57%

Patch-based Intuitive Multimodal Prototypes Network (PIMPNet) for Alzheimer's Disease classification

Lisa Anita De Santi, Jörg Schlötterer, Meike Nauta, Vincenzo Positano, Christin Seifert

专题命中医疗多模态：diagnosis(abstract)；分类 cs.CV

Comments Accepted "late-breaking work" at XAI-2024

2407.07582 2024-07-11 cs.CV 57%

TIP: Tabular-Image Pre-training for Multimodal Classification with Incomplete Data

Siyi Du, Shaoming Zheng, Yinsong Wang, Wenjia Bai, Declan P. O'Regan, Chen Qin

专题命中医疗多模态：medical image(abstract)；分类 cs.CV

Comments 28 pages (including 9 pages of supplementary materials), accepted by ECCV 2024

2406.14098 2024-07-08 cs.CV 57%

HeartBeat: Towards Controllable Echocardiography Video Synthesis with Multimodal Conditions-Guided Diffusion Models

Xinrui Zhou, Yuhao Huang, Wufeng Xue, Haoran Dou, Jun Cheng, Han Zhou, Dong Ni

专题命中医疗多模态：MRI(abstract)；分类 cs.CV

Comments Accepted by MICCAI 2024

2407.00535 2024-07-02 cs.CE cs.CV 57%

AI-powered multimodal modeling of personalized hemodynamics in aortic stenosis

Caglar Ozturk, Daniel H. Pak, Luca Rosalia, Debkalpa Goswami, Mary E. Robakowski, Raymond McKay, Christopher T. Nguyen, James S. Duncan, Ellen T. Roche

专题命中医疗多模态：diagnosis(abstract)；分类 cs.CV

Comments CO and DHP contributed equally to this work. JSD and ETR are corresponding authors

2401.05163 2024-06-21 cs.CV cs.AI 57%

MISS: A Generative Pretraining and Finetuning Approach for Med-VQA

Jiawei Chen, Dingkang Yang, Yue Jiang, Yuxuan Lei, Lihua Zhang

专题命中医疗多模态：medical image(abstract)；分类 cs.CV

Comments ICANN, 2024

1. 医疗多模态 975 篇

A Self-guided Multimodal Approach to Enhancing Graph Representation Learning for Alzheimer's Diseases

MaintAGT:Sim2Real-Guided Multimodal Large Model for Intelligent Maintenance with Chain-of-Thought Reasoning

Medical Adaptation of Large Language and Vision-Language Models: Are We Making Progress?

Multi-Task Adversarial Variational Autoencoder for Estimating Biological Brain Age with Multimodal Neuroimaging

Leveraging Multimodal Models for Enhanced Neuroimaging Diagnostics in Alzheimer's Disease

Mini-InternVL: A Flexible-Transfer Pocket Multimodal Model with 5% Parameters and 90% Performance

Cognitive Insights Across Languages: Enhancing Multimodal Interview Analysis

Conformal Alignment: Knowing When to Trust Foundation Models with Guarantees

Multimodal Fusion on Low-quality Data: A Comprehensive Survey

Parameter-Efficient Fine-Tuning Medical Multimodal Large Language Models for Medical Visual Grounding

BenchX: A Unified Benchmark Framework for Medical Vision-Language Pretraining on Chest X-Rays

MI-VisionShot: Few-shot adaptation of vision-language models for slide-level classification of histopathological images

Resource-Efficient Medical Report Generation using Large Language Models

Dragonfly: Multi-Resolution Zoom-In Encoding Enhances Vision-Language Models

RespLLM: Unifying Audio and Text with Multimodal LLMs for Generalized Respiratory Health Prediction

MC-CoT: A Modular Collaborative CoT Framework for Zero-shot Medical-VQA with LLM and MLLM Integration

MedThink: Explaining Medical Visual Question Answering via Multimodal Decision-Making Rationale

DRIM: Learning Disentangled Representations from Incomplete Multimodal Healthcare Data

MedViLaM: A multimodal large language model with advanced generalizability and explainability for medical data understanding and generation

PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answering

Med-MoE: Mixture of Domain-Specific Experts for Lightweight Medical Vision-Language Models

PromptSmooth: Certifying Robustness of Medical Vision-Language Models via Prompt Learning

Snap and Diagnose: An Advanced Multimodal Retrieval System for Identifying Plant Diseases in the Wild

Parkinson's Disease Classification Using Contrastive Graph Cross-View Learning with Multimodal Fusion of SPECT Images and Clinical Features

Algorithm Research of ELMo Word Embedding and Deep Learning Multimodal Transformer in Image Description

Patch-based Intuitive Multimodal Prototypes Network (PIMPNet) for Alzheimer's Disease classification

TIP: Tabular-Image Pre-training for Multimodal Classification with Incomplete Data

HeartBeat: Towards Controllable Echocardiography Video Synthesis with Multimodal Conditions-Guided Diffusion Models

AI-powered multimodal modeling of personalized hemodynamics in aortic stenosis

MISS: A Generative Pretraining and Finetuning Approach for Med-VQA