医学 AI - arXivDaily 专题

2509.11944 2025-09-16 cs.AI 50%

Agentic Temporal Graph of Reasoning with Multimodal Language Models: A Potential AI Aid to Healthcare

Susanta Mitra

专题命中医疗多模态：diagnosis(abstract)

2509.11937 2025-09-16 cs.SE cs.AI 50%

MMORE: Massive Multimodal Open RAG & Extraction

Alexandre Sallinen, Stefan Krsteski, Paul Teiletche, Marc-Antoine Allard, Baptiste Lecoeur, Michael Zhang, Fabrice Nemo, David Kalajdzic, Matthias Meyer, Mary-Anne Hartley

机构 * École Polytechnique Fédérale de Lausanne (EPFL), Switzerland（瑞士联邦理工学院洛桑校区）； ETH Zürich, Switzerland（瑞士苏黎世联邦理工学院）； T.H. Chan School of Public Health, Harvard University, USA（哈佛大学T.H. Chan公共卫生学院）

专题命中医疗多模态：biomedical(abstract)

Comments This paper was originally submitted to the CODEML workshop for ICML 2025. 9 pages (including references and appendices)

2508.18687 2025-08-27 cs.CL 50%

Knowing or Guessing? Robust Medical Visual Question Answering via Joint Consistency and Contrastive Learning

Songtao Jiang, Yuxi Chen, Sibo Song, Yan Zhang, Yeying Jin, Yang Feng, Jian Wu, Zuozhu Liu

机构 * Zhejiang University, Zhejiang, China（浙江大学）； Alibaba Group, Zhejiang, China（阿里巴巴集团）； Angelalign Technology Inc., Shanghai, China（Angelalign技术有限公司）； ChohoTech Inc., Hangzhou, China（楚合科技有限公司）； Zhejiang Key Laboratory of Medical Imaging Artificial Intelligence, Zhejiang, China（浙江省医学影像人工智能重点实验室）

专题命中医疗多模态：diagnosis(abstract)

2508.18608 2025-08-27 cs.AI 50%

eSkinHealth: A Multimodal Dataset for Neglected Tropical Skin Diseases

Janet Wang, Xin Hu, Yunbei Zhang, Diabate Almamy, Vagamon Bamba, Konan Amos Sébastien Koffi, Yao Koffi Aubin, Zhengming Ding, Jihun Hamm, Rie R. Yotsu

机构 * Tulane University（Tulane大学）； Bakke Graduate University（Bakke研究生大学）

专题命中医疗多模态：diagnosis(abstract)

2508.13072 2025-08-19 cs.AI 50%

A Language-Signal-Vision Multimodal Framework for Multitask Cardiac Analysis

Yuting Zhang, Tiantian Geng, Luoying Hao, Xinxing Cheng, Alexander Thorley, Xiaoxia Wang, Wenqi Lu, Sandeep S Hothi, Lei Wei, Zhaowen Qiu, Dipak Kotecha, Jinming Duan

机构 * School of Computer Science, University of Birmingham, Birmingham, UK ； Department of Cardiovascular Sciences, University of Birmingham, Birmingham, UK ； NIHR Birmingham Biomedical Research Centre ； West Midlands NHS Secure Data Environment, University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK ； Department of Computing ； Mathematics, Manchester Metropolitan University, Manchester, UK ； Department of Cardiology, Heart ； Lung Centre, Royal Wolverhampton NHS Trust, Wolverhampton, UK ； Department of Cardiovascular Surgery, The First Affiliated Hospital with Nanjing Medical University , Nanjing,China ； College of Computer ； Control Engineering, Northeast Forestry University, Harbin, China ； Julius Center, University Medical Center Utrecht, the Netherlands ； Data Sciences, University of Manchester, Manchester, UK

专题命中医疗多模态：diagnosis(abstract)

2508.08224 2025-08-14 cs.CL cs.AI 50%

Capabilities of GPT-5 on Multimodal Medical Reasoning

Shansong Wang, Mingzhe Hu, Qiang Li, Mojtaba Safari, Xiaofeng Yang

机构 * Department of Radiation Oncology, Winship Cancer Institute, Emory University School of Medicine（放射肿瘤科、Winship癌症研究所、埃默里大学医学院）

专题命中医疗多模态：medical image(abstract)

Comments Corrected some typos

2508.02525 2025-08-05 cs.AI 50%

Accurate and Interpretable Postmenstrual Age Prediction via Multimodal Large Language Model

Qifan Chen, Jin Cui, Cindy Duan, Yushuo Han, Yifei Shi

机构 * King’s College London（伦敦国王学院）； Imperial College London（帝国理工学院）； Columbia University（哥伦比亚大学）

专题命中医疗多模态：MRI(abstract)

Comments Submitted to the NeurIPS 2025 Workshop GenAI4Health. Conference website: https://aihealth.ischool.utexas.edu/GenAI4HealthNeurips2025/

2507.12786 2025-07-18 physics.optics 50%

Plasmonic Color Filters Enable Label-Free Plasmon-Enhanced Array Tomography with sub-diffraction limited resolution

Kristian Caracciolo, Eugeniu Balaur, Erinna F. Lee, W. Douglas Fairlie, Julian Ratcliffe, Eric Hanssen, David Hoxley, Jacqueline Orian, Chad Johnson, Lu Yu, Kang Han, Wei Xiang, Brian Abbey

专题命中医疗多模态：biomedical(abstract)

Comments 24 pages, 9 figures

2506.18212 2025-07-17 cs.RO 50%

Haptic-Informed ACT with a Soft Gripper and Recovery-Informed Training for Pseudo Oocyte Manipulation

Pedro Miguel Uriguen Eljuri, Hironobu Shibata, Maeyama Katsuyoshi, Yuanyuan Jia, Tadahiro Taniguchi

机构 * Kyoto University（京都大学）； Ritsumeikan University（立命馆大学）

专题命中医疗多模态：biomedical(abstract)

Comments Accepted at IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS2025) Project website https://tanichu-laboratory.github.io/pedro_haptic_act_iros2025/

2405.20421 2025-06-12 cs.AI 50%

Worse than Random? An Embarrassingly Simple Probing Evaluation of Large Multimodal Models in Medical VQA

Qianqi Yan, Xuehai He, Xiang Yue, Xin Eric Wang

机构 * University of California, Santa Cruz（加州大学圣克ruz分校）； Carnegie Mellon University（卡内基梅隆大学）

专题命中医疗多模态：diagnosis(abstract)

2506.02470 2025-06-04 cs.AI 50%

A Smart Multimodal Healthcare Copilot with Powerful LLM Reasoning

Xuejiao Zhao, Siyan Liu, Su-Yin Yang, Chunyan Miao

机构 * Joint NTU-UBC Research Centre of Excellence in Active Living for the Elderly (LILY), NTU（联合NTU-UBC老龄化积极生活卓越研究中心（LILY），NTU）； College of Computing and Data Science, Nanyang Technological University (NTU), Singapore（计算与数据科学学院，南洋理工大学（NTU），新加坡）； Tan Tock Seng Hospital, Singapore（坦 tok sing 医院，新加坡）； Woodlands Health, Singapore（伍德兰兹健康，新加坡）

专题命中医疗多模态：diagnosis(abstract)

2505.18530 2025-05-27 cs.MA cs.AI 50%

MRGAgents: A Multi-Agent Framework for Improved Medical Report Generation with Med-LVLMs

Pengyu Wang, Shuchang Ye, Usman Naseem, Jinman Kim

机构 * University of Sydney（悉尼大学）； Macquarie University（麦考瑞大学）

专题命中医疗多模态：diagnosis(abstract)

Comments 10pages

2505.05937 2025-05-12 cs.HC 50%

MER-CLIP: AU-Guided Vision-Language Alignment for Micro-Expression Recognition

Shifeng Liu, Xinglong Mao, Sirui Zhao, Peiming Li, Tong Xu, Enhong Chen

专题命中医疗多模态：diagnosis(abstract)

2502.15993 2025-02-25 cs.SI 50%

Community Detection in Multimodal Data: A Similarity Network Perspective

Aidan Marnane, T. Ian Simpson

专题命中医疗多模态：biomedical(abstract)

Comments 21 pages, 8 figures

2502.15040 2025-02-24 cs.CL cs.AI 50%

Reducing Hallucinations of Medical Multimodal Large Language Models with Visual Retrieval-Augmented Generation

Yun-Wei Chu, Kai Zhang, Christopher Malon, Martin Renqiang Min

专题命中医疗多模态：medical image(abstract)

Comments GenAI4Health - AAAI '25

2412.09928 2025-02-19 cs.SD eess.AS 50%

Leveraging Multimodal Methods and Spontaneous Speech for Alzheimer's Disease Identification

Yifan Gao, Long Guo, Hong Liu

专题命中医疗多模态：diagnosis(abstract)

Comments ICASSP 2025

2412.17077 2024-12-24 cs.AI 50%

SubstationAI: Multimodal Large Model-Based Approaches for Analyzing Substation Equipment Faults

Jinzhi Wang, Qinfeng Song, Lidong Qian, Haozhou Li, Qinke Peng, Jiangbo Zhang

专题命中医疗多模态：diagnosis(abstract)

2412.13387 2024-12-19 eess.AS cs.SD 50%

Deep Speech Synthesis from Multimodal Articulatory Representations

Peter Wu, Bohan Yu, Kevin Scheck, Alan W Black, Aditi S. Krishnapriyan, Irene Y. Chen, Tanja Schultz, Shinji Watanabe, Gopala K. Anumanchipalli

专题命中医疗多模态：MRI(abstract)

2406.18088 2024-09-25 cs.CL cs.AI cs.SD eess.AS 50%

LLM-Driven Multimodal Opinion Expression Identification

Bonian Jia, Huiyao Chen, Yueheng Sun, Meishan Zhang, Min Zhang

专题命中医疗多模态：diagnosis(abstract)

Comments 5 pages, 3 Figures, Accept by Interspeech 2024

Journal ref Proceedings of Interspeech 2024

2402.14416 2024-09-13 stat.AP 50%

Algorithm-agnostic significance testing in supervised learning with multimodal data

Lucas Kook, Anton Rask Lundborg

专题命中医疗多模态：medical image(abstract)

2403.04277 2024-09-10 physics.bio-ph 50%

Multimodal Analysis of Traction Forces and Temperature Dynamics of Living Cells with Diamond-Embedded Substrate

Tomasz Kołodziej, Mariusz Mrózek, Saravanan Sengottuvel, Maciej J. Głowacki, Mateusz Ficek, Wojciech Gawlik, Zenon Rajfur, Adam Wojciechowski

专题命中医疗多模态：biomedical(abstract)

Comments 19 pages, 5 figures

Journal ref Biomed. Opt. Express, 15(7), 4024-4043 (2024)

2403.04785 2024-09-02 cs.CL cs.AI 50%

Large Language Multimodal Models for 5-Year Chronic Disease Cohort Prediction Using EHR Data

Jun-En Ding, Phan Nguyen Minh Thao, Wen-Chih Peng, Jian-Zhe Wang, Chun-Cheng Chug, Min-Chen Hsieh, Yun-Chien Tseng, Ling Chen, Dongsheng Luo, Chi-Te Wang, Pei-fu Chen, Feng Liu, Fang-Ming Hung

专题命中医疗多模态：diagnosis(abstract)

2405.20775 2024-08-22 cs.CR cs.AI cs.CL cs.MM 50%

Medical MLLM is Vulnerable: Cross-Modality Jailbreak and Mismatched Attacks on Medical Multimodal Large Language Models

Xijie Huang, Xinyuan Wang, Hantao Zhang, Yinghao Zhu, Jiawen Xi, Jingkun An, Hao Wang, Hao Liang, Chengwei Pan

专题命中医疗多模态：medical image(abstract)

2406.18829 2024-06-28 stat.ME stat.ML 50%

Full Information Linked ICA: addressing missing data problem in multimodal fusion

Ruiyang Li, F. DuBois Bowman, Seonjoo Lee

专题命中医疗多模态：diagnosis(abstract)

Comments 17 pages, 6 figures

2309.15857 2024-06-21 cs.CL cs.AI cs.MM 50%

A Survey on Image-text Multimodal Models

Ruifeng Guo, Jingxuan Wei, Linzhuang Sun, Bihui Yu, Guiyong Chang, Dawei Liu, Sibo Zhang, Zhengbing Yao, Mingjun Xu, Liping Bu

专题命中医疗多模态：biomedical(abstract)

2405.19654 2024-05-31 cs.AI 50%

Unlocking the Power of Spatial and Temporal Information in Medical Multimodal Pre-training

Jinxia Yang, Bing Su, Wayne Xin Zhao, Ji-Rong Wen

专题命中医疗多模态：medical image(abstract)

Comments Accepted at ICML 2024

2307.16740 2024-04-09 cond-mat.soft cond-mat.mtrl-sci 50%

Bioinspired multi-asymmetric magnetized surfaces for tailoring energy-free liquid manipulation and 3-DOF solid transportation

Jiaqi Miao

专题命中医疗多模态：biomedical(abstract)

Comments 25 pages, 6 figures

Journal ref Sensors and Actuators A: Physical, 115104 (2024)

2403.01483 2024-03-05 cs.RO 50%

BronchoCopilot: Towards Autonomous Robotic Bronchoscopy via Multimodal Reinforcement Learning

Jianbo Zhao, Hao Chen, Qingyao Tian, Jian Chen, Bingyu Yang, Hongbin Liu

专题命中医疗多模态：diagnosis(abstract)

2402.14840 2024-02-26 cs.CL cs.AI stat.AP 50%

RJUA-MedDQA: A Multimodal Benchmark for Medical Document Question Answering and Clinical Reasoning

Congyun Jin, Ming Zhang, Xiaowei Ma, Li Yujiao, Yingbo Wang, Yabo Jia, Yuliang Du, Tao Sun, Haowen Wang, Cong Fan, Jinjie Gu, Chenfei Chi, Xiangguo Lv, Fangzhou Li, Wei Xue, Yiran Huang

专题命中医疗多模态：diagnosis(abstract)

Comments 15 pages, 13 figures

2312.07904 2024-02-05 physics.ins-det 50%

ForMAX -- a beamline for multiscale and multimodal structural characterization of hierarchical materials

K. Nygård, S. A. McDonald, J. B. González, V. Haghighat, C. Appel, E. Larsson, R. Ghanbari, M. Viljanen, J. Silva, S. Malki, Y. Li, V. Silva, C. Weninger, F. Engelmann, T. Jeppsson, G. Felcsuti, T. Rosén, K. Gordeyeva, L. D. Söderberg, H. Dierks, Y. Zhang, Z. Yao, R. Yang, E. M. Asimakopoulou, J. K. Rogalinski, J. Wallentin, P. Villanueva-Perez, R. Krüger, T. Dreier, M. Bech, M. Liebi, M. Bek, R. Kádár, A. E. Terry, H. Tarawneh, P. Ilinski, J. Malmqvist, Y. Cerenius

专题命中医疗多模态：biomedical(abstract)

Comments Accepted for publication in J. Synchrotron Rad

1. 医疗多模态 975 篇

Agentic Temporal Graph of Reasoning with Multimodal Language Models: A Potential AI Aid to Healthcare

MMORE: Massive Multimodal Open RAG & Extraction

Knowing or Guessing? Robust Medical Visual Question Answering via Joint Consistency and Contrastive Learning

eSkinHealth: A Multimodal Dataset for Neglected Tropical Skin Diseases

A Language-Signal-Vision Multimodal Framework for Multitask Cardiac Analysis

Capabilities of GPT-5 on Multimodal Medical Reasoning

Accurate and Interpretable Postmenstrual Age Prediction via Multimodal Large Language Model

Plasmonic Color Filters Enable Label-Free Plasmon-Enhanced Array Tomography with sub-diffraction limited resolution

Haptic-Informed ACT with a Soft Gripper and Recovery-Informed Training for Pseudo Oocyte Manipulation

Worse than Random? An Embarrassingly Simple Probing Evaluation of Large Multimodal Models in Medical VQA

A Smart Multimodal Healthcare Copilot with Powerful LLM Reasoning

MRGAgents: A Multi-Agent Framework for Improved Medical Report Generation with Med-LVLMs

MER-CLIP: AU-Guided Vision-Language Alignment for Micro-Expression Recognition

Community Detection in Multimodal Data: A Similarity Network Perspective

Reducing Hallucinations of Medical Multimodal Large Language Models with Visual Retrieval-Augmented Generation

Leveraging Multimodal Methods and Spontaneous Speech for Alzheimer's Disease Identification

SubstationAI: Multimodal Large Model-Based Approaches for Analyzing Substation Equipment Faults

Deep Speech Synthesis from Multimodal Articulatory Representations

LLM-Driven Multimodal Opinion Expression Identification

Algorithm-agnostic significance testing in supervised learning with multimodal data

Multimodal Analysis of Traction Forces and Temperature Dynamics of Living Cells with Diamond-Embedded Substrate

Large Language Multimodal Models for 5-Year Chronic Disease Cohort Prediction Using EHR Data

Medical MLLM is Vulnerable: Cross-Modality Jailbreak and Mismatched Attacks on Medical Multimodal Large Language Models

Full Information Linked ICA: addressing missing data problem in multimodal fusion

A Survey on Image-text Multimodal Models

Unlocking the Power of Spatial and Temporal Information in Medical Multimodal Pre-training

Bioinspired multi-asymmetric magnetized surfaces for tailoring energy-free liquid manipulation and 3-DOF solid transportation

BronchoCopilot: Towards Autonomous Robotic Bronchoscopy via Multimodal Reinforcement Learning

RJUA-MedDQA: A Multimodal Benchmark for Medical Document Question Answering and Clinical Reasoning

ForMAX -- a beamline for multiscale and multimodal structural characterization of hierarchical materials