多模态大模型

GEM: Empowering MLLM for Grounded ECG Understanding with Time Series and Images

Xiang Lan, Feng Wu, Kai He, Qinghao Zhao, Shenda Hong, Mengling Feng

机构 * National University of Singapore（新加坡国立大学） ； Peking University People’s Hospital（北京大学人民医院） ； Peking University（北京大学） 纠错

专题命中 多模态评测 ：MLLM(title,abstract)；multimodal(abstract)；cross-modal(abstract)；分类 cs.CV、cs.CL、cs.AI

Comments NeurIPS 2025 Camera-Ready

REACT-KD: Region-Aware Cross-modal Topological Knowledge Distillation for Interpretable Medical Image Classification

Hongzhao Chen, Hexiao Ding, Yufeng Jiang, Jing Lan, Ka Chun Li, Gerald W. Y. Cheng, Nga-Chun Ng, Yao Pu, Jing Cai, Liang-ting Lin, Jung Sun Yoo

机构 * Department of Health Technology and Informatics, Hong Kong Polytechnic University（健康科技与信息技术系，香港理工大学） ； Department of Nuclear Medicine and PET, Hong Kong Sanatorium and Hospital（核医学与PET部门，香港疗养院及医院） 纠错

专题命中 多模态评测 ：cross-modal(title,abstract)；multi-modal(abstract)；分类 cs.CV

Flex-Judge: Text-Only Reasoning Unleashes Zero-Shot Multimodal Evaluators

Jongwoo Ko, Sungnyun Kim, Sungwoo Cho, Se-Young Yun

机构 * Microsoft（微软公司） ； KAIST AI（韩国科学技术院人工智能研究所） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

Comments NeurIPS 2025

Towards Evaluating Proactive Risk Awareness of Multimodal Language Models

Youliang Yuan, Wenxiang Jiao, Yuejin Xie, Chihao Shen, Menghan Tian, Wenxuan Wang, Jen-tse Huang, Pinjia He

机构 * School of Data Science, The Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳）数据科学学院） ； Xiaohongshu Inc.（小红书公司） ； Renmin University of China（中国人民大学） ； Johns Hopkins University（约翰霍普金斯大学） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted by NeurIPS 2025 (Track on Datasets and Benchmarks)

Enhanced Motion Forecasting with Plug-and-Play Multimodal Large Language Models

Katie Luo, Jingwei Ji, Tong He, Runsheng Xu, Yichen Xie, Dragomir Anguelov, Mingxing Tan

机构 * Computer and Information Sciences Department, Cornell University（康奈尔大学计算机与信息科学系） ； Waymo LLC（Waymo公司） ； UC Berkeley（伯克利大学） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments In proceedings of IROS 2025

Few-Label Multimodal Modeling of SNP Variants and ECG Phenotypes Using Large Language Models for Cardiovascular Risk Stratification

Niranjana Arun Menon, Yulong Li, Iqra Farooq, Sara Ahmed, Muhammad Awais, Imran Razzak

机构 * University of New South Wales, Australia（新南威尔士大学，澳大利亚） ； University of Surrey, United Kingdom（萨里大学，英国） ； Mohamed bin Zayed University of Artificial Intelligence, UAE（穆罕默德·本·扎耶德人工智能大学，阿联酋） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Embody 3D: A Large-scale Multimodal Motion and Behavior Dataset

Claire McLean, Makenzie Meendering, Tristan Swartz, Orri Gabbay, Alexandra Olsen, Rachel Jacobs, Nicholas Rosen, Philippe de Bree, Tony Garcia, Gadsden Merrill, Jake Sandakly, Julia Buffalini, Neham Jain, Steven Krenn, Moneish Kumar, Dejan Markovic, Evonne Ng, Fabian Prada, Andrew Saba, Siwei Zhang, Vasu Agrawal, Tim Godisart, Alexander Richard, Michael Zollhoefer

机构 * Codec Avatars Lab, Meta（Meta 编码化身实验室） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Adaptive Data-Resilient Multi-Modal Hierarchical Multi-Label Book Genre Identification

Utsav Kumar Nareti, Soumi Chattopadhyay, Prolay Mallick, Suraj Kumar, Chandranath Adak, Ayush Vikas Daga, Adarsh Wase, Arjab Roy

机构 * Dept. of CSE, IIT Patna, India（计算机科学与工程系，印度帕纳布理工大学） ； Dept. of CSE, IIT Indore, India（计算机科学与工程系，印度英迪亚理工大学） ； SVNIT, India（萨瓦尼特理工学院，印度） ； IIT Indore and IIM Indore, India（英迪亚理工大学和印度管理学院，印度） ； Dept. of HSS, IIIT Guwahati, India（人文社会科学系，印度古瓦哈提理工学院） 纠错

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CL

A social context-aware graph-based multimodal attentive learning framework for disaster content classification during emergencies: a benchmark dataset and method

Shahid Shafi Dar, Mohammad Zia Ur Rehman, Karan Bais, Mohammed Abdul Haseeb, Nagendra Kumara

机构 * Indian Institute of Technology Indore（印度理工学院Indore分校） ； Institute of Engineering（工程院） ； Indian Institute of Information Technology Dharwad（印度信息技术学院Dharwad分校） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Journal ref journal={Expert Systems with Applications},pages={125337},year={2024},publisher={Elsevier}

Toward Multimodal Privacy in XR: Design and Evaluation of Composite Privatization Methods for Gaze and Body Tracking Data

Azim Ibragimov, Ethan Wilson, Kevin R. B. Butler, Eakta Jain

专题命中 多模态评测 ：multimodal(title,abstract)

iDETEX: Empowering MLLMs for Intelligent DETailed EXplainable IQA

Zhaoran Zhao, Xinli Yue, Jianhui Sun, Yuhao Xie, Tao Shao, Liangchao Yao, Fan Xia, Yuetang Deng

机构 * Tencent, WeChat（腾讯，微信） 纠错

专题命中 多模态评测 ：multimodal(abstract)；MLLM(abstract)；分类 cs.CV

Comments Accepted to ICCV 2025 Workshop

Aria Gen 2 Pilot Dataset

Chen Kong, James Fort, Aria Kang, Jonathan Wittmer, Simon Green, Tianwei Shen, Yipu Zhao, Cheng Peng, Gustavo Solaira, Andrew Berkovich, Nikhil Raina, Vijay Baiyya, Evgeniy Oleinik, Eric Huang, Fan Zhang, Julian Straub, Mark Schwesinger, Luis Pesqueira, Xiaqing Pan, Jakob Julian Engel, Carl Ren, Mingfei Yan, Richard Newcombe

专题命中 多模态评测 ：multimodal(abstract)；分类 cs.CV、cs.AI

Fusion-Augmented Large Language Models: Boosting Diagnostic Trustworthiness via Model Consensus

Md Kamrul Siam, Md Jobair Hossain Faruk, Jerry Q. Cheng, Huanying Gu

专题命中 多模态评测 ：multimodal(abstract)；分类 cs.CL、cs.AI

Comments 7 pages (Accepted to IEEE BHI 2025)

Dolphin v1.0 Technical Report

Taohan Weng, Kaibing Hu, Henan Liu, Siya Liu, Xiaoyang Liu, Zhenyu Liu, Jiren Ren, Boyan Wang, Boyang Wang, Yiyu Wang, Yalun Wu, Chaoran Yan, Kaiwen Yan, Jinze Yu, Chi Zhang, Duo Zhang, Haoyun Zheng, Xiaoqing Guo, Jacques Souquet, Hongcheng Guo, Anjie Le

专题命中 多模态评测 ：multimodal(abstract)；分类 cs.CV、cs.AI

TREAT: A Code LLMs Trustworthiness / Reliability Evaluation and Testing Framework

Shuzheng Gao, Eric John Li, Man Ho Lam, Jingyu Xiao, Yuxuan Wan, Chaozheng Wang, Ng Man Tik, Michael R. Lyu

机构 * ARISE Lab, Department of Computer Science and Engineering（ARISE实验室，计算机科学与工程系） 纠错

专题命中 多模态评测 ：multi-modal(abstract)；分类 cs.AI

CARDIUM: Congenital Anomaly Recognition with Diagnostic Images and Unified Medical records

Daniela Vega, Hannah V. Ceballos, Javier S. Vera, Santiago Rodriguez, Alejandra Perez, Angela Castillo, Maria Escobar, Dario Londoño, Luis A. Sarmiento, Camila I. Castro, Nadiezhda Rodriguez, Juan C. Briceño, Pablo Arbeláez

机构 * Universidad de los Andes（andes大学） ； Fundación Santa Fe de Bogotá（圣费博多哥基金会） 纠错

专题命中 多模态评测 ：multimodal(abstract)；分类 cs.CV

Comments Accepted to CVAMD Workshop, ICCV 2025

Challenges, Advances, and Evaluation Metrics in Medical Image Enhancement: A Systematic Literature Review

Chun Wai Chin, Haniza Yazid, Hoi Leong Lee

专题命中 多模态评测 ：multi-modal(abstract)；分类 cs.CV