多模态大模型

MultiSensor-Home: A Wide-area Multi-modal Multi-view Dataset for Action Recognition and Transformer-based Sensor Fusion

Trung Thanh Nguyen, Yasutomo Kawanishi, Vijay John, Takahiro Komamizu, Ichiro Ide

机构 * Graduate School of Informatics, Nagoya University（名古屋大学信息学研究科） ； Guardian Robot Project, Information R&D and Strategy Headquarters, RIKEN（RIKEN信息研发与战略总部Guardian机器人项目） ； Center for Artificial Intelligence, Mathematical and Data Science, Nagoya University（名古屋大学人工智能中心，数学与数据科学） 纠错

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Comments The 19th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2025)

The Multimodal Paradox: How Added and Missing Modalities Shape Bias and Performance in Multimodal AI

Kishore Sampath, Pratheesh, Ayaazuddin Mohammad, Resmi Ramachandranpillai

机构 * Northeastern University（东北大学） ； Institute for Experiential AI（体验人工智能研究所） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments CVPR 2025 Second Workshop on Responsible Generative AI

Task-Oriented Semantic Communication in Large Multimodal Models-based Vehicle Networks

Baoxia Du, Hongyang Du, Dusit Niyato, Ruidong Li

机构 * Institute of Science and Engineering, Kanazawa University（金泽大学科学与工程研究所） ； Department of Electrical and Electronic Engineering, University of Hong Kong（香港大学电子与电气工程系） ； College of Computing and Data Science, Nanyang Technological University（南洋理工大学计算与数据科学学院） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

R-Bench: Graduate-level Multi-disciplinary Benchmarks for LLM & MLLM Complex Reasoning Evaluation

Meng-Hao Guo, Jiajun Xu, Yi Zhang, Jiaxi Song, Haoyang Peng, Yi-Xuan Deng, Xinzhi Dong, Kiyohiro Nakayama, Zhengyang Geng, Chen Wang, Bolin Ni, Guo-Wei Yang, Yongming Rao, Houwen Peng, Han Hu, Gordon Wetzstein, Shi-min Hu

专题命中 多模态评测 ：MLLM(title)；multimodal(abstract)；分类 cs.CV

Comments 18pages

Interpretable graph-based models on multimodal biomedical data integration: A technical review and benchmarking

Alireza Sadeghi, Farshid Hajati, Ahmadreza Argha, Nigel H Lovell, Min Yang, Hamid Alinejad-Rokny

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments 41 pages

RiskLabs: Predicting Financial Risk Using Large Language Model based on Multimodal and Multi-Sources Data

Yupeng Cao, Zhi Chen, Prashant Kumar, Qingyun Pei, Yangyang Yu, Haohang Li, Fabrizio Dimino, Lorenzo Ausiello, K. P. Subbalakshmi, Papa Momar Ndiaye

机构 * Stevens Institute of Technology（史蒂文斯理工学院） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

SMSAT: A Multimodal Acoustic Dataset and Deep Contrastive Learning Framework for Affective and Physiological Modeling of Spiritual Meditation

Ahmad Suleman, Yazeed Alkhrijah, Misha Urooj Khan, Hareem Khan, Muhammad Abdullah Husnain Ali Faiz, Mohamad A. Alawad, Zeeshan Kaleem, Guan Gui

机构 * AITeC, National Center for Physics (NCP), Pakistan（AITeC，国家物理研究中心（NCP），巴基斯坦） ； Imam Mohammad Ibn Saud Islamic University (IMSIU)（伊玛目穆罕默德·伊本·沙特伊斯兰大学） ； European Organization for Nuclear Research, CERN, Switzerland（欧洲核子研究中心，CERN，瑞士） ； University of Engineering (UET), Taxila（工程大学（UET），塔西拉） ； Department of Computer Engineering and the Interdisciplinary Research Center for Smart Mobility and Logistics, King Fahd University of Petroleum & Minerals (KFUPM)（计算机工程系及智能物流与移动性交叉研究中心，国王法赫德石油与矿物大学（KFUPM）） ； College of Telecommunications and Information Engineering, Nanjing University of Posts and Telecommunications, Nanjing（电信与信息工程学院，南京邮电大学，南京） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)；分类 eess.AS

Soybean Disease Detection via Interpretable Hybrid CNN-GNN: Integrating MobileNetV2 and GraphSAGE with Cross-Modal Attention

Md Abrar Jahin, Soudeep Shahriar, M. F. Mridha, Md. Jakir Hossen, Nilanjan Dey

机构 * Biology Unit, Okinawa Institute of Science ； Technology Graduate University, Okinawa 904-0412, Japan (e-mail: ) ； Thomas Lord Department of Computer Science, Viterbi School of Engineering, University of Southern California, Los Angeles, CA 90007, USA (e-mail: ) ； Department of Computer Science, American International University-Bangladesh, Dhaka 1229, Bangladesh (e-mail: , ) ； Department of Robotics ； Automation, Multimedia University, Melaka, Malaysia (e-mail: ) ； Department of Computer Science \& Engineering, Techno International New Town, Kolkata 700156, India (e-mail: ) 纠错

专题命中 多模态评测 ：cross-modal(title,abstract)；分类 cs.CV

VisualPuzzles: Decoupling Multimodal Reasoning Evaluation from Domain Knowledge

Yueqi Song, Tianyue Ou, Yibo Kong, Zecheng Li, Graham Neubig, Xiang Yue

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments 56 pages, 43 figures

Plant Disease Detection through Multimodal Large Language Models and Convolutional Neural Networks

Konstantinos I. Roumeliotis, Ranjan Sapkota, Manoj Karkee, Nikolaos D. Tselikas, Dimitrios K. Nasiopoulos

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

MERA: Multimodal and Multiscale Self-Explanatory Model with Considerably Reduced Annotation for Lung Nodule Diagnosis

Jiahao Lu, Chong Yin, Silvia Ingala, Kenny Erleben, Michael Bachmann Nielsen, Sune Darkner

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

SSHNet: Unsupervised Cross-modal Homography Estimation via Problem Reformulation and Split Optimization

Junchen Yu, Si-Yuan Cao, Runmin Zhang, Chenghao Zhang, Zhu Yu, Shujie Chen, Bailin Yang, Hui-liang Shen

机构 * Ningbo Innovation Center, Zhejiang University（浙江大学宁波创新中心） ； College of Information Science and Electronic Engineering, Zhejiang University（浙江大学信息科学与电子工程学院） ； NingboTech University（宁波科技学院） ； Zhejiang Key Laboratory of Big Data and Future ECommerce Technology, Hangzhou, China（浙江大数据与未来电子商务技术重点实验室） 纠错

专题命中 多模态评测 ：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted by CVPR 2025

Plasma State Monitoring and Disruption Characterization using Multimodal VAEs

Yoeri Poels, Alessandro Pau, Christian Donner, Giulio Romanelli, Olivier Sauter, Cristina Venturini, Vlado Menkovski, the TCV team, the WPTE team

机构 * 1 École Polytechnique Fédérale de Lausanne (EPFL), Swiss Plasma Center (SPC), CH-1015 Lausanne, Switzerland ； 2 Eindhoven University of Technology (TU/e), Mathematics ； Computer Science, NL-5600MB Eindhoven, The Netherlands ； 3 Swiss Data Science Center (SDSC), ETH Zürich \& EPFL, CH-8092 Zürich \& CH-1015 Lausanne, Switzerland 纠错

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Bridging Cognition and Emotion: Empathy-Driven Multimodal Misinformation Detection

Zihan Wang, Lu Yuan, Zhengxuan Zhang, Qing Zhao

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

GeoSense: Evaluating Identification and Application of Geometric Principles in Multimodal Reasoning

Liangyu Xu, Yingxiu Zhao, Jingyun Wang, Yingyao Wang, Bu Pi, Chen Wang, Mingliang Zhang, Jihao Gu, Xiang Li, Xiaoyong Zhu, Jun Song, Bo Zheng

机构 * Taobao & Tmall Group of Alibaba Beijing China（阿里巴巴北京公司） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments 10 pages, 8 figures

MM-InstructEval: Zero-Shot Evaluation of (Multimodal) Large Language Models on Multimodal Reasoning Tasks

Xiaocui Yang, Wenfang Wu, Shi Feng, Ming Wang, Daling Wang, Yang Li, Qi Sun, Yifei Zhang, Xiaoming Fu, Soujanya Poria

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.MM

Comments Accepted by the Information Fusion Journal

VisuLogic: A Benchmark for Evaluating Visual Reasoning in Multi-modal Large Language Models

Weiye Xu, Jiahao Wang, Weiyun Wang, Zhe Chen, Wengang Zhou, Aijun Yang, Lewei Lu, Houqiang Li, Xiaohua Wang, Xizhou Zhu, Wenhai Wang, Jifeng Dai, Jinguo Zhu

机构 * University of Science and Technology of China（中国科学技术大学） ； Xi’an Jiaotong University（西安交通大学） ； SenseTime Research（商汤科技研究院） ； Tsinghua University（清华大学） 纠错

专题命中 多模态评测 ：multi-modal(title)；multimodal(abstract)；分类 cs.CV

Comments Code, data, and baselines are available at https://visulogic-benchmark.github.io/VisuLogic

LOKI: A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Models

Junyan Ye, Baichuan Zhou, Zilong Huang, Junan Zhang, Tianyi Bai, Hengrui Kang, Jun He, Honglin Lin, Zihao Wang, Tong Wu, Zhizheng Wu, Yiping Chen, Dahua Lin, Conghui He, Weijia Li

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments ICLR 2025 SPOTLIGHT, 83 pages, 63 figures

ProteinGPT: Multimodal LLM for Protein Property Prediction and Structure Understanding

Yijia Xiao, Edward Sun, Yiqiao Jin, Qifan Wang, Wei Wang

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments Spotlight, Machine Learning for Genomics Explorations @ ICLR 2025

LAD-Reasoner: Tiny Multimodal Models are Good Reasoners for Logical Anomaly Detection

Weijia Li, Guanglei Chu, Jiong Chen, Guo-Sen Xie, Caifeng Shan, Fang Zhao

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

K-means Enhanced Density Gradient Analysis for Urban and Transport Metrics Using Multi-Modal Satellite Imagery

P. Tomkiewicz, J. Jaworski, P. Zielonka, A. Wilinski

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Comments 16 pages, 6 figures

MMC: Iterative Refinement of VLM Reasoning via MCTS-based Multimodal Critique

Shuhang Liu, Zhenrong Zhang, Pengfei Hu, Jiefeng Ma, Jun Du, Qing Wang, Jianshu Zhang, Quan Liu, Jianqing Gao, Feng Ma

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.MM

FHBench: Towards Efficient and Personalized Federated Learning for Multimodal Healthcare

Penghao Wang, Qian Chen, Teng Zhang, Yingwei Zhang, Wang Lu, Yiqiang Chen

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning

Fanqing Meng, Lingxiao Du, Zongkai Liu, Zhixiang Zhou, Quanfeng Lu, Daocheng Fu, Tiancheng Han, Botian Shi, Wenhai Wang, Junjun He, Kaipeng Zhang, Ping Luo, Yu Qiao, Qiaosheng Zhang, Wenqi Shao

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Muse: A Multimodal Conversational Recommendation Dataset with Scenario-Grounded User Profiles

Zihan Wang, Xiaocui Yang, Yongkang Liu, Shi Feng, Daling Wang, Yifei Zhang

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.MM

Leveraging Driver Field-of-View for Multimodal Ego-Trajectory Prediction

M. Eren Akbiyik, Nedko Savov, Danda Pani Paudel, Nikola Popovic, Christian Vater, Otmar Hilliges, Luc Van Gool, Xi Wang

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted to 13th International Conference on Learning Representations (ICLR 2025), 29 pages

Integrating Vision and Location with Transformers: A Multimodal Deep Learning Framework for Medical Wound Analysis

Ramin Mousa, Hadis Taherinia, Khabiba Abdiyeva, Amir Ali Bengari, Mohammadmahdi Vahediahmar

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

MBE-ARI: A Multimodal Dataset Mapping Bi-directional Engagement in Animal-Robot Interaction

Ian Noronha, Advait Prasad Jawaji, Juan Camilo Soto, Jiajun An, Yan Gu, Upinder Kaur

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted to ICRA 2025

CMIP-CIL: A Cross-Modal Benchmark for Image-Point Class Incremental Learning

Chao Qi, Jianqin Yin, Ren Zhang

专题命中 多模态评测 ：cross-modal(title,abstract)；分类 cs.CV

A Multi-Modal AI System for Screening Mammography: Integrating 2D and 3D Imaging to Improve Breast Cancer Detection in a Prospective Clinical Study

Jungkyu Park, Jan Witowski, Yanqi Xu, Hari Trivedi, Judy Gichoya, Beatrice Brown-Mulry, Malte Westerhoff, Linda Moy, Laura Heacock, Alana Lewin, Krzysztof J. Geras

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV