多模态大模型

MuSaRoNews: A Multidomain, Multimodal Satire Dataset from Romanian News Articles

Răzvan-Alexandru Smădu, Andreea Iuga, Dumitru-Clementin Cercel

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments 10 pages, 9 figures

Unveiling the Impact of Multimodal Features on Chinese Spelling Correction: From Analysis to Design

Xiaowu Zhang, Hongfei Zhao, Jingyi Hou, Zhijie Liu

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

ClimateBench-M: A Multi-Modal Climate Data Benchmark with a Simple Generative Method

Dongqi Fu, Yada Zhu, Zhining Liu, Lecheng Zheng, Xiao Lin, Zihao Li, Liri Fang, Katherine Tieu, Onkar Bhardwaj, Kommy Weldemariam, Hanghang Tong, Hendrik Hamann, Jingrui He

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.AI

Comments Preprint, 29 pages

Benchmarking Multi-modal Semantic Segmentation under Sensor Failures: Missing and Noisy Modality Robustness

Chenfei Liao, Kaiyu Lei, Xu Zheng, Junha Moon, Zhixiong Wang, Yixuan Wang, Danda Pani Paudel, Luc Van Gool, Xuming Hu

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Comments This paper has been accepted by the CVPR 2025 Workshop: TMM-OpenWorld as an oral presentation paper

ActiView: Evaluating Active Perception Ability for Multimodal Large Language Models

Ziyue Wang, Chi Chen, Fuwen Luo, Yurui Dong, Yuanchi Zhang, Yuzhuang Xu, Xiaolong Wang, Peng Li, Yang Liu

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

StayLTC: A Cost-Effective Multimodal Framework for Hospital Length of Stay Forecasting

Sudeshna Jana, Manjira Sinha, Tirthankar Dasgupta

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments 4 pages, 3 figures

Investigating the Scaling Effect of Instruction Templates for Training Multimodal Language Model

Shijian Wang, Linxin Song, Jieyu Zhang, Ryotaro Shimizu, Jiarui Jin, Ao Luo, Yuan Lu, Li Yao, Cunjian Chen, Julian McAuley, Wentao Zhang, Hanqian Wu

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

A High-Force Gripper with Embedded Multimodal Sensing for Powerful and Perception Driven Grasping

Edoardo Del Bianco, Davide Torielli, Federico Rollo, Damiano Gasperini, Arturo Laurenzi, Lorenzo Baccelliere, Luca Muratore, Marco Roveri, Nikos G. Tsagarakis

专题命中 多模态评测 ：multimodal(title)；multi-modal(abstract)；分类 cs.AI

Comments 8 pages, 15 figures

Journal ref IEEE-RAS International Conference on Humanoid Robots (Humanoids), Nancy, France, 2024, pp. 149-156

Multimodal Lengthy Videos Retrieval Framework and Evaluation Metric

Mohamed Eltahir, Osamah Sarraj, Mohammed Bremoo, Mohammed Khurd, Abdulrahman Alfrihidi, Taha Alshatiri, Mohammad Almatrafi, Tanveer Hussain

专题命中 多模态评测 ：multimodal(title)；multi-modal(abstract)；分类 cs.CV

CliME: Evaluating Multimodal Climate Discourse on Social Media and the Climate Alignment Quotient (CAQ)

Abhilekh Borah, Hasnat Md Abdullah, Kangda Wei, Ruihong Huang

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments 16 pages, 9 figures

Machine Learning Prediction of Cardiovascular Risk in Type 1 Diabetes Mellitus Using Radiomics Features from Multimodal Retinal Images

Ariadna Tohà-Dalmau, Josep Rosinés-Fonoll, Enrique Romero, Ferran Mazzanti, Ruben Martin-Pinardel, Sonia Marias-Perez, Carolina Bernal-Morales, Rafael Castro-Dominguez, Andrea Mendez, Emilio Ortega, Irene Vinagre, Marga Gimenez, Alfredo Vellido, Javier Zarranz-Ventura

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments 19 pages, 7 figures. Submitted to Ophthalmology Science, under second review

GMAI-VL-R1: Harnessing Reinforcement Learning for Multimodal Medical Reasoning

Yanzhou Su, Tianbin Li, Jiyao Liu, Chenglong Ma, Junzhi Ning, Cheng Tang, Sibo Ju, Jin Ye, Pengcheng Chen, Ming Hu, Shixiang Tang, Lihao Liu, Bin Fu, Wenqi Shao, Xiaowei Hu, Xiangwen Liao, Yuanfeng Ji, Junjun He

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Multimodal Point Cloud Semantic Segmentation With Virtual Point Enhancement

Zaipeng Duan, Xuzhong Hu, Pei An, Jie Ma

专题命中 多模态评测 ：multimodal(title)；multi-modal(abstract)；分类 cs.CV

XLRS-Bench: Could Your Multimodal LLMs Understand Extremely Large Ultra-High-Resolution Remote Sensing Imagery?

Fengxiang Wang, Hongzhen Wang, Mingshuo Chen, Di Wang, Yulin Wang, Zonghao Guo, Qiang Ma, Long Lan, Wenjing Yang, Jing Zhang, Zhiyuan Liu, Maosong Sun

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments It has been accepted by CVPR2025

Mosaic of Modalities: A Comprehensive Benchmark for Multimodal Graph Learning

Jing Zhu, Yuhang Zhou, Shengyi Qian, Zhongmou He, Tong Zhao, Neil Shah, Danai Koutra

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments CVPR 2025

Exploring Hallucination of Large Multimodal Models in Video Understanding: Benchmark, Analysis and Mitigation

Hongcheng Gao, Jiashu Qu, Jingyi Tang, Baolong Bi, Yue Liu, Hongyu Chen, Li Liang, Li Su, Qingming Huang

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Foundation Model for Whole-Heart Segmentation: Leveraging Student-Teacher Learning in Multi-Modal Medical Imaging

Abdul Qayyum, Moona Mazher, Devran Ugurlu, Jose Alonso Solis Lemus, Cristobal Rodero, Steven A Niederer

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Adaptive Unimodal Regulation for Balanced Multimodal Information Acquisition

Chengxiang Huang, Yake Wei, Zequn Yang, Di Hu

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments 10pages, 16 figures, CVPR2025

MMCR: Advancing Visual Language Model in Multimodal Multi-Turn Contextual Reasoning

Dawei Yan, Yang Li, Qing-Guo Chen, Weihua Luo, Peng Wang, Haokui Zhang, Chunhua Shen

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

CarbonSense: A Multimodal Dataset and Baseline for Carbon Flux Modelling

Matthew Fortier, Mats L. Richter, Oliver Sonnentag, Chris Pal

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments 9 content pages, 11 reference pages, 9 appendix pages

Mind with Eyes: from Language Reasoning to Multimodal Reasoning

Zhiyu Lin, Yifei Gao, Xian Zhao, Yunfan Yang, Jitao Sang

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Multi-modal Multi-platform Person Re-Identification: Benchmark and Method

Ruiyang Ha, Songyi Jiang, Bin Li, Bikang Pan, Yihang Zhu, Junjie Zhang, Xiatian Zhu, Shaogang Gong, Jingya Wang

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

When Tom Eats Kimchi: Evaluating Cultural Bias of Multimodal Large Language Models in Cultural Mixture Contexts

Jun Seong Kim, Kyaw Ye Thu, Javad Ismayilzada, Junyeong Park, Eunsu Kim, Huzama Ahmad, Na Min An, James Thorne, Alice Oh

专题命中 多模态评测 ：multimodal(title)；multi-modal(abstract)；分类 cs.CL

Comments 12 pages

Multi-modal data generation with a deep metric variational autoencoder

Josefine Vilsbøll Sundgaard, Morten Rieger Hannemose, Søren Laugesen, Peter Bray, James Harte, Yosuke Kamide, Chiemi Tanaka, Rasmus R. Paulsen, Anders Nymark Christensen

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Multi-Modal Self-Supervised Semantic Communication

Hang Zhao, Hongru Li, Dongfang Xu, Shenghui Song, Khaled B. Letaief

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

BigDocs: An Open Dataset for Training Multimodal Models on Document and Code Tasks

Juan Rodriguez, Xiangru Jian, Siba Smarak Panigrahi, Tianyu Zhang, Aarash Feizi, Abhay Puri, Akshay Kalkunte, François Savard, Ahmed Masry, Shravan Nayak, Rabiul Awal, Mahsa Massoud, Amirhossein Abaskohi, Zichao Li, Suyuchen Wang, Pierre-André Noël, Mats Leon Richter, Saverio Vadacchino, Shubham Agarwal, Sanket Biswas, Sara Shanian, Ying Zhang, Noah Bolger, Kurt MacDonald, Simon Fauvel, Sathwik Tejaswi, Srinivas Sunkara, Joao Monteiro, Krishnamurthy DJ Dvijotham, Torsten Scholak, Nicolas Chapados, Sepideh Kharagani, Sean Hughes, M. Özsu, Siva Reddy, Marco Pedersoli, Yoshua Bengio, Christopher Pal, Issam Laradji, Spandana Gella, Perouz Taslakian, David Vazquez, Sai Rajeswar

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments The project is hosted at https://bigdocs.github.io

Journal ref ICLR 2025 https://openreview.net/forum?id=UTgNFcpk0j

Pose as a Modality: A Psychology-Inspired Network for Personality Recognition with a New Multimodal Dataset

Bin Tang, Keqi Pan, Miao Zheng, Ning Zhou, Jialu Sui, Dandan Zhu, Cheng-Long Deng, Shu-Guang Kuai

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments 9 pages, 6 figures, AAAI 2025 Oral

M$^{3}$-20M: A Large-Scale Multi-Modal Molecule Dataset for AI-driven Drug Design and Discovery

Siyuan Guo, Lexuan Wang, Chang Jin, Jinxian Wang, Han Peng, Huayang Shi, Wengen Li, Jihong Guan, Shuigeng Zhou

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.AI

VERIFY: A Benchmark of Visual Explanation and Reasoning for Investigating Multimodal Reasoning Fidelity

Jing Bi, Junjia Guo, Susan Liang, Guangyu Sun, Luchuan Song, Yunlong Tang, Jinxi He, Jiarui Wu, Ali Vosoughi, Chen Chen, Chenliang Xu

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

A Framework for a Capability-driven Evaluation of Scenario Understanding for Multimodal Large Language Models in Autonomous Driving

Tin Stribor Sohn, Philipp Reis, Maximilian Dillitzer, Johannes Bach, Jason J. Corso, Eric Sax

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments Submitted to IEEE IAVVC 2025, Under Review