多模态大模型

UEMM-Air: Make Unmanned Aerial Vehicles Perform More Multi-modal Tasks

Liang Yao, Fan Liu, Shengxiang Xu, Chuanyi Zhang, Xing Ma, Jianyu Jiang, Zequan Wang, Shimin Di, Jun Zhou

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Multi-modal Multi-kernel Graph Learning for Autism Prediction and Biomarker Discovery

Jin Liu, Junbin Mao, Hanhe Lin, Hulin Kuang, Shirui Pan, Xusheng Wu, Shan Xie, Fei Liu, Yi Pan

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.AI

Theoretical Analyses of Multiobjective Evolutionary Algorithms on Multimodal Objectives

Weijie Zheng, Benjamin Doerr

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments Extended version of a paper that appeared in the proceedings of AAAI 2021. 49 pages. Latest version only fixed two bugs in the references

Journal ref Evol. Comput. 31(4): 337-373 (2023)

LMOD: A Large Multimodal Ophthalmology Dataset and Benchmark for Large Vision-Language Models

Zhenyue Qin, Yu Yin, Dylan Campbell, Xuansheng Wu, Ke Zou, Yih-Chung Tham, Ninghao Liu, Xiuzhen Zhang, Qingyu Chen

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments 2025 NAACL: Annual Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics Project Page: https://kfzyqin.github.io/lmod/

MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?

Yi-Fan Zhang, Huanyu Zhang, Haochen Tian, Chaoyou Fu, Shuangqing Zhang, Junfei Wu, Feng Li, Kun Wang, Qingsong Wen, Zhang Zhang, Liang Wang, Rong Jin, Tieniu Tan

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments Project Page: https://mme-realworld.github.io/; accepted by ICLR 2025

CerraData-4MM: A multimodal benchmark dataset on Cerrado for land use and land cover classification

Mateus de Souza Miranda, Ronny Hänsch, Valdivino Alexandre de Santiago Júnior, Thales Sehn Körting, Erison Carlos dos Santos Monteiro

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments 9 pages, 13 Figures, 3 tables

VidSole: A Multimodal Dataset for Joint Kinetics Quantification and Disease Detection with Deep Learning

Archit Kambhamettu, Samantha Snyder, Maliheh Fakhar, Samuel Audia, Ross Miller, Jae Kun Shim, Aniket Bera

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted by AAAI 2025 Special Track on AI for Social Impact

NUS-Emo at SemEval-2024 Task 3: Instruction-Tuning LLM for Multimodal Emotion-Cause Analysis in Conversations

Meng Luo, Han Zhang, Shengqiong Wu, Bobo Li, Hong Han, Hao Fei

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments 2nd place at SemEval-2024 Task 3, Subtask 2, to appear in SemEval-2024 proceedings

MME-Industry: A Cross-Industry Multimodal Evaluation Benchmark

Dongyi Yi, Guibo Zhu, Chenglin Ding, Zongshu Li, Dong Yi, Jinqiao Wang

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments 9 pages,2 figures

Figurative-cum-Commonsense Knowledge Infusion for Multimodal Mental Health Meme Classification

Abdullah Mazhar, Zuhair hasan shaik, Aseem Srivastava, Polly Ruhnke, Lavanya Vaddavalli, Sri Keshav Katragadda, Shweta Yadav, Md Shad Akhtar

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments Accepted for oral presentation at The Web Conference (WWW) 2025

Time-MMD: Multi-Domain Multimodal Dataset for Time Series Analysis

Haoxin Liu, Shangqing Xu, Zhiyuan Zhao, Lingkai Kong, Harshavardhan Kamarthi, Aditya B. Sasanur, Megha Sharma, Jiaming Cui, Qingsong Wen, Chao Zhang, B. Aditya Prakash

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments Accepted by NeurIPS 2024 Datasets and Benchmarks Track

Multimodal Sensor Dataset for Monitoring Older Adults Post Lower-Limb Fractures in Community Settings

Ali Abedi, Charlene H. Chu, Shehroz S. Khan

专题命中 多模态评测 ：multimodal(title)；multi-modal(abstract)；分类 cs.CV

Multimodal AI on Wound Images and Clinical Notes for Home Patient Referral

Reza Saadati Fard, Emmanuel Agu, Palawat Busaranuvong, Deepak Kumar, Shefalika Gautam, Bengisu Tulu, Diane Strong

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments arXiv admin note: text overlap with arXiv:2208.05051 by other authors

Semi-intrusive audio evaluation: Casting non-intrusive assessment as a multi-modal text prediction task

Jozef Coldenhoff, Milos Cernak

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 eess.AS

Comments Accepted at ICASSP 2025

A Multi-annotated and Multi-modal Dataset for Wide-angle Video Quality Assessment

Bo Hu, Wei Wang, Chunyi Li, Lihuo He, Leida Li, Xinbo Gao

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Distilling Multi-modal Large Language Models for Autonomous Driving

Deepti Hegde, Rajeev Yasarla, Hong Cai, Shizhong Han, Apratim Bhattacharyya, Shweta Mahajan, Litian Liu, Risheek Garrepalli, Vishal M. Patel, Fatih Porikli

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

AugRefer: Advancing 3D Visual Grounding via Cross-Modal Augmentation and Spatial Relation-based Referring

Xinyi Wang, Na Zhao, Zhiyuan Han, Dan Guo, Xun Yang

专题命中 多模态评测 ：cross-modal(title,abstract)；分类 cs.CV

Comments AAAI 2025

OpticFusion: Multi-Modal Neural Implicit 3D Reconstruction of Microstructures by Fusing White Light Interferometry and Optical Microscopy

Shuo Chen, Yijin Li, Guofeng Zhang

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Comments 3DV 2025

Benchmarking Multimodal Models for Fine-Grained Image Analysis: A Comparative Study Across Diverse Visual Features

Evgenii Evstafev

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments 6 pages, 2 tables, 2 charts

Leveraging Taxonomy and LLMs for Improved Multimodal Hierarchical Classification

Shijing Chen, Mohamed Reda Bouadjenek, Shoaib Jameel, Usman Naseem, Basem Suleiman, Flora D. Salim, Hakim Hacid, Imran Razzak

专题命中 多模态评测 ：multimodal(title)；multi-modal(abstract)；分类 cs.AI

Comments 11 pages, 7 figures, 2 tables, and accepted by COLING 2025

A Multimodal Dataset for Enhancing Industrial Task Monitoring and Engagement Prediction

Naval Kishore Mehta, Arvind, Himanshu Kumar, Abeer Banerjee, Sumeet Saurav, Sanjay Singh

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted at the 20th International Conference on Human-Robot Interaction (HRI) 2025

Motion-X++: A Large-Scale Multimodal 3D Whole-body Human Motion Dataset

Yuhong Zhang, Jing Lin, Ailing Zeng, Guanlin Wu, Shunlin Lu, Yurong Fu, Yuanhao Cai, Ruimao Zhang, Haoqian Wang, Lei Zhang

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments 17 pages, 14 figures, This work extends and enhances the research published in the NeurIPS 2023 paper, "Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Dataset". arXiv admin note: substantial text overlap with arXiv:2307.00818

Multi-Modal One-Shot Federated Ensemble Learning for Medical Data with Vision Large Language Model

Naibo Wang, Yuchen Deng, Shichen Fan, Jianwei Yin, See-Kiong Ng

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.AI

Towards Multimodal Metaphor Understanding: A Chinese Dataset and Model for Metaphor Mapping Identification

Dongyu Zhang, Shengcheng Yin, Jingwei Yu, Zhiyao Wu, Zhen Li, Chengpei Xu, Xiaoxia Wang, Feng Xia

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Balance-aware Sequence Sampling Makes Multi-modal Learning Better

Zhi-Hao Guan

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.AI

OV-HHIR: Open Vocabulary Human Interaction Recognition Using Cross-modal Integration of Large Language Models

Lala Shakti Swarup Ray, Bo Zhou, Sungho Suh, Paul Lukowicz

专题命中 多模态评测 ：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted in IEEE ICASSP 2025

ProtCLIP: Function-Informed Protein Multi-Modal Learning

Hanjing Zhou, Mingze Yin, Wei Wu, Mingyang Li, Kun Fu, Jintai Chen, Jian Wu, Zheng Wang

专题命中 多模态评测 ：multi-modal(title)；cross-modal(abstract)；分类 cs.AI

Journal ref AAAI 2025

3D-Speaker-Toolkit: An Open-Source Toolkit for Multimodal Speaker Verification and Diarization

Yafeng Chen, Siqi Zheng, Hui Wang, Luyao Cheng, Tinglong Zhu, Rongjie Huang, Chong Deng, Qian Chen, Shiliang Zhang, Wen Wang, Xihao Li

专题命中 多模态评测 ：multimodal(title,abstract)；分类 eess.AS

An Attentive Dual-Encoder Framework Leveraging Multimodal Visual and Semantic Information for Automatic OSAHS Diagnosis

Yingchen Wei, Xihe Qiu, Xiaoyu Tan, Jingjing Huang, Wei Chu, Yinghui Xu, Yuan Qi

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments 5 pages, 2 figures, Published as a conference paper at ICASSP 2025

BIG-MoE: Bypass Isolated Gating MoE for Generalized Multimodal Face Anti-Spoofing

Yingjie Ma, Zitong Yu, Xun Lin, Weicheng Xie, Linlin Shen

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted by ICASSP 2025