多模态大模型

Stress Detection from Multimodal Wearable Sensor Data

Paul Schreiber, Beyza Cinar, Lennart Mackert, Maria Maleshkova

专题命中 多模态评测 ：multimodal(title)；multi-modal(abstract)

Affordances of Sketched Notations for Multimodal UI Design and Development Tools

Sam H. Ross, Yunseo Lee, Coco K. Lee, Jayne Everson, R. Benjamin Shapiro

专题命中 多模态评测 ：multimodal(title,abstract)

Comments VL/HCC 2025

Beauty and the Bias: Exploring the Impact of Attractiveness on Multimodal Large Language Models

Aditya Gulati, Moreno D'Incà, Nicu Sebe, Bruno Lepri, Nuria Oliver

专题命中 多模态评测 ：multimodal(title,abstract)

Comments 39 pages, 4 figures, 33 tables; Accepted for publication at the Eighth AAAI/ACM Conference on AI, Ethics and Society (AIES 2025) (https://www.aies-conference.com/2025/)

A Metric for MLLM Alignment in Large-scale Recommendation

Yubin Zhang, Yanhua Huang, Haiming Xu, Mingliang Qi, Chang Wang, Jiarui Jin, Xiangyuan Ren, Xiaodan Wang, Ruiwen Xu

机构 * Xiaohongshu Inc.（小红书公司） 纠错

专题命中 多模态评测 ：MLLM(title)；multimodal(abstract)

Comments Pre-print.Under Review

A Foundational Multi-Modal Model for Few-Shot Learning

Pengtao Dang, Tingbo Guo, Sha Cao, Chi Zhang

机构 * Oregon Health & Science University（俄勒冈健康与科学大学） 纠错

专题命中 多模态评测 ：multi-modal(title,abstract)

Comments 11 pages, 5 figures

ChineseEEG-2: An EEG Dataset for Multimodal Semantic Alignment and Neural Decoding during Reading and Listening

Sitong Chen, Beiqianyi Li, Cuilin He, Dongyang Li, Mingyang Wu, Xinke Shen, Song Wang, Xuetao Wei, Xindi Wang, Haiyan Wu, Quanying Liu

专题命中 多模态评测 ：multimodal(title,abstract)

A Novel Multimodal Framework for Early Detection of Alzheimers Disease Using Deep Learning

Tatwadarshi P Nagarhalli, Sanket Patil, Vishal Pande, Uday Aswalekar, Prafulla Patil

专题命中 多模态评测 ：multimodal(title,abstract)

Comments Journal paper, 14 pages

Journal ref SSRG International Journal of Electronics and Communication Engineering, Volume 11 Issue 11, November 2024

Integrating Machine Learning with Multimodal Monitoring System Utilizing Acoustic and Vision Sensing to Evaluate Geometric Variations in Laser Directed Energy Deposition

Ke Xu, Chaitanya Krishna Prasad Vallabh, Souran Manoochehri

专题命中 多模态评测 ：multimodal(title,abstract)

R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimization

Jingyi Zhang, Jiaxing Huang, Huanjin Yao, Shunyu Liu, Xikun Zhang, Shijian Lu, Dacheng Tao

机构 * Nanyang Technological University（南洋理工大学） 纠错

专题命中 多模态评测 ：multimodal(title)；分类 cs.CV、cs.CL、cs.AI

Comments ICCV 2025 Camera Ready

Privacy-Preserving Multimodal News Recommendation through Federated Learning

Mehdi Khalaj, Shahrzad Golestani Najafabadi, Julita Vassileva

机构 * Department of Computer Science, University of Saskatchewan（计算机科学系，萨斯喀彻温大学） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)

FedMultiEmo: Real-Time Emotion Recognition via Multimodal Federated Learning

Baran Can Gül, Suraksha Nadig, Stefanos Tziampazis, Nasser Jazdi, Michael Weyrich

机构 * Institute of Industrial Automation and Software Engineering, University of Stuttgart, Germany（工业自动化与软件工程研究所，斯图加特大学） ； Electrical Engineering, University of Stuttgart, Germany（电气工程，斯图加特大学） ； Graduate School of Excellence advanced Manufacturing Engineering, University of Stuttgart, Germany（先进制造工程优秀研究生院，斯图加特大学） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)

Comments Preprint version. Accepted for publication at IEEE ICECCME 2025

Assessing the Value of Visual Input: A Benchmark of Multimodal Large Language Models for Robotic Path Planning

Jacinto Colan, Ana Davila, Yasuhisa Hasegawa

机构 * Department of Micro-Nano Mechanical Science and Engineering, Nagoya University, Nagoya, Aichi, Japan（Nagoya大学微纳米机械科学与工程系） ； Institutes of Innovation for Future Society, Nagoya University, Nagoya, Aichi, Japan（Nagoya大学未来社会创新研究所） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)

Comments Accepted at the 2025 SICE Festival with Annual Conference (SICE FES)

Journal ref 2025 SICE Festival with Annual Conference (SICE FES)

Reframing SAR Target Recognition as Visual Reasoning: A Chain-of-Thought Dataset with Multimodal LLMs

Chaoran Li, Xingguo Xu, Siyuan Mu

专题命中 多模态评测 ：multimodal(title,abstract)

Advancing Precision Oncology Through Modeling of Longitudinal and Multimodal Data

Luoting Zhuang, Stephen H. Park, Steven J. Skates, Ashley E. Prosper, Denise R. Aberle, William Hsu

专题命中 多模态评测 ：multimodal(title,abstract)

Comments To be published in IEEE Reviews in Biomedical Engineering. In early access: https://ieeexplore.ieee.org/document/11068945

SatHealth: A Multimodal Public Health Dataset with Satellite-based Environmental Factors

Yuanlong Wang, Pengqi Wang, Changchang Yin, Ping Zhang

机构 * The Ohio State University（俄亥俄州立大学） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)

Comments 18 pages, 6 figures. To be published in SIGKDD 2025 Datasets and Benchmarks Track

SOLIDGEO: Measuring Multimodal Spatial Math Reasoning in Solid Geometry

Peijie Wang, Chao Yang, Zhong-Zhi Li, Fei Yin, Dekang Ran, Mi Tian, Zhilong Ji, Jinfeng Bai, Cheng-Lin Liu

专题命中 多模态评测 ：multimodal(title,abstract)

Multi-Modal Large Models Based Beam Prediction: An Example Empowered by DeepSeek

Yizhu Zhao, Li Yu, Lianzheng Shi, Jianhua Zhang, Guangyi Liu

专题命中 多模态评测 ：multi-modal(title,abstract)

BYO-Eval: Build Your Own Dataset for Fine-Grained Visual Assessment of Multimodal Language Models

Ludovic Arnould, Salim Khazem, Hugues Ali Mehenni

机构 * R&D Center, Talan（Talan 研发中心） 纠错

专题命中 多模态评测 ：multimodal(title)；分类 cs.CV、cs.CL、cs.AI

Confidence-Aware Self-Distillation for Multimodal Sentiment Analysis with Incomplete Modalities

Yanxi Luo, Shijin Wang, Zhongxing Xu, Yulong Li, Feilong Tang, Jionglong Su

机构 * Xi’an Jiaotong-Liverpool University（西安交通大学利物浦大学） ； Renmin University of China（中国人民大学） ； Monash University（墨尔本大学） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)

Improving population size adapting CMA-ES algorithm on step-size blow-up in weakly-structured multimodal functions

Chandula Fernando, Kushani De Silva

专题命中 多模态评测 ：multimodal(title,abstract)

Regionalized Metric Framework: A Novel Approach for Evaluating Multimodal Multi-Objective Optimization Algorithms

Jintai Chen, Fangqing Liu, Xueming Yan, Han Huang

专题命中 多模态评测 ：multimodal(title,abstract)

Comments conference

Learning Optimal Multimodal Information Bottleneck Representations

Qilong Wu, Yiyang Shao, Jun Wang, Xiaobo Sun

专题命中 多模态评测 ：multimodal(title,abstract)

Comments ICML 2025

Understanding the Capabilities of Molecular Graph Neural Networks in Materials Science Through Multimodal Learning and Physical Context Encoding

Can Polat, Hasan Kurban, Erchin Serpedin, Mustafa Kurban

机构 * Dept. of Electrical and Computer Engineering, Texas A&M University, College Station, TX 77843, USA（电气与计算机工程系，德克萨斯A&M大学） ； College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar（科学与工程学院，哈马德·本·卡西姆大学） ； Dept. of Prosthetics and Orthotics, Ankara University, Ankara, Turkey（假肢与矫形学系，安卡拉大学） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)

Comments Accepted Spotlight Paper at CVPR 2025 for MM4Mat

Automated Ensemble Multimodal Machine Learning for Healthcare

Fergus Imrie, Stefan Denner, Lucas S. Brunschwig, Klaus Maier-Hein, Mihaela van der Schaar

机构 * Department of Statistics, University of Oxford（统计系，牛津大学） ； Division of Medical Image Computing, German Cancer Research Center (DKFZ)（医学影像计算部，德国癌症研究中心（DKFZ）） ； Medical Faculty Heidelberg, Heidelberg University（海德堡大学医学系） ； École Polytechnique Fédérale de Lausanne（洛桑联邦理工学院） ； Pattern Analysis and Learning Group, Department of Radiation Oncology, Heidelberg University Hospital（模式分析与学习小组，海德堡大学医院放射肿瘤学系） ； National Center for Tumor Diseases (NCT) Heidelberg（海德堡国家肿瘤疾病中心（NCT）） ； Department of Applied Mathematics and Theoretical Physics, University of Cambridge（应用数学与理论物理系，剑桥大学） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)

Q-Heart: ECG Question Answering via Knowledge-Informed Multimodal LLMs

Hung Manh Pham, Jialu Tang, Aaqib Saeed, Dong Ma

专题命中 多模态评测 ：multimodal(title,abstract)

SynSHRP2: A Synthetic Multimodal Benchmark for Driving Safety-critical Events Derived from Real-world Driving Data

Liang Shi, Boyu Jiang, Zhenyuan Yuan, Miguel A. Perez, Feng Guo

机构 * Virginia Tech Transportation Institute（弗吉尼亚理工运输研究所） ； Department of Statistics, Virginia Tech（弗吉尼亚理工统计系） ； Department of Biomedical Engineering and Mechanics, Virginia Tech（弗吉尼亚理工生物医学工程与力学系） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)

Comments Accepted as a poster in CVPR 2025

OmniGIRL: A Multilingual and Multimodal Benchmark for GitHub Issue Resolution

Lianghong Guo, Wei Tao, Runhan Jiang, Yanlin Wang, Jiachi Chen, Xilin Liu, Yuchi Ma, Mingzhi Mao, Hongyu Zhang, Zibin Zheng

专题命中 多模态评测 ：multimodal(title,abstract)

Comments To appear at ISSTA'25

OV-MER: Towards Open-Vocabulary Multimodal Emotion Recognition

Zheng Lian, Haiyang Sun, Licai Sun, Haoyu Chen, Lan Chen, Hao Gu, Zhuofan Wen, Shun Chen, Siyuan Zhang, Hailiang Yao, Bin Liu, Rui Liu, Shan Liang, Ya Li, Jiangyan Yi, Jianhua Tao

专题命中 多模态评测 ：multimodal(title,abstract)

What Makes Teamwork Work? A Multimodal Case Study on Emotions and Diagnostic Expertise in an Intelligent Tutoring System

Xiaoshan Huang, Haolun Wu, Xue Liu, Susanne P. Lajoie

专题命中 多模态评测 ：multimodal(title,abstract)

Comments 8 pages, 1 figure

Advancing Face-to-Face Emotion Communication: A Multimodal Dataset (AFFEC)

Meisam J. Sekiavandi, Laurits Dixen, Jostein Fimland, Sree Keerthi Desu, Antonia-Bianca Zserai, Ye Sul Lee, Maria Barrett, Paolo Burelli

专题命中 多模态评测 ：multimodal(title,abstract)