多模态大模型

A Large-scale Multimodal Study for Predicting Mortality Risk Using Minimal and Low Parameter Models and Separable Risk Assessment

Alvaro E. Ulloa Cerna, Marios Pattichis, David P. vanMaanen, Linyuan Jing, Aalpen A. Patel, Joshua V. Stough, Christopher M. Haggerty, Brandon K. Fornwalt

机构 * Department of Translational Data Science and Informatics, Geisinger（转化数据科学与信息学部门，Geisinger） ； Department of Electrical and Computer Engineering, University of New Mexico（电气与计算机工程系，新墨西哥大学） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)

Journal ref IEEE Journal of Biomedical and Health Informatics, 2025

Virology Capabilities Test (VCT): A Multimodal Virology Q&A Benchmark

Jasper Götting, Pedro Medeiros, Jon G Sanders, Nathaniel Li, Long Phan, Karam Elabd, Lennart Justen, Dan Hendrycks, Seth Donoughe

机构 * SecureBio ； Federal University of ABC（亚巴西联邦大学） ； Center for Natural and Human Sciences（自然与人类科学中心） ； Media Lab, Massachusetts Institute of Technology（麻省理工学院媒体实验室） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)

Comments 31 pages

REASSEMBLE: A Multimodal Dataset for Contact-rich Robotic Assembly and Disassembly

Daniel Sliwowski, Shail Jadav, Sergej Stanovcic, Jedrzej Orbik, Johannes Heidersberger, Dongheui Lee

机构 * Autonomous Systems Lab, Institute of Computer Technology, TU Wien（自主系统实验室，计算机技术学院，维也纳技术大学） ； Institute of Robotics and Mechatronics (DLR), German Aerospace Center（机器人与机电系统研究所（DLR），德国航空航天中心） 纠错

专题命中 多模态评测 ：multimodal(title)；multi-modal(abstract)

Comments 17 pages, 15 figures, 1 table

SynthSoM: A synthetic intelligent multi-modal sensing-communication dataset for Synesthesia of Machines (SoM)

Xiang Cheng, Ziwei Huang, Yong Yu, Lu Bai, Mingran Sun, Zengrui Han, Ruide Zhang, Sijiang Li

专题命中 多模态评测 ：multi-modal(title,abstract)

M2P2: A Multi-Modal Passive Perception Dataset for Off-Road Mobility in Extreme Low-Light Conditions

Aniket Datar, Anuj Pokhrel, Mohammad Nazeri, Madhan B. Rao, Chenhui Pan, Yufan Zhang, Andre Harrison, Maggie Wigness, Philip R. Osteen, Jinwei Ye, Xuesu Xiao

机构 * George Mason University（乔治·马歇尔大学） 纠错

专题命中 多模态评测 ：multi-modal(title,abstract)

The 2nd MERCADO Workshop at IEEE VIS 2025: Multimodal Experiences for Remote Communication Around Data Online

Wolfgang Büschel, Gabriela Molina León, Arnaud Prouzeau, Mahmood Jasim, Christophe Hurter, Maxime Cordeil, Matthew Brehmer

专题命中 多模态评测 ：multimodal(title,abstract)

Comments Workshop accepted for IEEE VIS 2025

CHASE: A Causal Hypergraph based Framework for Root Cause Analysis in Multimodal Microservice Systems

Ziming Zhao, Zhenwei Wang, Tiehua Zhang, Zhishu Shen, Hai Dong, Zhen Lei, Xingjun Ma, Gaowei Xu, Zhijun Ding, Yun Yang

机构 * NEC Laboratories America（NEC美国实验室） ； School of Computer Science and Technology, Tongji University（同济大学计算机科学与技术学院） ； School of Computer Science and Artificial Intelligence, Wuhan University of Technology（武汉理工大学计算机科学与人工智能学院） ； School of Computing Technologies, RMIT University（皇家墨尔本理工学院计算技术学院） ； School of Computer Science, Fudan University（复旦大学计算机科学学院） ； School of Science, Computing and Engineering Technologies, Swinburne University of Technology（斯威本技术大学科学、计算与工程技术学院） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)

MRAMG-Bench: A Comprehensive Benchmark for Advancing Multimodal Retrieval-Augmented Multimodal Generation

Qinhan Yu, Zhiyou Xiao, Binghui Li, Zhengren Wang, Chong Chen, Wentao Zhang

机构 * Peking University（北京大学） ； Huawei Cloud BU（华为云业务单元） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)

Comments Published as a conference paper at SIGIR 2025; 11 pages

Translating Multimodal AI into Real-World Inspection: TEMAI Evaluation Framework and Pathways for Implementation

Zehan Li, Jinzhi Deng, Haibing Ma, Chi Zhang, Dan Xiao

机构 * Moximize.ai China Creative Studies Institute（Moximize.ai中国创意研究学院） ； Moximize.ai Shanghai Zhongqiao Vocational And Technical University（Moximize.ai上海仲桥职业技术大学） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)

Correlation Ratio for Unsupervised Learning of Multi-modal Deformable Registration

Xiaojian Chen, Yihao Liu, Shuwen Wei, Aaron Carass, Yong Du, Junyu Chen

专题命中 多模态评测 ：multi-modal(title,abstract)

Comments Accepted by SPIE MI'25 ((c) SPIE). Code available at https://github.com/junyuchen245/Correlation_Ratio

Generalized probabilistic canonical correlation analysis for multi-modal data integration with full or partial observations

Tianjian Yang, Wei Vivian Li

机构 * University of California, Riverside（加州大学河滨分校） 纠错

专题命中 多模态评测 ：multi-modal(title,abstract)

InSPE: Rapid Evaluation of Heterogeneous Multi-Modal Infrastructure Sensor Placement

Zhaoliang Zheng, Yun Zhang, Zongling Meng, Johnson Liu, Xin Xia, Jiaqi Ma

机构 * University of California, Los Angeles（加利福尼亚大学洛杉矶分校） 纠错

专题命中 多模态评测 ：multi-modal(title,abstract)

More Modality, More AI: Exploring Design Opportunities of AI-Based Multi-modal Remote Monitoring Technologies for Early Detection of Mental Health Sequelae in Youth Concussion Patients

Bingsheng Yao, Menglin Zhao, Yuling Sun, Weidan Cao, Changchang Yin, Stephen Intille, Xuhai Xu, Ping Zhang, Jingzhen Yang, Dakuo Wang

专题命中 多模态评测 ：multi-modal(title,abstract)

Toward Interpretable Sleep Stage Classification Using Cross-Modal Transformers

Jathurshan Pradeepkumar, Mithunjha Anandakumar, Vinith Kugathasan, Dhinesh Suntharalingham, Simon L. Kappel, Anjula C. De Silva, Chamira U. S. Edussooriya

机构 * University of Moratuwa（莫拉图瓦大学） ； Harvard University（哈佛大学） ； Florida International University（佛罗里达国际大学） ； Aarhus University（奥胡斯大学） 纠错

专题命中 多模态评测 ：cross-modal(title,abstract)

Comments 11 pages, 7 figures, 6 tables

Detecting Multimodal Situations with Insufficient Context and Abstaining from Baseless Predictions

Junzhang Liu, Zhecan Wang, Hammad Ayyubi, Haoxuan You, Chris Thomas, Rui Sun, Shih-Fu Chang, Kai-Wei Chang

机构 * Columbia University（哥伦比亚大学） ； University of California, Los Angeles（加利福尼亚大学洛杉矶分校） 纠错

专题命中 多模态评测 ：multimodal(title)；分类 cs.CV、cs.AI、cs.MM

Multimodal Machine Learning for Real Estate Appraisal: A Comprehensive Survey

Chenya Huang, Zhidong Li, Fang Chen, Bin Liang

机构 * University of Technology Sydney（悉尼科技大学） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)

Comments 13 pages, 5 figures

Dermacen Analytica: A Novel Methodology Integrating Multi-Modal Large Language Models with Machine Learning in tele-dermatology

Dimitrios P. Panagoulias, Evridiki Tsoureli-Nikita, Maria Virvou, George A. Tsihrintzis

机构 * University of Piraeus（比雷埃夫斯大学） ； Athens University Medical School（雅典医学院） 纠错

专题命中 多模态评测 ：multi-modal(title)；分类 cs.CV、cs.CL、cs.AI

Ground Penetrating Radar-Assisted Multimodal Robot Odometry Using Subsurface Feature Matrix

Haifeng Li, Jiajun Guo, Xuanxin Fan, Dezhen Song

机构 * Civil Aviation University of China（中国民航大学） ； Mohamed Bin Zayed University of Artificial Intelligence (MBZUAI)（穆罕默德·本·扎耶德人工智能大学） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)

Leveraging Multi-modal Representations to Predict Protein Melting Temperatures

Daiheng Zhang, Yan Zeng, Xinyu Hong, Jinbo Xu

专题命中 多模态评测 ：multi-modal(title,abstract)

Comments Accepted to AAAI 2025 FM4BIO workshop

EVA-MED: An Enhanced Valence-Arousal Multimodal Emotion Dataset for Emotion Recognition

Xin Huang, Shiyao Zhu, Ziyu Wang, Yaping He, Hao Jin, Zhengkui Liu

专题命中 多模态评测 ：multimodal(title,abstract)

Comments 10 pages, 6figures, 1table

Multimodal Stock Price Prediction: A Case Study of the Russian Securities Market

Kasymkhan Khubiev, Mikhail Semenov

机构 * Sirius University of Science and Technology（天狼星科技大学） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)

Comments NSCF-2024, PROGRAM SYSTEMS: THEORY AND APPLICATIONS

Journal ref http://psta.psiras.ru:8081/ru/2025/1_83-130

MERCI: Multimodal Emotional and peRsonal Conversational Interactions Dataset

Mohammed Althubyani, Zhijin Meng, Shengyuan Xie, Cha Seung, Imran Razzak, Eduardo B. Sandoval, Baki Kocaballi, Francisco Cruz

机构 * University of Technology, Sydney（悉尼科技大学） ； University of New South Wales（新南威尔士大学） ； Mohamed bin Zayed University of Artificial Intelligence（穆罕默德·本·扎耶德人工智能大学） ； Universidad Central de Chile（智利中央大学） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)

Comments 9 pages, 5 Figures, Rejected from International Conference of Human Robot Interaction 2025, Melbourne, Australia

Systematic Categorization, Construction and Evaluation of New Attacks against Multi-modal Mobile GUI Agents

Yulong Yang, Xinshan Yang, Shuaidong Li, Chenhao Lin, Zhengyu Zhao, Chao Shen, Tianwei Zhang

专题命中 多模态评测 ：multi-modal(title,abstract)

Comments Preprint. Work in progress

Multi-Modal Variable-Rate CSI Reconstruction for FDD Massive MIMO Systems

Yunseo Nam, Jiwook Choi

专题命中 多模态评测 ：multi-modal(title,abstract)

GND: Global Navigation Dataset with Multi-Modal Perception and Multi-Category Traversability in Outdoor Campus Environments

Jing Liang, Dibyendu Das, Daeun Song, Md Nahid Hasan Shuvo, Mohammad Durrani, Karthik Taranath, Ivan Penskiy, Dinesh Manocha, Xuesu Xiao

机构 * University of Maryland（马里兰大学） ； George Mason University（乔治梅森大学） 纠错

专题命中 多模态评测 ：multi-modal(title,abstract)

MMDVS-LF: Multi-Modal Dynamic Vision Sensor and Eye-Tracking Dataset for Line Following

Felix Resch, Mónika Farsang, Radu Grosu

机构 * Technische Universität Wien (TU Wien)（维也纳技术大学） 纠错

专题命中 多模态评测 ：multi-modal(title,abstract)

TabGLM: Tabular Graph Language Model for Learning Transferable Representations Through Multi-Modal Consistency Minimization

Anay Majee, Maria Xenochristou, Wei-Peng Chen

机构 * Fujitsu（富士通） 纠错

专题命中 多模态评测 ：multi-modal(title,abstract)

Comments Accepted to AAAI 2025

CPVis: Evidence-based Multimodal Learning Analytics for Evaluation in Collaborative Programming

Gefei Zhang, Shenming Ji, Yicao Li, Jingwei Tang, Jihong Ding, Meng Xia, Guodao Sun, Ronghua Liang

专题命中 多模态评测 ：multimodal(title,abstract)

Towards accurate and reliable ICU outcome prediction: a multimodal learning framework based on belief function theory using structured EHRs and free-text notes

Yucheng Ruan, Daniel J. Tan, See Kiong Ng, Ling Huang, Mengling Feng

专题命中 多模态评测 ：multimodal(title,abstract)

A Landscape-Aware Differential Evolution for Multimodal Optimization Problems

Guo-Yun Lin, Zong-Gan Chen, Chuanbin Liu, Yuncheng Jiang, Sam Kwong, Jun Zhang, Zhi-Hui Zhan

专题命中 多模态评测 ：multimodal(title,abstract)