多模态大模型

GrOMP: Grasped Object Manifold Projection for Multimodal Imitation Learning of Manipulation

GrOMP：抓取物体流形投影用于多模态模仿学习的操控

William van den Bogert, Gregory Linkowski, Nima Fazeli

机构 * Mechanical Engineering Department at the University of Michigan（密歇根大学机械工程系） ； Robotics & Automation Research Department at the Ford Motor Company（福特汽车公司机器人与自动化研究部） ； Robotics Department at the University of Michigan（密歇根大学机器人系） 纠错

专题命中 多模态评测 ：multimodal(title)

AI总结 GrOMP通过抓取物体流形投影技术，提升多模态模仿学习中操控任务的精度和鲁棒性，基于累积误差界理论，利用触觉反馈在多个装配任务中验证其有效性。

Comments 8 pages, 8 figures, 2 tables

Preoperative Prognosis Assessment of Lumbar Spinal Surgery for Low Back Pain and Sciatica Patients based on Multimodalities and Multimodal Learning

基于多模态与多模态学习的腰椎手术术前预后评估

Li-Chin Chen, Jung-Nien Lai, Hung-En Lin, Hsien-Te Chen, Kuo-Hsuan Hung, Yu Tsao

专题命中 多模态评测 ：multimodal(title)

AI总结 本研究通过结合东方医学和机器学习，开发了一种基于多模态数据的术前预后评估工具，准确率高达0.81，为腰椎手术患者提供术前预后预测。

Mamba-based Deep Learning Approach for Sleep Staging on a Wireless Multimodal Wearable System without Electroencephalography

基于Mamba的深度学习方法用于无线多模态可穿戴系统中的睡眠分期（无脑电图）

Andrew H. Zhang, Alex He-Mo, Richard Fei Yin, Chunlin Li, Yuzhi Tang, Dharmendra Gurve, Veronique van der Horst, Aron S. Buchman, Nasim Montazeri Ghahjaverestan, Maged Goubran, Bo Wang, Andrew S. P. Lim

专题命中 多模态评测 ：multimodal(title)

AI总结 本文提出基于Mamba的深度学习方法，用于无脑电图的无线多模态可穿戴系统中实现睡眠分期，通过整合多种生物信号提升睡眠阶段识别的准确性。

Comments 40 pages, 24 figures. Authors Andrew H. Zhang, Alex He-Mo, and Richard Fei Yin contributed equally

RoadSens-4M: A Multimodal Smartphone & Camera Dataset for Holistic Road-way Analysis

Amith Khandakar, David Michelson, Shaikh Golam Rabbani, Fariya Bintay Shafi, Md. Faysal Ahamed, Khondokar Radwanur Rahman, Md Abidur Rahman, Md. Fahmidun Nabi, Mohamed Arselene Ayari, Khaled Khan, Ponnuthurai Nagaratnam Suganthan

专题命中 多模态评测 ：multimodal(title)

A Multimodal Lightweight Approach to Fault Diagnosis of Induction Motors in High-Dimensional Dataset

Usman Ali

机构 * GIFT University（GIFT大学） 纠错

专题命中 多模态评测 ：multimodal(title)

A Multimodal Approach to SME Credit Scoring Integrating Transaction and Ownership Networks

Sahab Zandi, Kamesh Korangi, Juan C. Moreno-Paredes, María Óskarsdóttir, Christophe Mues, Cristián Bravo

机构 * Department of Statistical and Actuarial Sciences, Western University（西敏大学统计与精算科学系） ； University of Southampton Business School（南安普顿大学商学院） ； Centre for Operational Research, Management Sciences and Information Systems（运营研究、管理科学与信息系统中心） ； School of Mathematical Sciences, University of Southampton（南安普顿大学数学科学学院） ； Department of Computer Science, Reykjavík University（雷克雅未克大学计算机科学系） 纠错

专题命中 多模态评测 ：multimodal(title)

SONAR: Semantic-Object Navigation with Aggregated Reasoning through a Cross-Modal Inference Paradigm

Yao Wang, Zhirui Sun, Wenzheng Chi, Baozhi Jia, Wenjun Xu, Jiankun Wang

机构 * Shenzhen Key Laboratory of Robotics Perception and Intelligence（机器人感知与智能深圳重点实验室） ； Department of Electronic and Electrical Engineering（电子与电气工程系） ； Southern University of Science and Technology（南方科技大学） ； Research Institute of Multiple Agents and Embodied Intelligence（多智能体与具身智能研究院） ； Peng Cheng Laboratory（鹏城实验室） ； Robotics and Microsystems Center（机器人与微系统中心） ； School of Mechanical and Electric Engineering（机械与电子工程学院） ； Soochow University（苏州大学） ； Xiamen Key Laboratory of Visual Perception Technology and Application（视觉感知技术与应用厦门重点实验室） ； Reconova Information Technology Co., Ltd.（Reconova信息技术有限公司） 纠错

专题命中 多模态评测 ：cross-modal(title)

Aerial-ground Cross-modal Localization: Dataset, Ground-truth, and Benchmark

Yandi Yang, Jianping Li, Youqi Liao, Yuhao Li, Yizhe Zhang, Zhen Dong, Bisheng Yang, Naser El-Sheimy

机构 * Department of Geomatics Engineering（测绘工程系） ； School of Electrical and Electronic Engineering（电子电气工程学院） ； State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing（测绘遥感信息工程国家重点实验室） ； School of Mechanical Engineering（机械工程学院） 纠错

专题命中 多模态评测 ：cross-modal(title)

NAICS-Aware Graph Neural Networks for Large-Scale POI Co-visitation Prediction: A Multi-Modal Dataset and Methodology

Yazeed Alrubyli, Omar Alomeir, Abrar Wafa, Diána Hidvégi, Hend Alrasheed, Mohsen Bahrami

机构 * Prince Sultan University（普森大学） ； Massachusetts Institute of Technology（麻省理工学院） 纠错

专题命中 多模态评测 ：multi-modal(title)

SenseSeek Dataset: Multimodal Sensing to Study Information Seeking Behaviors

Kaixin Ji, Danula Hettiachchi, Falk Scholer, Flora D. Salim, Damiano Spina

专题命中 多模态评测 ：multimodal(title)

Comments Accepted in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), September 2025

MedLeak: Multimodal Medical Data Leakage in Secure Federated Learning with Crafted Models

Shanghao Shi, Md Shahedul Haque, Abhijeet Parida, Chaoyu Zhang, Marius George Linguraru, Y. Thomas Hou, Syed Muhammad Anwar, Wenjing Lou

机构 * Children's National Hospital（儿童医院） ； Children's National Hospital, George Washington University（儿童医院与乔治华盛顿大学） 纠错

专题命中 多模态评测 ：multimodal(title)

Comments Accepted by the IEEE/ACM conference on Connected Health: Applications, Systems and Engineering Technologies 2025 (CHASE'25)

Advancing Digital Precision Medicine for Chronic Fatigue Syndrome through Longitudinal Large-Scale Multi-Modal Biological Omics Modeling with Machine Learning and Artificial Intelligence

Ruoyun Xiong

专题命中 多模态评测 ：multi-modal(title)

Domain Specific Benchmarks for Evaluating Multimodal Large Language Models

Khizar Anjum, Muhammad Arbab Arshad, Kadhim Hayawi, Efstathios Polyzos, Asadullah Tariq, Mohamed Adel Serhani, Laiba Batool, Brady Lund, Nishith Reddy Mannuru, Ravi Varma Kumar Bevara, Taslim Mahbub, Muhammad Zeeshan Akram, Sakib Shahriar

机构 * Rutgers University（罗切斯特大学） ； Iowa State University（爱荷华州立大学） ； Zayed University（扎耶德大学） ； United Arab Emirates University（阿拉伯联合酋长国大学） ； University of Sharjah（沙迦大学） ； University of North Texas（北德克萨斯大学） ； George Washington University（乔治·华盛顿大学） ； University of Louisville（路易斯维尔大学） ； University of Guelph（圭尔夫大学） 纠错

专题命中 多模态评测 ：multimodal(title)

Yambda-5B -- A Large-Scale Multi-modal Dataset for Ranking And Retrieval

A. Ploshkin, V. Tytskiy, A. Pismenny, V. Baikalov, E. Taychinov, A. Permiakov, D. Burlakov, E. Krofto, N. Savushkin

机构 * Yandex 纠错

专题命中 多模态评测 ：multi-modal(title)

Multi-modal Atmospheric Sensing to Augment Wearable IMU-Based Hand Washing Detection

Robin Burchard, Kristof Van Laerhoven

机构 * University of Siegen（锡根大学） 纠错

专题命中 多模态评测 ：multi-modal(title)

Comments iWOAR2024

A Hierarchical Graph-Based Terrain-Aware Autonomous Navigation Approach for Complementary Multimodal Ground-Aerial Exploration

Akash Patel, Mario A. V. Saucedo, Nikolaos Stathoulopoulos, Viswa Narayanan Sankaranarayanan, Ilias Tevetzidis, Christoforos Kanellakis, George Nikolakopoulos

机构 * Robotics & AI Team, Department of Computer, Electrical and Space Engineering, Luleå University of Technology（机器人与人工智能团队，计算机、电气与空间工程系，卢勒奥技术大学） 纠错

专题命中 多模态评测 ：multimodal(title)

ForgeEDA: A Comprehensive Multimodal Dataset for Advancing EDA

Zhengyuan Shi, Zeju Li, Chengyu Ma, Yunhao Zhou, Ziyang Zheng, Jiawei Liu, Hongyang Pan, Lingfeng Zhou, Kezhi Li, Jiaying Zhu, Lingwei Yan, Zhiqiang He, Chenhao Xue, Wentao Jiang, Fan Yang, Guangyu Sun, Xiaoyan Yang, Gang Chen, Chuan Shi, Zhufei Chu, Jun Yang, Qiang Xu

专题命中 多模态评测 ：multimodal(title)

High and Low Resolution Tradeoffs in Roadside Multimodal Sensing

Shaozu Ding, Yihong Tang, Marco De Vincenzi, Dajiang Suo

机构 * The Polytechnic School Arizona State University（亚利桑那州立大学理工学院） ； Civil Engineering McGill University（麦吉尔大学土木工程系） ； Maricopa County Department of Transportation（马里科帕县交通部门） 纠错

专题命中 多模态评测 ：multimodal(title)

Comments 8 pages, 7 figures

Obstructive Sleep Apnea Characterization: A Multimodal Cross-Recurrence-Based Approach for Investigating Atrial Fibrillation

Mantas Rinkevičius, Jesús Lázaro, Eduardo Gil, Pablo Laguna, Peter H. Charlton, Raquel Bailón, Vaidotas Marozas

专题命中 多模态评测 ：multimodal(title)

Comments Already published in the IEEE Journal of Biomedical and Health Informatics (JBHI) under a Creative Commons License CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Accepted 11 July 2024. Date of current version 4 October 2024 (13 pages, 11 figures, 2 tables). Volume: 28, Issue: 10, Pages: 6155 - 6167. Link to the published paper: https://ieeexplore.ieee.org/document/10601325

Untangling the Furball: A Practice Mapping Approach to the Analysis of Multimodal Interactions in Social Networks

Axel Bruns, Kateryna Kasianenko, Vishnu Padinjaredath Suresh, Ehsan Dehghan, Laura Vodden

专题命中 多模态评测 ：multimodal(title)

M-TabNet: A Multi-Encoder Transformer Model for Predicting Neonatal Birth Weight from Multimodal Data

Muhammad Mursil, Hatem A. Rashwan, Luis Santos-Calderon, Pere Cavalle-Busquets, Michelle M. Murphy, Domenec Puig

机构 * Department of Computer Engineering and Mathematics, Universitat Rovira i Virgili (URV)（计算机工程与数学系，罗维拉-维加利大学） ； Unit of Preventive Medicine & Biostatistics, Faculty of Medicine and Health Sciences, URV, CIBERObn ISCIII（预防医学与生物统计学单位，医学与健康科学学院，URV，CIBERObn ISCIII） 纠错

专题命中 多模态评测 ：multimodal(title)

Improving the evaluation of samplers on multi-modal targets

Louis Grenioux, Maxence Noble, Marylou Gabrié

专题命中 多模态评测 ：multi-modal(title)

Comments Accepted at ICLR 2025 workshop "Frontiers in Probabilistic Inference: Learning meets Sampling"

A multi-modal infant-based metric for choosing the best supernova

The Gigantic Supernova Pile, Collaboration

专题命中 多模态评测 ：multi-modal(title)

Comments 6 pages, 6 figures

Understanding State Social Anxiety in Virtual Social Interactions using Multimodal Wearable Sensing Indicators

Maria A. Larrazabal, Zhiyuan Wang, Mark Rucker, Emma R. Toner, Mehdi Boukhechba, Bethany A. Teachman, Laura E. Barnes

专题命中 多模态评测 ：multimodal(title)

Comments 28 pages, 13 figures

Predicting Cardiopulmonary Exercise Testing Outcomes in Congenital Heart Disease Through Multi-modal Data Integration and Geometric Learning

Muhammet Alkan, Gruschen Veldtman, Fani Deligianni

机构 * School of Computing Science at University of Glasgow（格拉斯哥大学计算科学学院） ； Golden Jubilee National Hospital（金禧国家医院） ； Helen DeVos Children’s Hospital, Corewell Health（科尔韦尔健康海伦·德沃斯儿童医院） 纠错

专题命中 多模态评测 ：multi-modal(title)

Comments preprint for Scientific Reports

Enhancing Web Service Anomaly Detection via Fine-grained Multi-modal Association and Frequency Domain Analysis

Xixuan Yang, Xin Huang, Chiming Duan, Tong Jia, Shandong Dong, Ying Li, Gang Huang

机构 * Peking University（北京大学） ； Nanyang Normal University（南阳师范学院） ； Alibaba group（阿里巴巴集团） 纠错

专题命中 多模态评测 ：multi-modal(title)

Comments Accepted by WWW' 25

Constrained Multi-Modal Density Control of Linear Systems via Covariance Steering Theory

Isin M Balci, Efstathios Bakolas

专题命中 多模态评测 ：multi-modal(title)

Constraint-Based Model in Multimodal Learning to Improve Ventricular Arrhythmia Prediction

Evariste Njomgue Fotso, Buntheng Ly, Hubert Cochet, Maxime Sermesant

专题命中 多模态评测 ：multimodal(title)

Journal ref Statistical Atlases and Computational Modeling of the Heart (STACOM), Oct 2024, Marrackech, Maroc, Morocco

Statistical Modeling of Univariate Multimodal Data

Paraskevi Chasani, Aristidis Likas

机构 * University of Ioannina（约阿尼纳大学） 纠错

专题命中 多模态评测 ：multimodal(title)

Comments 30 pages, 9 figures

A quantum inspired predictor of Parkinsons disease built on a diverse, multimodal dataset

Diya Vatsavai, Anya Iyer, Ashwin A. Nair

专题命中 多模态评测 ：multimodal(title)

Comments 20 pages, 3 figures, 1 table