arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 6942 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 多模态训练与对齐 6942 篇

2211.10506 2022-11-22 cs.LG 50%

A Transformer Framework for Data Fusion and Multi-Task Learning in Smart Cities

Alexander C. DeRieux, Walid Saad, Wangda Zuo, Rachmawan Budiarto, Mochamad Donny Koerniawan, Dwi Novitasari

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments 14 pages, 10 figures, 3 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2105.07597 2022-11-22 cs.IR cs.DB 50%

Variational Bandwidth Auto-encoder for Hybrid Recommender Systems

Yaochen Zhu, Zhenzhong Chen

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2207.11717 2022-11-21 cs.LG 50%

A Priority Map for Vision-and-Language Navigation with Trajectory Plans and Feature-Location Cues

Jason Armitage, Leonardo Impett, Rico Sennrich

专题命中 多模态训练与对齐 :cross-modal(abstract)

Comments Accepted to WACV 2023

详情

展开后加载摘要…

URL PDF HTML 收藏
2201.04292 2022-10-12 cs.LG 50%

Predicting Terrorist Attacks in the United States using Localized News Data

Steven J. Krieg, Christian W. Smith, Rusha Chatterjee, Nitesh V. Chawla

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2203.05235 2022-10-12 eess.SP 50%

Data-Folding and Hyperspace Coding for Multi-Dimensonal Time-Series Data Imaging

Chao Lian, Yuliang Zhao, Zhikun Zhan, Wen J. Li

专题命中 多模态训练与对齐 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2209.12018 2022-10-04 cs.HC 50%

Facilitating Self-monitored Physical Rehabilitation with Virtual Reality and Haptic feedback

Yu Jiang, Zhipeng Li, Ziyue Dang, Yuntao Wang, Yukang Yan, Y Zhang, Xinguang Wang, Yansong Li, Mouwang Zhou, Hua Tian, Yuanchun Shi

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2205.04806 2022-10-04 stat.CO math.OC stat.ML 50%

Fixed-point iterations for several dissimilarity measure barycenters in the Gaussian case

Alessandro D'Ortenzio, Costanzo Manes, Umut Orguner

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2209.13529 2022-09-28 q-bio.NC cs.LG 50%

Deep Cross-Modality and Resolution Graph Integration for Universal Brain Connectivity Mapping and Augmentation

Ece Cinar, Sinem Elif Haseki, Alaa Bessadok, Islem Rekik

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2209.06272 2022-09-15 cs.DC 50%

Towards Efficient Architecture and Algorithms for Sensor Fusion

Zhendong Wang, Xiaoming Zeng, Shuaiwen Leon Song, Yang Hu

专题命中 多模态训练与对齐 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2109.10871 2022-08-10 cs.RO stat.AP 50%

Nested Sampling for Non-Gaussian Inference in SLAM Factor Graphs

Qiangqiang Huang, Alan Papalia, John J. Leonard

专题命中 多模态训练与对齐 :multi-modal(abstract)

Journal ref IEEE Robotics and Automation Letters, vol. 7, no. 4, pp. 9232-9239, Oct. 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2208.03075 2022-08-08 cs.LG 50%

PGX: A Multi-level GNN Explanation Framework Based on Separate Knowledge Distillation Processes

Tien-Cuong Bui, Wen-syan Li, Sang-Kyun Cha

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments 11 pages, 8 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
1912.06780 2022-07-29 math.ST eess.SP stat.TH 50%

Formal Definitions of Conservative Probability Distribution Functions (PDFs)

Shane Lubold, Clark N. Taylor

专题命中 多模态训练与对齐 :multi-modal(abstract)

Journal ref Information Fusion, 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2203.12616 2022-06-10 cs.LG 50%

Unsupervised Pre-Training on Patient Population Graphs for Patient-Level Predictions

Chantal Pellegrini, Anees Kazi, Nassir Navab

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments 10 pages, 1 figure, 3 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2205.04202 2022-05-10 cs.RO 50%

Multimodel Sensor Fusion for Learning Rich Models for Interacting Soft Robots

Thomas George Thuruthel, Fumiya Iida

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments Under review in IROS 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2204.07777 2022-04-19 eess.SP cs.CR cs.LG 50%

Exploiting Multiple EEG Data Domains with Adversarial Learning

David Bethge, Philipp Hallgarten, Ozan Özdenizci, Ralf Mikut, Albrecht Schmidt, Tobias Grosse-Puppendahl

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments 5 pages, 3 figures, IEEE EMBC 2022 full paper

详情

展开后加载摘要…

URL PDF HTML 收藏
2203.01389 2022-03-04 cs.RO cs.SY eess.SY 50%

Graph-based Multi-sensor Fusion for Consistent Localization of Autonomous Construction Robots

Julian Nubert, Shehryar Khattak, Marco Hutter

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments 7 pages, 6 figures, 2 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2202.13500 2022-03-01 cs.SI cs.HC 50%

The Golden Circle: Creating Socio-technical Alignment in Content Moderation

Abhishek Gupta, Iga Kozlowska, Nga Than

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments 6 pages, 1 figure, 1 table

详情

展开后加载摘要…

URL PDF HTML 收藏
2005.06935 2022-03-01 cs.LG stat.ML 50%

Simultaneous imputation and disease classification in incomplete medical datasets using Multigraph Geometric Matrix Completion (MGMC)

Gerome Vivar, Anees Kazi, Hendrik Burwinkel, Andreas Zwergal, Nassir Navab, Seyed-Ahmad Ahmadi

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2111.02887 2022-02-25 cs.NI cs.LG 50%

Self-Supervised Radio-Visual Representation Learning for 6G Sensing

Mohammed Alloulah, Akash Deep Singh, Maximilian Arnold

专题命中 多模态训练与对齐 :cross-modal(abstract)

Comments To appear in IEEE ICC '22

详情

展开后加载摘要…

URL PDF HTML 收藏
2107.09510 2022-02-23 eess.SP cs.LG 50%

Modality Fusion Network and Personalized Attention in Momentary Stress Detection in the Wild

Han Yu, Thomas Vaessen, Inez Myin-Germeys, Akane Sano

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments 2021 9th International Conference on Affective Computing and Intelligent Interaction (ACII)

详情

展开后加载摘要…

URL PDF HTML 收藏
2106.03287 2021-12-24 cs.RO cs.LG 50%

Stein ICP for Uncertainty Estimation in Point Cloud Matching

Fahira Afzal Maken, Fabio Ramos, Lionel Ott

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments 8 pages, 7 figures, Robotics and Automation Letters

详情

展开后加载摘要…

URL PDF HTML 收藏
2011.02000 2021-12-20 q-bio.QM eess.SP 50%

Detection of Maternal and Fetal Stress from the Electrocardiogram with Self-Supervised Representation Learning

Pritam Sarkar, Silvia Lobmaier, Bibiana Fabre, Diego González, Alexander Mueller, Martin G. Frasch, Marta C. Antonelli, Ali Etemad

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments ClinicalTrials.gov registration number: NCT03389178. Code repo: https://code.engineering.queensu.ca/17ps21/ssl-ecg-v2

Journal ref Scientific Reports, December 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2112.02566 2021-12-07 cs.HC eess.SP 50%

Improving Intention Detection in Single-Trial Classification through Fusion of EEG and Eye-tracker Data

Xianliang Ge, Yunxian Pan, Sujie Wang, Linze Qian, Jingjia Yuan, Jie Xu, Nitish Thakor, Yu Sun

专题命中 多模态训练与对齐 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2111.15043 2021-12-01 cs.RO 50%

RailLoMer: Rail Vehicle Localization and Mapping with LiDAR-IMU-Odometer-GNSS Data Fusion

Yusheng Wang, Yidong Lou, Yi Zhang, Weiwei Song, Fei Huang, Zhiyong Tu, Shimin Zhang

专题命中 多模态训练与对齐 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2111.00762 2021-11-02 cs.RO 50%

MetroLoc: Metro Vehicle Mapping and Localization with LiDAR-Camera-Inertial Integration

Yusheng Wang, Weiwei Song, Yi Zhang, Fei Huang, Zhiyong Tu, Yidong Lou

专题命中 多模态训练与对齐 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2110.03523 2021-10-08 eess.SP cs.IT math.IT math.OC 50%

Range and Bearing Data Fusion for Precise Convex Network Localization

Claudia Soares, Filipa Valdeira, Joao Gomes

专题命中 多模态训练与对齐 :multimodal(abstract)

Journal ref IEEE Signal Processing Letters 27 (2020): 670-674

详情

展开后加载摘要…

URL PDF HTML 收藏
2105.03296 2021-10-06 cs.RO 50%

VIRAL SLAM: Tightly Coupled Camera-IMU-UWB-Lidar SLAM

Thien-Minh Nguyen, Shenghai Yuan, Muqing Cao, Thien Hoang Nguyen, Lihua Xie

专题命中 多模态训练与对齐 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2101.07342 2021-09-15 eess.IV cs.LG q-bio.QM 50%

Feature Fusion of Raman Chemical Imaging and Digital Histopathology using Machine Learning for Prostate Cancer Detection

Trevor Doherty, Susan McKeever, Nebras Al-Attar, Tiarnan Murphy, Claudia Aura, Arman Rahman, Amanda O'Neill, Stephen P Finn, Elaine Kay, William M. Gallagher, R. William G. Watson, Aoife Gowen, Patrick Jackman

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments 19 pages, 8 tables, 18 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2104.14938 2021-08-23 cs.RO 50%

Super Odometry: IMU-centric LiDAR-Visual-Inertial Estimator for Challenging Environments

Shibo Zhao, Hengrui Zhang, Peng Wang, Lucas Nogueira, Sebastian Scherer

专题命中 多模态训练与对齐 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2108.05316 2021-08-12 cs.SE 50%

Why are Some Bugs Non-Reproducible? An Empirical Investigation using Data Fusion

Mohammad Masudur Rahman, Foutse Khomh, Marco Castelluccio

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments 12 pages

Journal ref 2020 IEEE International Conference on Software Maintenance and Evolution (ICSME)

详情

展开后加载摘要…

URL PDF HTML 收藏