多模态大模型 - arXivDaily 专题

2210.03927 2022-10-11 cs.LG 78%

APE: Aligning Pretrained Encoders to Quickly Learn Aligned Multimodal Representations

Elan Rosenfeld, Preetum Nakkiran, Hadi Pouransari, Oncel Tuzel, Fartash Faghri

专题命中多模态训练与对齐：multimodal(title,abstract)

2210.02590 2022-10-07 cs.LG cs.NA math.NA 78%

Star-Graph Multimodal Matching Component Analysis for Data Fusion and Transfer Learning

Nick Lorenzo

专题命中多模态训练与对齐：multimodal(title,abstract)

2110.08465 2022-09-30 cs.LG cs.NE q-bio.NC 78%

Heterogeneous Graph-Based Multimodal Brain Network Learning

Gen Shi, Yifan Zhu, Wenjin Liu, Quanming Yao, Xuesong Li

专题命中多模态训练与对齐：multimodal(title,abstract)

2209.08978 2022-09-20 cs.SE 78%

MMF3: Neural Code Summarization Based on Multi-Modal Fine-Grained Feature Fusion

Zheng Ma, Yuexiu Gao, Lei Lyu, Chen Lyu

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments 12 pages, 5 figures

2207.04292 2022-07-12 cond-mat.mtrl-sci 78%

Multimodal Image Registration of Raman Spectral Maps in Two Dimensional Materials by Strain and Doping Analysis

Kirby Schmidt, Anthony Trofe, Tetyana Ignatova

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 11 pages 2 figures

2206.10846 2022-06-23 eess.SY cs.SY 78%

A Multimodal Perceived Stress Classification Framework using Wearable Physiological Sensors

Muhammad Majid, Aamir Arsalan, Syed Muhammad Anwar

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments Submitted in IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS

2012.13619 2022-05-24 cs.LG 78%

On self-supervised multi-modal representation learning: An application to Alzheimer's disease

Alex Fedorov, Lei Wu, Tristan Sylvain, Margaux Luck, Thomas P. DeRamus, Dmitry Bleklov, Sergey M. Plis, Vince D. Calhoun

专题命中多模态训练与对齐：multi-modal(title)；multimodal(abstract)

2205.06907 2022-05-17 cs.LG 78%

Multimodal Conversational AI: A Survey of Datasets and Approaches

Anirudh Sundar, Larry Heck

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 17 pages, 1 figure, to be published in the 4th Workshop on NLP for Conversational AI

2205.04300 2022-05-17 cs.RO 78%

Multi-modal Semantic SLAM for Complex Dynamic Environments

Han Wang, Jing Ying Ko, Lihua Xie

专题命中多模态训练与对齐：multi-modal(title,abstract)

2203.12221 2022-03-24 cs.LG 78%

Modality Competition: What Makes Joint Training of Multi-modal Network Fail in Deep Learning? (Provably)

Yu Huang, Junyang Lin, Chang Zhou, Hongxia Yang, Longbo Huang

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments 41 pages, 2 figures

2104.07407 2022-03-24 cs.IR 78%

MM-Rec: Multimodal News Recommendation

Chuhan Wu, Fangzhao Wu, Tao Qi, Yongfeng Huang

专题命中多模态训练与对齐：multimodal(title,abstract)

2104.09684 2022-03-16 cs.LG 78%

Suppressing simulation bias using multi-modal data

Bogdan Kustowski, Jim A. Gaffney, Brian K. Spears, Gemma J. Anderson, Rushil Anirudh, Peer-Timo Bremer, Jayaraman J. Thiagarajan, Michael K. G. Kruse, Ryan C. Nora

专题命中多模态训练与对齐：multi-modal(title,abstract)

2202.08401 2022-02-18 cs.RO 78%

Multi-Modal Fusion in Contact-Rich Precise Tasks via Hierarchical Policy Learning

Piaopiao Jin, Yinjie Lin, Yanchao Tan, Tiefeng Li, Wei Yang

专题命中多模态训练与对齐：multi-modal(title,abstract)

2201.07683 2022-01-20 stat.ML cs.LG stat.ME 78%

Coupled Support Tensor Machine Classification for Multimodal Neuroimaging Data

Li Peide, Seyyid Emre Sofuoglu, Tapabrata Maiti, Selin Aviyente

专题命中多模态训练与对齐：multimodal(title,abstract)

2201.04712 2022-01-14 cs.LG eess.SP 78%

Deep Learning on Multimodal Sensor Data at the Wireless Edge for Vehicular Network

Batool Salehi, Guillem Reus-Muns, Debashri Roy, Zifeng Wang, Tong Jian, Jennifer Dy, Stratis Ioannidis, Kaushik Chowdhury

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 16 pages

2107.00992 2022-01-14 cs.SE cs.LG 78%

Multimodal Representation for Neural Code Search

Jian Gu, Zimin Chen, Martin Monperrus

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 12 pages, 9 figures, 7 tables, accepted by ICSME 2021, the camera-ready version

Journal ref Proceedings of International Conference on Software Maintenance and Evolution, 2021

2112.04814 2021-12-10 q-bio.BM cs.LG 78%

Multimodal Pre-Training Model for Sequence-based Prediction of Protein-Protein Interaction

Yang Xue, Zijing Liu, Xiaomin Fang, Fan Wang

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments MLCB 2021 Spotlight

2105.06018 2021-11-24 cs.LG stat.ML 78%

Robust Dynamic Multi-Modal Data Fusion: A Model Uncertainty Perspective

Bin Liu

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments This paper has been accepted by IEEE Signal Processing Letters for publication

2111.04898 2021-11-10 cs.LG 78%

Machine Learning for Multimodal Electronic Health Records-based Research: Challenges and Perspectives

Ziyi Liu, Jiaqi Zhang, Yongshuai Hou, Xinran Zhang, Ge Li, Yang Xiang

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 37 pages, 3 tables, 2 figures, to be submitted to JAMIA

2111.04497 2021-11-09 cs.LG cs.CY 78%

An Approach for Combining Multimodal Fusion and Neural Architecture Search Applied to Knowledge Tracing

Xinyi Ding, Tao Han, Yili Fang, Eric Larson

专题命中多模态训练与对齐：multimodal(title,abstract)

2005.14117 2021-10-26 eess.IV cs.LG stat.ML 78%

Multimodal Feature Fusion and Knowledge-Driven Learning via Experts Consult for Thyroid Nodule Classification

Danilo Avola, Luigi Cinque, Alessio Fagioli, Sebastiano Filetti, Giorgio Grani, Emanuele Rodolà

专题命中多模态训练与对齐：multimodal(title,abstract)

2108.12445 2021-10-04 cs.LG stat.ML 78%

Multimodal Data Fusion in High-Dimensional Heterogeneous Datasets via Generative Models

Yasin Yilmaz, Mehmet Aktukmak, Alfred O. Hero

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments IEEE Transactions on Signal Processing (2021)

2109.12547 2021-09-28 cs.SI 78%

Multi-modal Fusion using Fine-tuned Self-attention and Transfer Learning for Veracity Analysis of Web Information

Priyanka Meel, Dinesh Kumar Vishwakarma

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments 31 pages, 12 figures

2109.03029 2021-09-08 cs.LG 78%

Predicting Mood Disorder Symptoms with Remotely Collected Videos Using an Interpretable Multimodal Dynamic Attention Fusion Network

Tathagata Banerjee, Matthew Kollada, Pablo Gersberg, Oscar Rodriguez, Jane Tiller, Andrew E Jaffe, John Reynders

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 8 pages, 3 figures, Published in the Computational Approaches to Mental Health Workshop of the International Conference on Machine Learning 2021, accepted-papers" target="_blank" rel="noopener">https://sites.google.com/view/ca2mh/accepted-papers

2108.08301 2021-08-24 cs.LG eess.IV 78%

Identifying Illicit Drug Dealers on Instagram with Large-scale Multimodal Data Fusion

Chuanbo Hu, Minglei Yin, Bin Liu, Xin Li, Yanfang Ye

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments Accepted by ACM Transactions on Intelligent Systems and Technology (TIST)

2011.05817 2021-08-02 cs.RO 78%

FINO-Net: A Deep Multimodal Sensor Fusion Framework for Manipulation Failure Detection

Arda Inceoglu, Eren Erdal Aksoy, Abdullah Cihan Ak, Sanem Sariel

专题命中多模态训练与对齐：multimodal(title,abstract)

2107.09869 2021-07-22 cs.LG cs.NE eess.SP 78%

ECG Heartbeat Classification Using Multimodal Fusion

Zeeshan Ahmad, Anika Tabassum, Ling Guan, Naimul Khan

专题命中多模态训练与对齐：multimodal(title,abstract)

2106.11473 2021-06-23 cs.LG 78%

Sequential Late Fusion Technique for Multi-modal Sentiment Analysis

Debapriya Banerjee, Fotios Lygerakis, Fillia Makedon

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments 2 pages, 1 figure, 1 table

2106.06180 2021-06-14 eess.SP 78%

Gas Detection and Identification Using Multimodal Artificial Intelligence Based Sensor Fusion

Parag Narkhede, Rahee Walambe, Shruti Mandaokar, Pulkit Chandel, Ketan Kotecha, George Ghinea

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 14 Pages, 9 Figures

Journal ref Applied System Innovation. 2021; 4(1):3

2005.14372 2021-06-09 stat.ME stat.CO 78%

Multimodal Bayesian Registration of Noisy Functions using Hamiltonian Monte Carlo

J. Derek Tucker, Lyndsay Shand, Kenny Chowdhary

专题命中多模态训练与对齐：multimodal(title)；multi-modal(abstract)

1. 多模态训练与对齐 6903 篇

APE: Aligning Pretrained Encoders to Quickly Learn Aligned Multimodal Representations

Star-Graph Multimodal Matching Component Analysis for Data Fusion and Transfer Learning

Heterogeneous Graph-Based Multimodal Brain Network Learning

MMF3: Neural Code Summarization Based on Multi-Modal Fine-Grained Feature Fusion

Multimodal Image Registration of Raman Spectral Maps in Two Dimensional Materials by Strain and Doping Analysis

A Multimodal Perceived Stress Classification Framework using Wearable Physiological Sensors

On self-supervised multi-modal representation learning: An application to Alzheimer's disease

Multimodal Conversational AI: A Survey of Datasets and Approaches

Multi-modal Semantic SLAM for Complex Dynamic Environments

Modality Competition: What Makes Joint Training of Multi-modal Network Fail in Deep Learning? (Provably)

MM-Rec: Multimodal News Recommendation

Suppressing simulation bias using multi-modal data

Multi-Modal Fusion in Contact-Rich Precise Tasks via Hierarchical Policy Learning

Coupled Support Tensor Machine Classification for Multimodal Neuroimaging Data

Deep Learning on Multimodal Sensor Data at the Wireless Edge for Vehicular Network

Multimodal Representation for Neural Code Search

Multimodal Pre-Training Model for Sequence-based Prediction of Protein-Protein Interaction

Robust Dynamic Multi-Modal Data Fusion: A Model Uncertainty Perspective

Machine Learning for Multimodal Electronic Health Records-based Research: Challenges and Perspectives

An Approach for Combining Multimodal Fusion and Neural Architecture Search Applied to Knowledge Tracing

Multimodal Feature Fusion and Knowledge-Driven Learning via Experts Consult for Thyroid Nodule Classification

Multimodal Data Fusion in High-Dimensional Heterogeneous Datasets via Generative Models

Multi-modal Fusion using Fine-tuned Self-attention and Transfer Learning for Veracity Analysis of Web Information

Predicting Mood Disorder Symptoms with Remotely Collected Videos Using an Interpretable Multimodal Dynamic Attention Fusion Network

Identifying Illicit Drug Dealers on Instagram with Large-scale Multimodal Data Fusion

FINO-Net: A Deep Multimodal Sensor Fusion Framework for Manipulation Failure Detection

ECG Heartbeat Classification Using Multimodal Fusion

Sequential Late Fusion Technique for Multi-modal Sentiment Analysis

Gas Detection and Identification Using Multimodal Artificial Intelligence Based Sensor Fusion

Multimodal Bayesian Registration of Noisy Functions using Hamiltonian Monte Carlo