多模态大模型 - arXivDaily 专题

2111.08456 2021-11-17 cs.LG cs.AI 79%

Trustworthy Multimodal Regression with Mixture of Normal-inverse Gamma Distributions

Huan Ma, Zongbo Han, Changqing Zhang, Huazhu Fu, Joey Tianyi Zhou, Qinghua Hu

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.AI

Comments Accepted to NeurIPS 2021

2111.05485 2021-11-11 cs.CV 79%

A Structure Feature Algorithm for Multi-modal Forearm Registration

Jiaxin Li, Yan Ding, Weizhong Zhang, Yifan Zhao, Lingxi Guo, Zhe Yang

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

2111.01623 2021-11-10 cs.CV eess.IV 79%

A Tri-attention Fusion Guided Multi-modal Segmentation Network

Tongxue Zhou, Su Ruan, Pierre Vera, Stéphane Canu

专题命中多模态训练与对齐：multi-modal(title)；multimodal(abstract)；分类 cs.CV

Comments 33 pages, 11 figures, accepted by Pattern Recognition on 01 November 2021. arXiv admin note: substantial text overlap with arXiv:2102.03111

Journal ref Pattern Recognition 2021

1808.03833 2021-11-05 cs.CV 79%

Self-Supervised Model Adaptation for Multimodal Semantic Segmentation

Abhinav Valada, Rohit Mohan, Wolfram Burgard

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments A Live demo is available at http://deepscene.cs.uni-freiburg.de and the code as well as the models are available at https://github.com/DeepSceneSeg

Journal ref International Journal of Computer Vision (IJCV), Special Issue: Deep Learning for Robotic Vision, vol. 128, no. 5, pp. 1239-1285, 2019

2110.15639 2021-11-01 cs.CV 79%

Multi-Task and Multi-Modal Learning for RGB Dynamic Gesture Recognition

Dinghao Fan, Hengjie Lu, Shugong Xu, Shan Cao

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

2106.04538 2021-10-27 cs.LG cs.AI 79%

What Makes Multi-modal Learning Better than Single (Provably)

Yu Huang, Chenzhuang Du, Zihui Xue, Xuanyao Chen, Hang Zhao, Longbo Huang

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.AI

Comments Accepted to NeurIPS 2021

2110.00385 2021-10-05 cs.NE cs.AI cs.LG 79%

Neural Dependency Coding inspired Multimodal Fusion

Shiv Shankar

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.AI

2104.03618 2021-09-27 eess.IV cs.CV 79%

MRI-based Alzheimer's disease prediction via distilling the knowledge in multi-modal data

Hao Guan, Chaoyue Wang, Dacheng Tao

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

2011.04945 2021-09-22 cs.CV 79%

Multi-modal Fusion for Single-Stage Continuous Gesture Recognition

Harshala Gammulle, Simon Denman, Sridha Sridharan, Clinton Fookes

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted for publication in IEEE Transactions on Image Processing

2010.12712 2021-09-21 cs.CL 79%

Can images help recognize entities? A study of the role of images for Multimodal NER

Shuguang Chen, Gustavo Aguilar, Leonardo Neves, Thamar Solorio

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CL

Comments Accepted to W-NUT 2021 at EMNLP

2109.07922 2021-09-17 cs.CV 79%

M2RNet: Multi-modal and Multi-scale Refined Network for RGB-D Salient Object Detection

Xian Fang, Jinchao Zhu, Ruixun Zhang, Xiuli Shao, Hongpeng Wang

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

2102.05766 2021-09-15 cs.CL 79%

Fused Acoustic and Text Encoding for Multimodal Bilingual Pretraining and Speech Translation

Renjie Zheng, Junkun Chen, Mingbo Ma, Liang Huang

专题命中多模态训练与对齐：multimodal(title)；cross-modal(abstract)；分类 cs.CL

2109.02804 2021-09-08 cs.CV 79%

Deep Collaborative Multi-Modal Learning for Unsupervised Kinship Estimation

Guan-Nan Dong, Chi-Man Pun, Zheng Zhang

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

2109.02271 2021-09-07 cs.SI cs.AI cs.DB 79%

MONITOR: A Multimodal Fusion Framework to Assess Message Veracity in Social Networks

Abderrazek Azri, Cécile Favre, Nouria Harbi, Jérôme Darmont, Camille Noûs

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.AI

Comments 25th European Conference on Advances in Databases and Information Systems (ADBIS 2021), Aug 2021, Tartu, Estonia

2107.13669 2021-08-31 cs.AI 79%

Bi-Bimodal Modality Fusion for Correlation-Controlled Multimodal Sentiment Analysis

Wei Han, Hui Chen, Alexander Gelbukh, Amir Zadeh, Louis-philippe Morency, Soujanya Poria

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.AI

Comments Accepted at ICMI 2021

2007.07229 2021-08-25 cs.IR cs.CL cs.LG 79%

BERTERS: Multimodal Representation Learning for Expert Recommendation System with Transformer

N. Nikzad-Khasmakhi, M. A. Balafar, M. Reza Feizi-Derakhshi, Cina Motamed

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CL

2108.07422 2021-08-18 cs.CV 79%

Learning by Aligning: Visible-Infrared Person Re-identification using Cross-Modal Correspondences

Hyunjong Park, Sanghoon Lee, Junghyup Lee, Bumsub Ham

专题命中多模态训练与对齐：cross-modal(title,abstract)；分类 cs.CV

Comments iccv 2021

2108.05009 2021-08-12 cs.CV 79%

Learning Deep Multimodal Feature Representation with Asymmetric Multi-layer Fusion

Yikai Wang, Fuchun Sun, Ming Lu, Anbang Yao

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments ACMMM 2020 (2020.3)

2009.12148 2021-08-05 cs.MM 79%

Adaptive Multi-modal Fusion Hashing via Hadamard Matrix

Jun Yu, Donglin Zhang, Zhenqiu Shu, Feng Chen

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.MM

Comments 10pages, 8figures, 3tables. The paper is under consideration at Applied Intelligence

2107.12167 2021-07-27 cs.HC cs.CV cs.LG 79%

Multimodal Fusion Using Deep Learning Applied to Driver's Referencing of Outside-Vehicle Objects

Abdul Rafey Aftab, Michael von der Beeck, Steven Rohrhirsch, Benoit Diotte, Michael Feld

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

2107.11585 2021-07-27 cs.CV cs.LG eess.IV 79%

Two Headed Dragons: Multimodal Fusion and Cross Modal Transactions

Rupak Bose, Shivam Pande, Biplab Banerjee

专题命中多模态训练与对齐：multimodal(title)；cross-modal(abstract)；分类 cs.CV

Comments Accepted in IEEE International conference on Image Processing (ICIP), 2021

2107.09928 2021-07-22 cs.CV 79%

Multimodal Representations Learning and Adversarial Hypergraph Fusion for Early Alzheimer's Disease Prediction

Qiankun Zuo, Baiying Lei, Yanyan Shen, Yong Liu, Zhiguang Feng, Shuqiang Wang

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments 13 pages, 3 figures

2107.04548 2021-07-13 cs.CV 79%

Cross-modal Attention for MRI and Ultrasound Volume Registration

Xinrui Song, Hengtao Guo, Xuanang Xu, Hanqing Chao, Sheng Xu, Baris Turkbey, Bradford J. Wood, Ge Wang, Pingkun Yan

专题命中多模态训练与对齐：cross-modal(title,abstract)；分类 cs.CV

Comments This paper has been accepted by MICCAI 2021

2107.02339 2021-07-07 cs.LG cs.AI cs.RO 79%

Multi-Modal Mutual Information (MuMMI) Training for Robust Self-Supervised Deep Reinforcement Learning

Kaiqi Chen, Yong Lee, Harold Soh

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.AI

Comments 10 pages, Published in ICRA 2021

2010.14924 2021-06-30 cs.CV 79%

Multimodal End-to-End Learning for Autonomous Steering in Adverse Road and Weather Conditions

Jyri Maanpää, Josef Taher, Petri Manninen, Leo Pakola, Iaroslav Melekhov, Juha Hyyppä

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments 8 pages, 8 figures, included in the conference proceedings of the 2020 25th International Conference on Pattern Recognition (ICPR), 2021

Journal ref 2020 25th International Conference on Pattern Recognition (ICPR), 2021, pp. 699-706

2106.14174 2021-06-29 cs.LG cs.DB cs.IR cs.MM 79%

Transfer-based adaptive tree for multimodal sentiment analysis based on user latent aspects

Sana Rahmani, Saeid Hosseini, Raziyeh Zall, Mohammad Reza Kangavari, Sara Kamran, Wen Hua

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.MM

Comments Under Review on IEEE Transactions on Pattern Analysis and Machine Intelligence

2012.07175 2021-06-29 cs.CV cs.LG 79%

MSAF: Multimodal Split Attention Fusion

Lang Su, Chuqing Hu, Guofa Li, Dongpu Cao

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

1810.12941 2021-06-17 cs.CV 79%

Joint detection and matching of feature points in multimodal images

Elad Ben Baruch, Yosi Keller

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

1912.07812 2021-06-15 cs.LG cs.CV eess.SP stat.ML 79%

Capsule Attention for Multimodal EEG-EOG Representation Learning with Application to Driver Vigilance Estimation

Guangyi Zhang, Ali Etemad

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments Accepted by IEEE Transactions on Neural Systems and Rehabilitation Engineering

2102.11456 2021-06-14 cs.CV 79%

Representation Disentanglement for Multi-modal brain MR Analysis

Jiahong Ouyang, Ehsan Adeli, Kilian M. Pohl, Qingyu Zhao, Greg Zaharchuk

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by Information Processing in Medical Imaging (IPMI) 2021

1. 多模态训练与对齐 6918 篇

Trustworthy Multimodal Regression with Mixture of Normal-inverse Gamma Distributions

A Structure Feature Algorithm for Multi-modal Forearm Registration

A Tri-attention Fusion Guided Multi-modal Segmentation Network

Self-Supervised Model Adaptation for Multimodal Semantic Segmentation

Multi-Task and Multi-Modal Learning for RGB Dynamic Gesture Recognition

What Makes Multi-modal Learning Better than Single (Provably)

Neural Dependency Coding inspired Multimodal Fusion

MRI-based Alzheimer's disease prediction via distilling the knowledge in multi-modal data

Multi-modal Fusion for Single-Stage Continuous Gesture Recognition

Can images help recognize entities? A study of the role of images for Multimodal NER

M2RNet: Multi-modal and Multi-scale Refined Network for RGB-D Salient Object Detection

Fused Acoustic and Text Encoding for Multimodal Bilingual Pretraining and Speech Translation

Deep Collaborative Multi-Modal Learning for Unsupervised Kinship Estimation

MONITOR: A Multimodal Fusion Framework to Assess Message Veracity in Social Networks

Bi-Bimodal Modality Fusion for Correlation-Controlled Multimodal Sentiment Analysis

BERTERS: Multimodal Representation Learning for Expert Recommendation System with Transformer

Learning by Aligning: Visible-Infrared Person Re-identification using Cross-Modal Correspondences

Learning Deep Multimodal Feature Representation with Asymmetric Multi-layer Fusion

Adaptive Multi-modal Fusion Hashing via Hadamard Matrix

Multimodal Fusion Using Deep Learning Applied to Driver's Referencing of Outside-Vehicle Objects

Two Headed Dragons: Multimodal Fusion and Cross Modal Transactions

Multimodal Representations Learning and Adversarial Hypergraph Fusion for Early Alzheimer's Disease Prediction

Cross-modal Attention for MRI and Ultrasound Volume Registration

Multi-Modal Mutual Information (MuMMI) Training for Robust Self-Supervised Deep Reinforcement Learning

Multimodal End-to-End Learning for Autonomous Steering in Adverse Road and Weather Conditions

Transfer-based adaptive tree for multimodal sentiment analysis based on user latent aspects

MSAF: Multimodal Split Attention Fusion

Joint detection and matching of feature points in multimodal images

Capsule Attention for Multimodal EEG-EOG Representation Learning with Application to Driver Vigilance Estimation

Representation Disentanglement for Multi-modal brain MR Analysis