多模态大模型 - arXivDaily 专题

2011.00168 2020-11-03 cs.CV cs.LG cs.RO 79%

Multimodal and self-supervised representation learning for automatic gesture recognition in surgical robotics

Aniruddha Tamhane, Jie Ying Wu, Mathias Unberath

专题命中多模态训练与对齐：multimodal(title)；multi-modal(abstract)；分类 cs.CV

Comments 15 pages, 7 figures

2010.14095 2020-10-28 cs.CV 79%

MMFT-BERT: Multimodal Fusion Transformer with BERT Encodings for Visual Question Answering

Aisha Urooj Khan, Amir Mazaheri, Niels da Vitoria Lobo, Mubarak Shah

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments Accepted at Findings of EMNLP 2020

2007.08076 2020-10-26 cs.LG cs.CV stat.ML 79%

Memory based fusion for multi-modal deep learning

Darshana Priyasad, Tharindu Fernando, Simon Denman, Sridha Sridharan, Clinton Fookes

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

Comments Pre-print submitted to Information Fusion

2010.08218 2020-10-19 cs.AI 79%

Deep-HOSeq: Deep Higher Order Sequence Fusion for Multimodal Sentiment Analysis

Sunny Verma, Jiwei Wang, Zhefeng Ge, Rujia Shen, Fan Jin, Yang Wang, Fang Chen, Wei Liu

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.AI

Comments Accepted at ICDM 2020

2009.09629 2020-10-08 cs.CL 79%

Modality-Transferable Emotion Embeddings for Low-Resource Multimodal Emotion Recognition

Wenliang Dai, Zihan Liu, Tiezheng Yu, Pascale Fung

专题命中多模态训练与对齐：multimodal(title)；multi-modal(abstract)；分类 cs.CL

Comments 12 pages, 5 figures

2009.02902 2020-09-29 cs.CL 79%

TransModality: An End2End Fusion Method with Transformer for Multimodal Sentiment Analysis

Zilong Wang, Zhaohong Wan, Xiaojun Wan

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CL

Comments Proceedings of The Web Conference 2020

2009.10945 2020-09-24 cs.CV 79%

MAFF-Net: Filter False Positive for 3D Vehicle Detection with Multi-modal Adaptive Feature Fusion

Zehan Zhang, Ming Zhang, Zhidong Liang, Xian Zhao, Ming Yang, Wenming Tan, ShiLiang Pu

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

Comments 8 pages, 6 figures

2009.04549 2020-09-23 cs.LG cs.AI cs.CR cs.SE stat.ML 79%

Multimodal Deep Learning for Flaw Detection in Software Programs

Scott Heidbrink, Kathryn N. Rodhouse, Daniel M. Dunlavy

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.AI

Comments 13 pages, 2 figures, 5 tables

2009.05147 2020-09-14 cs.CV cs.LG cs.RO stat.ML 79%

Practical Cross-modal Manifold Alignment for Grounded Language

Andre T. Nguyen, Luke E. Richards, Gaoussou Youssouf Kebe, Edward Raff, Kasra Darvish, Frank Ferraro, Cynthia Matuszek

专题命中多模态训练与对齐：cross-modal(title)；multi-modal(abstract)；分类 cs.CV

2009.03118 2020-09-08 cs.CV 79%

Interpretable Deep Multimodal Image Super-Resolution

Iman Marivani, Evaggelia Tsiligianni, Bruno Cornelis, Nikos Deligiannis

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments in Proceedings of iTWIST'20, Paper-ID: 41, Nantes, France, December, 2-4, 2020

2009.02569 2020-09-08 eess.IV cs.AI 79%

Max-Fusion U-Net for Multi-Modal Pathology Segmentation with Attention and Dynamic Resampling

Haochuan Jiang, Chengjia Wang, Agisilaos Chartsias, Sotirios A. Tsaftaris

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.AI

Comments 13 pages, 7 figures, conference paper

Journal ref MICCAI-2020 MyoPS Challenge Paper

2008.09672 2020-08-25 cs.CV cs.RO 79%

Towards Autonomous Driving: a Multi-Modal 360$^{\circ}$ Perception Proposal

Jorge Beltrán, Carlos Guindel, Irene Cortés, Alejandro Barrera, Armando Astudillo, Jesús Urdiales, Mario Álvarez, Farid Bekka, Vicente Milanés, Fernando García

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted for publication in IEEE ITSC 2020

2008.06179 2020-08-17 cs.CV cs.IR 79%

A Multimodal Late Fusion Model for E-Commerce Product Classification

Ye Bi, Shuo Wang, Zhongrui Fan

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments 4 pages, SIGIR 2020 E-commerce Workshop Data Challenge Technical Report

2008.05457 2020-08-13 cs.CV eess.IV 79%

More Diverse Means Better: Multimodal Deep Learning Meets Remote Sensing Imagery Classification

Danfeng Hong, Lianru Gao, Naoto Yokoya, Jing Yao, Jocelyn Chanussot, Qian Du, Bing Zhang

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Journal ref IEEE Transactions on Geoscience and Remote Sensing, 2020

2008.01388 2020-08-05 cs.CV 79%

Unsupervised Cross-Modal Alignment for Multi-Person 3D Pose Estimation

Jogendra Nath Kundu, Ambareesh Revanur, Govind Vitthal Waghmare, Rahul Mysore Venkatesh, R. Venkatesh Babu

专题命中多模态训练与对齐：cross-modal(title,abstract)；分类 cs.CV

Comments ECCV 2020

2007.09777 2020-07-21 cs.CV 79%

Deep Representation Learning For Multimodal Brain Networks

Wen Zhang, Liang Zhan, Paul Thompson, Yalin Wang

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments 11 pages, 3 figures, MICCAI 2020

2005.12209 2020-07-21 eess.IV cs.CV 79%

JSSR: A Joint Synthesis, Segmentation, and Registration System for 3D Multi-Modal Image Alignment of Large-scale Pathological CT Scans

Fengze Liu, Jinzheng Cai, Yuankai Huo, Chi-Tung Cheng, Ashwin Raju, Dakai Jin, Jing Xiao, Alan Yuille, Le Lu, ChienHung Liao, Adam P Harrison

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

Comments accepted to ECCV 2020

2007.08742 2020-07-20 cs.CL 79%

A Novel Graph-based Multi-modal Fusion Encoder for Neural Machine Translation

Yongjing Yin, Fandong Meng, Jinsong Su, Chulun Zhou, Zhengyuan Yang, Jie Zhou, Jiebo Luo

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CL

2007.04901 2020-07-10 cs.CV 79%

Cross-Modal Weighting Network for RGB-D Salient Object Detection

Gongyang Li, Zhi Liu, Linwei Ye, Yang Wang, Haibin Ling

专题命中多模态训练与对齐：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted in ECCV2020. Code: https://github.com/MathLee/CMWNet

1902.08913 2020-07-01 cs.CV 79%

Seeing Through Fog Without Seeing Fog: Deep Multimodal Sensor Fusion in Unseen Adverse Weather

Mario Bijelic, Tobias Gruber, Fahim Mannan, Florian Kraus, Werner Ritter, Klaus Dietmayer, Felix Heide

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Journal ref The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2020

2006.09454 2020-06-18 q-bio.NC cs.CV cs.LG eess.IV 79%

Interpretable multimodal fusion networks reveal mechanisms of brain cognition

Wenxing Hu, Xianghe Meng, Yuntong Bai, Aiying Zhang, Biao Cai, Gemeng Zhang, Tony W. Wilson, Julia M. Stephen, Vince D. Calhoun, Yu-Ping Wang

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

2006.08159 2020-06-16 cs.CV 79%

Survey on Deep Multi-modal Data Analytics: Collaboration, Rivalry and Fusion

Yang Wang

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

Comments Appearing at ACM TOMM, 26 pages

1910.04392 2020-06-04 cs.CV 79%

Adaptive and Azimuth-Aware Fusion Network of Multimodal Local Features for 3D Object Detection

Yonglin Tian, Kunfeng Wang, Yuang Wang, Yulin Tian, Zilei Wang, Fei-Yue Wang

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments Accepted by Neurocomputing

2006.01431 2020-06-03 cs.CV 79%

Distribution Aligned Multimodal and Multi-Domain Image Stylization

Minxuan Lin, Fan Tang, Weiming Dong, Xiao Li, Chongyang Ma, Changsheng Xu

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

2005.10987 2020-05-25 cs.CV 79%

Investigating Vulnerability to Adversarial Examples on Multimodal Data Fusion in Deep Learning

Youngjoon Yu, Hong Joo Lee, Byeong Cheon Kim, Jung Uk Kim, Yong Man Ro

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

1903.04294 2020-05-18 cs.CV 79%

Mix and match networks: cross-modal alignment for zero-pair image-to-image translation

Yaxing Wang, Luis Herranz, Joost van de Weijer

专题命中多模态训练与对齐：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted by IJCV

2004.11744 2020-04-27 cs.CV 79%

PipeNet: Selective Modal Pipeline of Fusion Network for Multi-Modal Face Anti-Spoofing

Qing Yang, Xia Zhu, Jong-Kae Fwu, Yun Ye, Ganmei You, Yuan Zhu

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted to appear in CVPR2020 WMF

2004.09321 2020-04-21 cs.CV eess.IV 79%

Combining multimodal information for Metal Artefact Reduction: An unsupervised deep learning framework

Marta B. M. Ranzini, Irme Groothuis, Kerstin Kläser, M. Jorge Cardoso, Johann Henckel, Sébastien Ourselin, Alister Hart, Marc Modat

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments Accepted at IEEE International Symposium on Biomedical Imaging (ISBI) 2020

2003.13910 2020-04-17 cs.CV 79%

Attention-based Multi-modal Fusion Network for Semantic Scene Completion

Siqi Li, Changqing Zou, Yipeng Li, Xibin Zhao, Yue Gao

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by AAAI 2020

2004.07011 2020-04-16 cs.CV 79%

Code-Aligned Autoencoders for Unsupervised Change Detection in Multimodal Remote Sensing Images

Luigi T. Luppino, Mads A. Hansen, Michael Kampffmeyer, Filippo M. Bianchi, Gabriele Moser, Robert Jenssen, Stian N. Anfinsen

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

1. 多模态训练与对齐 6918 篇

Multimodal and self-supervised representation learning for automatic gesture recognition in surgical robotics

MMFT-BERT: Multimodal Fusion Transformer with BERT Encodings for Visual Question Answering

Memory based fusion for multi-modal deep learning

Deep-HOSeq: Deep Higher Order Sequence Fusion for Multimodal Sentiment Analysis

Modality-Transferable Emotion Embeddings for Low-Resource Multimodal Emotion Recognition

TransModality: An End2End Fusion Method with Transformer for Multimodal Sentiment Analysis

MAFF-Net: Filter False Positive for 3D Vehicle Detection with Multi-modal Adaptive Feature Fusion

Multimodal Deep Learning for Flaw Detection in Software Programs

Practical Cross-modal Manifold Alignment for Grounded Language

Interpretable Deep Multimodal Image Super-Resolution

Max-Fusion U-Net for Multi-Modal Pathology Segmentation with Attention and Dynamic Resampling

Towards Autonomous Driving: a Multi-Modal 360$^{\circ}$ Perception Proposal

A Multimodal Late Fusion Model for E-Commerce Product Classification

More Diverse Means Better: Multimodal Deep Learning Meets Remote Sensing Imagery Classification

Unsupervised Cross-Modal Alignment for Multi-Person 3D Pose Estimation

Deep Representation Learning For Multimodal Brain Networks

JSSR: A Joint Synthesis, Segmentation, and Registration System for 3D Multi-Modal Image Alignment of Large-scale Pathological CT Scans

A Novel Graph-based Multi-modal Fusion Encoder for Neural Machine Translation

Cross-Modal Weighting Network for RGB-D Salient Object Detection

Seeing Through Fog Without Seeing Fog: Deep Multimodal Sensor Fusion in Unseen Adverse Weather

Interpretable multimodal fusion networks reveal mechanisms of brain cognition

Survey on Deep Multi-modal Data Analytics: Collaboration, Rivalry and Fusion

Adaptive and Azimuth-Aware Fusion Network of Multimodal Local Features for 3D Object Detection

Distribution Aligned Multimodal and Multi-Domain Image Stylization

Investigating Vulnerability to Adversarial Examples on Multimodal Data Fusion in Deep Learning

Mix and match networks: cross-modal alignment for zero-pair image-to-image translation

PipeNet: Selective Modal Pipeline of Fusion Network for Multi-Modal Face Anti-Spoofing

Combining multimodal information for Metal Artefact Reduction: An unsupervised deep learning framework

Attention-based Multi-modal Fusion Network for Semantic Scene Completion

Code-Aligned Autoencoders for Unsupervised Change Detection in Multimodal Remote Sensing Images