多模态大模型 - arXivDaily 专题

2008.10833 2021-06-09 cs.CV 79%

Adaptive Context-Aware Multi-Modal Network for Depth Completion

Shanshan Zhao, Mingming Gong, Huan Fu, Dacheng Tao

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

2106.03619 2021-06-08 cs.AI 79%

Multi-modal Entity Alignment in Hyperbolic Space

Hao Guo, Jiuyang Tang, Weixin Zeng, Xiang Zhao, Li Liu

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.AI

Comments 24 pages,5 figures;

2005.02933 2021-05-10 eess.IV cs.CV 79%

Groupwise Multimodal Image Registration using Joint Total Variation

Mikael Brudfors, Yaël Balbastre, John Ashburner

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

2105.02489 2021-05-07 cs.LG cs.CV 79%

Learning Neighborhood Representation from Multi-Modal Multi-Graph: Image, Text, Mobility Graph and Beyond

Tianyuan Huang, Zhecheng Wang, Hao Sheng, Andrew Y. Ng, Ram Rajagopal

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

2105.00310 2021-05-04 cs.CV 79%

MARL: Multimodal Attentional Representation Learning for Disease Prediction

Ali Hamdi, Amr Aboeleneen, Khaled Shaban

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments 8 pages, submitted to IEEE-FUZZ'2021

2105.00136 2021-05-04 cs.MM 79%

Cross-Modal Self-Attention with Multi-Task Pre-Training for Medical Visual Question Answering

Haifan Gong, Guanqi Chen, Sishuo Liu, Yizhou Yu, Guanbin Li

专题命中多模态训练与对齐：cross-modal(title,abstract)；分类 cs.MM

Comments ICMR '21: ACM International Conference on Multimedia Retrieval, Taipei, Taiwan, August 21-24, 2021

2104.11476 2021-04-28 cs.CL 79%

Multimodal Fusion with BERT and Attention Mechanism for Fake News Detection

Nguyen Manh Duc Tuan, Pham Quang Nhat Minh

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CL

Comments RIVF 2021

2104.11693 2021-04-26 cs.CV 79%

Deep Lucas-Kanade Homography for Multimodal Image Alignment

Yiming Zhao, Xinming Huang, Ziming Zhang

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments Accepted by CVPR2021, codelink: https://github.com/placeforyiming/CVPR21-Deep-Lucas-Kanade-Homography

2011.13572 2021-04-26 cs.AI 79%

Analyzing Unaligned Multimodal Sequence via Graph Convolution and Graph Pooling Fusion

Sijie Mai, Songlong Xing, Jiaxuan He, Ying Zeng, Haifeng Hu

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.AI

Comments preprint, work in progress

2104.08403 2021-04-20 cs.CV 79%

Accurate 3D Facial Geometry Prediction by Multi-Task, Multi-Modal, and Multi-Representation Landmark Refinement Network

Cho-Ying Wu, Qiangeng Xu, Ulrich Neumann

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

Comments Project page: https://choyingw.github.io/works/M3-LRN/index.html

2104.04000 2021-04-12 cs.AI cs.LG cs.RO 79%

Software/Hardware Co-design for Multi-modal Multi-task Learning in Autonomous Systems

Cong Hao, Deming Chen

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.AI

Comments Invited paper at IEEE AICAS 2021, 5 pages

1808.06194 2021-04-01 cs.CV 79%

Fast and Robust Matching for Multimodal Remote Sensing Image Registration

Yuanxin Ye, Lorenzo Bruzzone, Jie Shan, Francesca Bovolo, Qing Zhu

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

2005.08706 2021-04-01 cs.CV 79%

Towards Better Graph Representation: Two-Branch Collaborative Graph Neural Networks for Multimodal Marketing Intention Detection

Lu Zhang, Jian Zhang, Zhibin Li, Jingsong Xu

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments Accepted by ICME2020

2103.11832 2021-03-23 cs.CV 79%

Deep RGB-D Saliency Detection with Depth-Sensitive Attention and Automatic Multi-Modal Fusion

Peng Sun, Wenhu Zhang, Huanyu Wang, Songyuan Li, Xi Li

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by CVPR2021, Oral

2103.11114 2021-03-23 cs.CV 79%

A novel multimodal fusion network based on a joint coding model for lane line segmentation

Zhenhong Zou, Xinyu Zhang, Huaping Liu, Zhiwei Li, Amir Hussain, Jun Li

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

2103.05940 2021-03-11 cs.CV 79%

TransMed: Transformers Advance Multi-modal Medical Image Classification

Yin Dai, Yifan Gao

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

Comments 8 pages, 4 figures

1709.08680 2021-03-11 cs.CV 79%

Multimodal Image Super-resolution via Joint Sparse Representations induced by Coupled Dictionaries

Pingfan Song, Xin Deng, João F. C. Mota, Nikos Deligiannis, Pier Luigi Dragotti, Miguel R. D. Rodrigues

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments 13 pages, 8 figures, 9 tables

2103.05107 2021-03-10 cs.CV cs.LG 79%

Risk Prediction on Traffic Accidents using a Compact Neural Model for Multimodal Information Fusion over Urban Big Data

Wenshan Wang, Su Yang, Weishan Zhang

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

2103.04412 2021-03-09 cs.RO cs.AI 79%

Multimodal VAE Active Inference Controller

Cristian Meo, Pablo Lanillos

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.AI

Comments Submitted to IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

2102.08641 2021-02-18 cs.CV cs.LG eess.IV 79%

Coupled Feature Learning for Multimodal Medical Image Fusion

Farshad G. Veshki, Nora Ouzir, Sergiy A. Vorobyov, Esa Ollila

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

2102.03111 2021-02-08 eess.IV cs.CV cs.LG 79%

3D Medical Multi-modal Segmentation Network Guided by Multi-source Correlation Constraint

Tongxue Zhou, Stéphane Canu, Pierre Vera, Su Ruan

专题命中多模态训练与对齐：multi-modal(title)；multimodal(abstract)；分类 cs.CV

Comments 8 pages, 8 figures

2012.13024 2020-12-25 cs.CV cs.LG 79%

Private-Shared Disentangled Multimodal VAE for Learning of Hybrid Latent Representations

Mihee Lee, Vladimir Pavlovic

专题命中多模态训练与对齐：multimodal(title)；multi-modal(abstract)；分类 cs.CV

2012.10160 2020-12-23 eess.IV cs.CV 79%

Multimodal Transfer Learning-based Approaches for Retinal Vascular Segmentation

José Morano, Álvaro S. Hervella, Noelia Barreira, Jorge Novo, José Rouco

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Journal ref Proceedings of the 24th European Conference on Artificial Intelligence (ECAI 2020)

2012.08637 2020-12-17 cs.RO cs.AI cs.LG 79%

Multi-Modal Anomaly Detection for Unstructured and Uncertain Environments

Tianchen Ji, Sri Theja Vuppala, Girish Chowdhary, Katherine Driggs-Campbell

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.AI

Comments Conference on Robot Learning (CoRL) 2020

2012.04446 2020-12-09 cs.MM 79%

LAMP: Label Augmented Multimodal Pretraining

Jia Guo, Chen Zhu, Yilun Zhao, Heda Wang, Yao Hu, Xiaofei He, Deng Cai

专题命中多模态训练与对齐：multimodal(title)；multi-modal(abstract)；分类 cs.MM

2012.03417 2020-12-08 cs.CV 79%

Boosting Image Super-Resolution Via Fusion of Complementary Information Captured by Multi-Modal Sensors

Fan Wang, Jiangxin Yang, Yanlong Cao, Yanpeng Cao, Michael Ying Yang

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

Comments 8 pages, 7 figures

2011.05005 2020-12-08 cs.CV cs.LG 79%

Deep Multimodal Fusion by Channel Exchanging

Yikai Wang, Wenbing Huang, Fuchun Sun, Tingyang Xu, Yu Rong, Junzhou Huang

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments NeurIPS 2020. Code and models: https://github.com/yikaiw/CEN

1908.05787 2020-11-24 cs.LG cs.CL stat.ML 79%

Integrating Multimodal Information in Large Pretrained Transformers

Wasifur Rahman, Md. Kamrul Hasan, Sangwu Lee, Amir Zadeh, Chengfeng Mao, Louis-Philippe Morency, Ehsan Hoque

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CL

2011.07191 2020-11-17 cs.LG cs.AI 79%

On the Benefits of Early Fusion in Multimodal Representation Learning

George Barnum, Sabera Talukder, Yisong Yue

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.AI

2011.06216 2020-11-13 cs.CV eess.IV 79%

Unsupervised Multimodal Image Registration with Adaptative Gradient Guidance

Zhe Xu, Jiangpeng Yan, Jie Luo, Xiu Li, Jayender Jagadeesan

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments 5 pages, under review

1. 多模态训练与对齐 6918 篇

Adaptive Context-Aware Multi-Modal Network for Depth Completion

Multi-modal Entity Alignment in Hyperbolic Space

Groupwise Multimodal Image Registration using Joint Total Variation

Learning Neighborhood Representation from Multi-Modal Multi-Graph: Image, Text, Mobility Graph and Beyond

MARL: Multimodal Attentional Representation Learning for Disease Prediction

Cross-Modal Self-Attention with Multi-Task Pre-Training for Medical Visual Question Answering

Multimodal Fusion with BERT and Attention Mechanism for Fake News Detection

Deep Lucas-Kanade Homography for Multimodal Image Alignment

Analyzing Unaligned Multimodal Sequence via Graph Convolution and Graph Pooling Fusion

Accurate 3D Facial Geometry Prediction by Multi-Task, Multi-Modal, and Multi-Representation Landmark Refinement Network

Software/Hardware Co-design for Multi-modal Multi-task Learning in Autonomous Systems

Fast and Robust Matching for Multimodal Remote Sensing Image Registration

Towards Better Graph Representation: Two-Branch Collaborative Graph Neural Networks for Multimodal Marketing Intention Detection

Deep RGB-D Saliency Detection with Depth-Sensitive Attention and Automatic Multi-Modal Fusion

A novel multimodal fusion network based on a joint coding model for lane line segmentation

TransMed: Transformers Advance Multi-modal Medical Image Classification

Multimodal Image Super-resolution via Joint Sparse Representations induced by Coupled Dictionaries

Risk Prediction on Traffic Accidents using a Compact Neural Model for Multimodal Information Fusion over Urban Big Data

Multimodal VAE Active Inference Controller

Coupled Feature Learning for Multimodal Medical Image Fusion

3D Medical Multi-modal Segmentation Network Guided by Multi-source Correlation Constraint

Private-Shared Disentangled Multimodal VAE for Learning of Hybrid Latent Representations

Multimodal Transfer Learning-based Approaches for Retinal Vascular Segmentation

Multi-Modal Anomaly Detection for Unstructured and Uncertain Environments

LAMP: Label Augmented Multimodal Pretraining

Boosting Image Super-Resolution Via Fusion of Complementary Information Captured by Multi-Modal Sensors

Deep Multimodal Fusion by Channel Exchanging

Integrating Multimodal Information in Large Pretrained Transformers

On the Benefits of Early Fusion in Multimodal Representation Learning

Unsupervised Multimodal Image Registration with Adaptative Gradient Guidance