多模态大模型 - arXivDaily 专题

1808.06887 2021-11-05 cs.RO cs.CV 79%

Multimodal Interaction-aware Motion Prediction for Autonomous Street Crossing

Noha Radwan, Wolfram Burgard, Abhinav Valada

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments The International Journal of Robotics Research (2020)

Journal ref The International Journal of Robotics Research (IJRR), vol. 39, no. 13, pp. 1567-1598, 2020

2110.05231 2021-11-04 q-bio.GN cs.AI cs.LG 79%

Multi-modal Self-supervised Pre-training for Regulatory Genome Across Cell Types

Shentong Mo, Xi Fu, Chenyang Hong, Yizhen Chen, Yuxuan Zheng, Xiangru Tang, Zhiqiang Shen, Eric P Xing, Yanyan Lan

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.AI

2103.11575 2021-11-04 cs.RO cs.CV cs.LG 79%

Learn-to-Race: A Multimodal Control Environment for Autonomous Racing

James Herman, Jonathan Francis, Siddha Ganju, Bingqing Chen, Anirudh Koul, Abhinav Gupta, Alexey Skabelkin, Ivan Zhukov, Max Kumskoy, Eric Nyberg

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments Accepted to the International Conference on Computer Vision (ICCV 2021); equal contribution - JH and JF; 15 pages, 4 figures

Journal ref International Conference on Computer Vision (ICCV), 2021

2110.06416 2021-11-02 cs.CV cs.LG 79%

MMIU: Dataset for Visual Intent Understanding in Multimodal Assistants

Alkesh Patel, Joel Ruben Antony Moniz, Roman Nguyen, Nick Tzou, Hadas Kotek, Vincent Renkens

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments Extended abstract accepted for WeCNLP 2021

2110.11938 2021-10-25 cs.CL 79%

A Framework for Learning Assessment through Multimodal Analysis of Reading Behaviour and Language Comprehension

Santosh Kumar Barnwal

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

Comments PhD Thesis, August 2021, Indian Institute of Information Technology Allahabad, Prayagraj, India

2110.08020 2021-10-18 cs.CL 79%

Multimodal Emotion-Cause Pair Extraction in Conversations

Fanfan Wang, Zixiang Ding, Rui Xia, Zhaoyu Li, Jianfei Yu

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

2012.13755 2021-10-12 cs.CV cs.RO 79%

Probabilistic 3D Multi-Modal, Multi-Object Tracking for Autonomous Driving

Hsu-kuang Chiu, Jie Li, Rares Ambrus, Jeannette Bohg

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments IEEE International Conference on Robotics and Automation (ICRA) 2021

2109.12913 2021-09-28 cs.CL 79%

The JDDC 2.0 Corpus: A Large-Scale Multimodal Multi-Turn Chinese Dialogue Dataset for E-commerce Customer Service

Nan Zhao, Haoran Li, Youzheng Wu, Xiaodong He, Bowen Zhou

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

2109.06416 2021-09-27 cs.IR cs.AI 79%

MMCoVaR: Multimodal COVID-19 Vaccine Focused Data Repository for Fake News Detection and a Baseline Architecture for Classification

Mingxuan Chen, Xinqiao Chu, K. P. Subbalakshmi

专题命中多模态评测：multimodal(title,abstract)；分类 cs.AI

Comments 12 pages, 8 figures. This paper has been accepted for publication in ASONAM 2021

2107.08888 2021-09-21 cs.LG cs.AI 79%

Multimodal Reward Shaping for Efficient Exploration in Reinforcement Learning

Mingqi Yuan, Mon-on Pun, Dong Wang, Yi Chen, Haojun Li

专题命中多模态评测：multimodal(title,abstract)；分类 cs.AI

Comments 17 pages, 5 figures

2109.08333 2021-09-20 cs.CL 79%

A Multimodal Sentiment Dataset for Video Recommendation

Hongxuan Tang, Hao Liu, Xinyan Xiao, Hua Wu

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

Comments 6 pages, 4 figures

2010.01678 2021-09-16 cs.CL cs.PL 79%

Optimal Neural Program Synthesis from Multimodal Specifications

Xi Ye, Qiaochu Chen, Isil Dillig, Greg Durrett

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

Comments Findings of EMNLP 2021

2105.02835 2021-09-15 eess.IV cs.CV 79%

Deep Learning based Multi-modal Computing with Feature Disentanglement for MRI Image Synthesis

Yuchen Fei, Bo Zhan, Mei Hong, Xi Wu, Jiliu Zhou, Yan Wang

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

2104.08836 2021-09-10 cs.CL 79%

LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understanding

Yiheng Xu, Tengchao Lv, Lei Cui, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Furu Wei

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

Comments Work in progress

2109.03415 2021-09-09 cs.CL 79%

Vision Matters When It Should: Sanity Checking Multimodal Machine Translation Models

Jiaoda Li, Duygu Ataman, Rico Sennrich

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

Comments EMNLP 2021

2103.14672 2021-09-08 cs.CV cs.RO 79%

Multi-Modal RGB-D Scene Recognition Across Domains

Andrea Ferreri, Silvia Bucci, Tatiana Tommasi

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted at Deep Multi-Task Learning in Computer Vision (DeepMTL) workshop, ICCV 2021

2109.02445 2021-09-07 cs.AI cs.PL 79%

Multi-modal Program Inference: a Marriage of Pre-trainedLanguage Models and Component-based Synthesis

Kia Rahmani, Mohammad Raza, Sumit Gulwani, Vu Le, Daniel Morris, Arjun Radhakrishna, Gustavo Soares, Ashish Tiwari

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.AI

Comments To be published in OOPSLA 2021

2108.11149 2021-08-27 cs.CV 79%

A Unified Taxonomy and Multimodal Dataset for Events in Invasion Games

Henrik Biermann, Jonas Theiner, Manuel Bassek, Dominik Raabe, Daniel Memmert, Ralph Ewerth

专题命中多模态评测：multimodal(title)；multi-modal(abstract)；分类 cs.CV

2108.11119 2021-08-26 cs.CV 79%

Product-oriented Machine Translation with Cross-modal Cross-lingual Pre-training

Yuqing Song, Shizhe Chen, Qin Jin, Wei Luo, Jun Xie, Fei Huang

专题命中多模态评测：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted as Oral by ACMMM 2021

2108.07543 2021-08-18 cs.CL 79%

Graph Capsule Aggregation for Unaligned Multimodal Sequences

Jianfeng Wu, Sijie Mai, Haifeng Hu

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

2108.03353 2021-08-10 cs.HC cs.AI cs.LG 79%

Screen2Words: Automatic Mobile UI Summarization with Multimodal Learning

Bryan Wang, Gang Li, Xin Zhou, Zhourong Chen, Tovi Grossman, Yang Li

专题命中多模态评测：multimodal(title)；multi-modal(abstract)；分类 cs.AI

Comments UIST'21

2107.14724 2021-08-10 cs.CV 79%

Sparse-to-dense Feature Matching: Intra and Inter domain Cross-modal Learning in Domain Adaptation for 3D Semantic Segmentation

Duo Peng, Yinjie Lei, Wen Li, Pingping Zhang, Yulan Guo

专题命中多模态评测：cross-modal(title)；multi-modal(abstract)；分类 cs.CV

Comments 10 pages,6 figures,accepted at ICCV 2021

2108.02319 2021-08-06 cs.LG cs.AI 79%

Generalization in Multimodal Language Learning from Simulation

Aaron Eisermann, Jae Hee Lee, Cornelius Weber, Stefan Wermter

专题命中多模态评测：multimodal(title,abstract)；分类 cs.AI

2108.01260 2021-08-04 cs.CL 79%

M2H2: A Multimodal Multiparty Hindi Dataset For Humor Recognition in Conversations

Dushyant Singh Chauhan, Gopendra Vikram Singh, Navonil Majumder, Amir Zadeh, Asif Ekbal, Pushpak Bhattacharyya, Louis-philippe Morency, Soujanya Poria

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

Comments ICMI 2021

2108.00860 2021-08-03 cs.CV cs.LG eess.IV 79%

U-GAT: Multimodal Graph Attention Network for COVID-19 Outcome Prediction

Matthias Keicher, Hendrik Burwinkel, David Bani-Harouni, Magdalini Paschali, Tobias Czempiel, Egon Burian, Marcus R. Makowski, Rickmer Braren, Nassir Navab, Thomas Wendler

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments 18 pages, 5 figures, submitted to Medical Image Analysis

2108.00187 2021-08-03 cs.CV 79%

Unsupervised Cross-Modal Distillation for Thermal Infrared Tracking

Jingxian Sun, Lichao Zhang, Yufei Zha, Abel Gonzalez-Garcia, Peng Zhang, Wei Huang, Yanning Zhang

专题命中多模态评测：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted at ACM MM 2021. Code and models are available at https://github.com/zhanglichao/cmdTIRtracking

2108.00158 2021-08-03 cs.CV 79%

Multiplex Graph Networks for Multimodal Brain Network Analysis

Zhaoming Kong, Lichao Sun, Hao Peng, Liang Zhan, Yong Chen, Lifang He

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

2101.07240 2021-08-02 cs.LG cs.AI 79%

Multimodal Variational Autoencoders for Semi-Supervised Learning: In Defense of Product-of-Experts

Svetlana Kutuzova, Oswin Krause, Douglas McCloskey, Mads Nielsen, Christian Igel

专题命中多模态评测：multimodal(title,abstract)；分类 cs.AI

2107.09909 2021-07-22 cs.CV 79%

DRDF: Determining the Importance of Different Multimodal Information with Dual-Router Dynamic Framework

Haiwen Hong, Xuan Jin, Yin Zhang, Yunqing Hu, Jingfeng Zhang, Yuan He, Hui Xue

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

2107.09842 2021-07-22 eess.IV cs.CV 79%

Modality-aware Mutual Learning for Multi-modal Medical Image Segmentation

Yao Zhang, Jiawei Yang, Jiang Tian, Zhongchao Shi, Cheng Zhong, Yang Zhang, Zhiqiang He

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

1. 多模态评测 9189 篇

Multimodal Interaction-aware Motion Prediction for Autonomous Street Crossing

Multi-modal Self-supervised Pre-training for Regulatory Genome Across Cell Types

Learn-to-Race: A Multimodal Control Environment for Autonomous Racing

MMIU: Dataset for Visual Intent Understanding in Multimodal Assistants

A Framework for Learning Assessment through Multimodal Analysis of Reading Behaviour and Language Comprehension

Multimodal Emotion-Cause Pair Extraction in Conversations

Probabilistic 3D Multi-Modal, Multi-Object Tracking for Autonomous Driving

The JDDC 2.0 Corpus: A Large-Scale Multimodal Multi-Turn Chinese Dialogue Dataset for E-commerce Customer Service

MMCoVaR: Multimodal COVID-19 Vaccine Focused Data Repository for Fake News Detection and a Baseline Architecture for Classification

Multimodal Reward Shaping for Efficient Exploration in Reinforcement Learning

A Multimodal Sentiment Dataset for Video Recommendation

Optimal Neural Program Synthesis from Multimodal Specifications

Deep Learning based Multi-modal Computing with Feature Disentanglement for MRI Image Synthesis

LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understanding

Vision Matters When It Should: Sanity Checking Multimodal Machine Translation Models

Multi-Modal RGB-D Scene Recognition Across Domains

Multi-modal Program Inference: a Marriage of Pre-trainedLanguage Models and Component-based Synthesis

A Unified Taxonomy and Multimodal Dataset for Events in Invasion Games

Product-oriented Machine Translation with Cross-modal Cross-lingual Pre-training

Graph Capsule Aggregation for Unaligned Multimodal Sequences

Screen2Words: Automatic Mobile UI Summarization with Multimodal Learning

Sparse-to-dense Feature Matching: Intra and Inter domain Cross-modal Learning in Domain Adaptation for 3D Semantic Segmentation

Generalization in Multimodal Language Learning from Simulation

M2H2: A Multimodal Multiparty Hindi Dataset For Humor Recognition in Conversations

U-GAT: Multimodal Graph Attention Network for COVID-19 Outcome Prediction

Unsupervised Cross-Modal Distillation for Thermal Infrared Tracking

Multiplex Graph Networks for Multimodal Brain Network Analysis

Multimodal Variational Autoencoders for Semi-Supervised Learning: In Defense of Product-of-Experts

DRDF: Determining the Importance of Different Multimodal Information with Dual-Router Dynamic Framework

Modality-aware Mutual Learning for Multi-modal Medical Image Segmentation