多模态大模型 - arXivDaily 专题

2004.04807 2020-07-17 cs.CV cs.LG cs.RO eess.IV 79%

6D Camera Relocalization in Ambiguous Scenes via Continuous Multimodal Inference

Mai Bui, Tolga Birdal, Haowen Deng, Shadi Albarqouni, Leonidas Guibas, Slobodan Ilic, Nassir Navab

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments Accepted for publication at ECCV 2020. Project page under https://multimodal3dvision.github.io

2006.12906 2020-07-14 cs.CV cs.RO 79%

Probabilistic Crowd GAN: Multimodal Pedestrian Trajectory Prediction using a Graph Vehicle-Pedestrian Attention Network

Stuart Eiffert, Kunming Li, Mao Shan, Stewart Worrall, Salah Sukkarieh, Eduardo Nebot

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments Accepted for publication in IEEE Robotics and Automation Letters (RA-L) Copyright may be transferred without notice, after which this version may no longer be accessible

1904.06618 2020-07-02 cs.LG cs.CL stat.ML 79%

UR-FUNNY: A Multimodal Language Dataset for Understanding Humor

Md Kamrul Hasan, Wasifur Rahman, Amir Zadeh, Jianyuan Zhong, Md Iftekhar Tanveer, Louis-Philippe Morency, Mohammed, Hoque

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

Journal ref EMNLP-IJCNLP, 2019, 2046-2056

2006.00923 2020-06-26 cs.CV 79%

Multimodal grid features and cell pointers for Scene Text Visual Question Answering

Lluís Gómez, Ali Furkan Biten, Rubèn Tito, Andrés Mafla, Marçal Rusiñol, Ernest Valveny, Dimosthenis Karatzas

专题命中多模态评测：multimodal(title)；multi-modal(abstract)；分类 cs.CV

Comments This paper is under consideration at Pattern Recognition Letters

1906.03631 2020-06-09 cs.CV 79%

Overcoming Limitations of Mixture Density Networks: A Sampling and Fitting Framework for Multimodal Future Prediction

Osama Makansi, Eddy Ilg, Özgün Cicek, Thomas Brox

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments In CVPR 2019

2006.00197 2020-06-02 eess.IV cs.CV cs.LG 79%

Blended Multi-Modal Deep ConvNet Features for Diabetic Retinopathy Severity Prediction

J. D. Bodapati, N. Veeranjaneyulu, S. N. Shareef, S. Hakak, M. Bilal, P. K. R. Maddikunta, O. Jo

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments 18 pages, 8 figures, published in Electronics MDPI journal

Journal ref Electronics 2020, 9, 914

2005.14107 2020-05-29 cs.CV cs.LG eess.IV 79%

Unsupervised learning of multimodal image registration using domain adaptation with projected Earth Move's discrepancies

Mattias P Heinrich, Lasse Hansen

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments Medical Imaging with Deep Learning (accepted short paper) https://openreview.net/forum?id=wbZM-DcJB9

2005.06338 2020-05-21 eess.IV cs.CV stat.ML 79%

Neural Architecture Search for Gliomas Segmentation on Multimodal Magnetic Resonance Imaging

Feifan Wang

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

2005.02235 2020-05-06 cs.CL 79%

Creating a Multimodal Dataset of Images and Text to Study Abusive Language

Alessio Palmero Aprosio, Stefano Menini, Sara Tonelli

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

2004.05804 2020-04-14 eess.IV cs.CV 79%

Multi-modal Datasets for Super-resolution

Haoran Li, Weihong Quan, Meijun Yan, Jin zhang, Xiaoli Gong, Jin Zhou

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

2004.00176 2020-04-02 cs.CV 79%

Knowledge as Priors: Cross-Modal Knowledge Generalization for Datasets without Superior Knowledge

Long Zhao, Xi Peng, Yuxiao Chen, Mubbasir Kapadia, Dimitris N. Metaxas

专题命中多模态评测：cross-modal(title,abstract)；分类 cs.CV

Comments In CVPR 2020. (15 pages including supplementary material)

2003.07650 2020-03-18 cs.CV 79%

M$^5$L: Multi-Modal Multi-Margin Metric Learning for RGBT Tracking

Zhengzheng Tu, Chun Lin, Chenglong Li, Jin Tang, Bin Luo

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments 11 pages, 7 figures

1911.03854 2020-03-13 cs.CL cs.CY cs.IR 79%

r/Fakeddit: A New Multimodal Benchmark Dataset for Fine-grained Fake News Detection

Kai Nakamura, Sharon Levy, William Yang Wang

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

Comments Accepted LREC 2020

2003.05136 2020-03-12 cs.CV 79%

CASIA-SURF CeFA: A Benchmark for Multi-modal Cross-ethnicity Face Anti-spoofing

Ajian Li, Zichang Tan, Xuan Li, Jun Wan, Sergio Escalera, Guodong Guo, Stan Z. Li

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments 17 pages, 4 figures. arXiv admin note: substantial text overlap with arXiv:1912.02340

2003.03480 2020-03-10 eess.SP cs.AI 79%

A Multi-Modal States based Vehicle Descriptor and Dilated Convolutional Social Pooling for Vehicle Trajectory Prediction

Huimin Zhang, Yafei Wang, Junjia Liu, Chengwei Li, Taiyuan Ma, Chengliang Yin

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.AI

2001.07739 2020-03-10 cs.CV cs.LG eess.IV 79%

EMOPAIN Challenge 2020: Multimodal Pain Evaluation from Facial and Bodily Expressions

Joy O. Egede, Siyang Song, Temitayo A. Olugbade, Chongyang Wang, Amanda Williams, Hongying Meng, Min Aung, Nicholas D. Lane, Michel Valstar, Nadia Bianchi-Berthouze

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments 8 pages

2003.01181 2020-03-04 cs.LG cs.CV stat.ML 79%

RandomNet: Towards Fully Automatic Neural Architecture Design for Multimodal Learning

Stefano Alletto, Shenyang Huang, Vincent Francois-Lavet, Yohei Nakata, Guillaume Rabusseau

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments 6 pages, 1 figures

1908.10654 2020-02-05 cs.CV 79%

CASIA-SURF: A Large-scale Multi-modal Benchmark for Face Anti-spoofing

Shifeng Zhang, Ajian Liu, Jun Wan, Yanyan Liang, Guogong Guo, Sergio Escalera, Hugo Jair Escalante, Stan Z. Li

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by TBIOM; Journal extension of our previous conference paper: arXiv:1812.00408

2001.11737 2020-02-04 cs.CV cs.RO 79%

AU-AIR: A Multi-modal Unmanned Aerial Vehicle Dataset for Low Altitude Traffic Surveillance

Ilker Bozcan, Erdal Kayacan

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments 7 pages, 8 figures, 3 tables; for the associated dataset, see http://bozcani.github.io/auairdataset accepted to ICRA 2020

2001.05745 2020-01-17 cs.HC cs.CV eess.IV 79%

A Technology-aided Multi-modal Training Approach to Assist Abdominal Palpation Training and its Assessment in Medical Education

A. Asadipour, K. Debattista, V. Patel, A. Chalmers

专题命中多模态评测：multi-modal(title)；multimodal(abstract)；分类 cs.CV

Comments In Press

1912.10248 2020-01-06 cs.MM cs.LG 79%

Look, Read and Feel: Benchmarking Ads Understanding with Multimodal Multitask Learning

Huaizheng Zhang, Yong Luo, Qiming Ai, Yonggang Wen

专题命中多模态评测：multimodal(title,abstract)；分类 cs.MM

Comments 8 pages, 5 figures

1911.09338 2020-01-01 cs.CV 79%

Voice-Face Cross-modal Matching and Retrieval: A Benchmark

Chuyuan Xiong, Deyuan Zhang, Tao Liu, Xiaoyong Du

专题命中多模态评测：cross-modal(title,abstract)；分类 cs.CV

1912.10675 2019-12-30 cs.RO cs.CV 79%

A Multimodal Target-Source Classifier with Attention Branches to Understand Ambiguous Instructions for Fetching Daily Objects

Aly Magassouba, Komei Sugiura, Hisashi Kawai

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments 9 pages, 5 figures, accepted for IEEE Robotics and Automation Letters

1910.03650 2019-12-23 cs.LG cs.AI cs.RO 79%

Multi-Head Attention for Multi-Modal Joint Vehicle Motion Forecasting

Jean Mercat, Thomas Gilles, Nicole El Zoghby, Guillaume Sandou, Dominique Beauvois, Guillermo Pita Gil

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.AI

Comments 7 pages, 4 figures, under review at ICRA and RA-L

1912.02487 2019-12-06 cs.CV 79%

Smartphone Multi-modal Biometric Authentication: Database and Evaluation

Raghavendra Ramachandra, Martin Stokkenes, Amir Mohammadi, Sushma Venkatesh, Kiran Raja, Pankaj Wasnik, Eric Poiret, Sébastien Marcel, Christoph Busch

专题命中多模态评测：multi-modal(title)；multimodal(abstract)；分类 cs.CV

1911.04058 2019-11-12 cs.CV 79%

Open-Ended Visual Question Answering by Multi-Modal Domain Adaptation

Yiming Xu, Lin Chen, Zhongwei Cheng, Lixin Duan, Jiebo Luo

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

1904.09073 2019-11-11 cs.CV 79%

Integrating Text and Image: Determining Multimodal Document Intent in Instagram Posts

Julia Kruk, Jonah Lubin, Karan Sikka, Xiao Lin, Dan Jurafsky, Ajay Divakaran

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments Accepted at EMNLP'2019; Added dataset link

1904.11223 2019-11-07 cs.LG cs.AI q-bio.QM stat.ML 79%

Towards Explainable Anticancer Compound Sensitivity Prediction via Multimodal Attention-based Convolutional Encoders

Matteo Manica, Ali Oskooei, Jannis Born, Vigneshwari Subramanian, Julio Sáez-Rodríguez, María Rodríguez Martínez

专题命中多模态评测：multimodal(title,abstract)；分类 cs.AI

Comments 11 pages, 5 figures, 1 table, Workshop on Computational Biology at the International Conference on Machine Learning (ICML), Long Beach, CA, 2019

Journal ref Mol. Pharmaceutics 2019

1909.11765 2019-09-27 cs.HC cs.AI 79%

A Multimodal Alerting System for Online Class Quality Assurance

Jiahao Chen, Hang Li, Wenxin Wang, Wenbiao Ding, Gale Yan Huang, Zitao Liu

专题命中多模态评测：multimodal(title,abstract)；分类 cs.AI

Comments The 20th International Conference on Artificial Intelligence in Education(AIED), 2019

1909.06795 2019-09-17 cs.CV 79%

OpenMPR: Recognize Places Using Multimodal Data for People with Visual Impairments

Ruiqi Cheng, Kaiwei Wang, Jian Bai, Zhijie Xu

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments The paper is accepted by the special issue of Measurement Science and Engineering

1. 多模态评测 9204 篇

6D Camera Relocalization in Ambiguous Scenes via Continuous Multimodal Inference

Probabilistic Crowd GAN: Multimodal Pedestrian Trajectory Prediction using a Graph Vehicle-Pedestrian Attention Network

UR-FUNNY: A Multimodal Language Dataset for Understanding Humor

Multimodal grid features and cell pointers for Scene Text Visual Question Answering

Overcoming Limitations of Mixture Density Networks: A Sampling and Fitting Framework for Multimodal Future Prediction

Blended Multi-Modal Deep ConvNet Features for Diabetic Retinopathy Severity Prediction

Unsupervised learning of multimodal image registration using domain adaptation with projected Earth Move's discrepancies

Neural Architecture Search for Gliomas Segmentation on Multimodal Magnetic Resonance Imaging

Creating a Multimodal Dataset of Images and Text to Study Abusive Language

Multi-modal Datasets for Super-resolution

Knowledge as Priors: Cross-Modal Knowledge Generalization for Datasets without Superior Knowledge

M$^5$L: Multi-Modal Multi-Margin Metric Learning for RGBT Tracking

r/Fakeddit: A New Multimodal Benchmark Dataset for Fine-grained Fake News Detection

CASIA-SURF CeFA: A Benchmark for Multi-modal Cross-ethnicity Face Anti-spoofing

A Multi-Modal States based Vehicle Descriptor and Dilated Convolutional Social Pooling for Vehicle Trajectory Prediction

EMOPAIN Challenge 2020: Multimodal Pain Evaluation from Facial and Bodily Expressions

RandomNet: Towards Fully Automatic Neural Architecture Design for Multimodal Learning

CASIA-SURF: A Large-scale Multi-modal Benchmark for Face Anti-spoofing

AU-AIR: A Multi-modal Unmanned Aerial Vehicle Dataset for Low Altitude Traffic Surveillance

A Technology-aided Multi-modal Training Approach to Assist Abdominal Palpation Training and its Assessment in Medical Education

Look, Read and Feel: Benchmarking Ads Understanding with Multimodal Multitask Learning

Voice-Face Cross-modal Matching and Retrieval: A Benchmark

A Multimodal Target-Source Classifier with Attention Branches to Understand Ambiguous Instructions for Fetching Daily Objects

Multi-Head Attention for Multi-Modal Joint Vehicle Motion Forecasting

Smartphone Multi-modal Biometric Authentication: Database and Evaluation

Open-Ended Visual Question Answering by Multi-Modal Domain Adaptation

Integrating Text and Image: Determining Multimodal Document Intent in Instagram Posts

Towards Explainable Anticancer Compound Sensitivity Prediction via Multimodal Attention-based Convolutional Encoders

A Multimodal Alerting System for Online Class Quality Assurance

OpenMPR: Recognize Places Using Multimodal Data for People with Visual Impairments