arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 9204 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 多模态评测 9204 篇

1908.10398 2019-08-29 cs.AI cs.LG cs.RO 79%

A Data-Efficient Deep Learning Approach for Deployable Multimodal Social Robots

Heriberto Cuayáhuitl

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
1908.07738 2019-08-22 cs.IR cs.MM 79%

User Diverse Preference Modeling by Multimodal Attentive Metric Learning

Fan Liu, Zhiyong Cheng, Changchang Sun, Yinglong Wang, Liqiang Nie, Mohan Kankanhalli

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.MM

Comments Accepted by ACM Multimedia 2019 as a full paper

详情

展开后加载摘要…

URL PDF HTML 收藏
1908.05418 2019-08-16 eess.IV cs.CV 79%

Multimodal Volume-Aware Detection and Segmentation for Brain Metastases Radiosurgery

Szu-Yeu Hu, Wei-Hung Weng, Shao-Lun Lu, Yueh-Hung Cheng, Furen Xiao, Feng-Ming Hsu, Jen-Tang Lu

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.CV

Comments Accepted to 2019 MICCAI AIRT

详情

展开后加载摘要…

URL PDF HTML 收藏
1908.05349 2019-08-16 cs.LG cs.CV 79%

Multimodal Emotion Recognition Using Deep Canonical Correlation Analysis

Wei Liu, Jie-Lin Qiu, Wei-Long Zheng, Bao-Liang Lu

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
1907.12023 2019-07-30 eess.IV cs.CV 79%

Two-Stream CNN with Loose Pair Training for Multi-modal AMD Categorization

Weisen Wang, Zhiyan Xu, Weihong Yu, Jianchun Zhao, Jingyuan Yang, Feng He, Zhikun Yang, Di Chen, Dayong Ding, Youxin Chen, Xirong Li

专题命中 多模态评测 :multi-modal(title,abstract);分类 cs.CV

Comments accepted by MICCAI 2019

详情

展开后加载摘要…

URL PDF HTML 收藏
1907.11857 2019-07-30 cs.LG cs.MM stat.ML 79%

Many could be better than all: A novel instance-oriented algorithm for Multi-modal Multi-label problem

Yi Zhang, Cheng Zeng, Hao Cheng, Chongjun Wang, Lei Zhang

专题命中 多模态评测 :multi-modal(title,abstract);分类 cs.MM

Comments To be published in ICME 2019

详情

展开后加载摘要…

URL PDF HTML 收藏
1904.12894 2019-07-29 cs.CV 79%

DiamondGAN: Unified Multi-Modal Generative Adversarial Networks for MRI Sequences Synthesis

Hongwei Li, Johannes C. Paetzold, Anjany Sekuboyina, Florian Kofler, Jianguo Zhang, Jan S. Kirschke, Benedikt Wiestler, Bjoern Menze

专题命中 多模态评测 :multi-modal(title,abstract);分类 cs.CV

Comments accepted by miccai 2019

详情

展开后加载摘要…

URL PDF HTML 收藏
1907.06370 2019-07-16 cs.CV 79%

Multimodal deep networks for text and image-based document classification

Nicolas Audebert, Catherine Herold, Kuider Slimani, Cédric Vidal

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
1810.06553 2019-07-11 cs.CV 79%

Recipe1M+: A Dataset for Learning Cross-Modal Embeddings for Cooking Recipes and Food Images

Javier Marin, Aritro Biswas, Ferda Ofli, Nicholas Hynes, Amaia Salvador, Yusuf Aytar, Ingmar Weber, Antonio Torralba

专题命中 多模态评测 :cross-modal(title);multimodal(abstract);分类 cs.CV

Comments IEEE Transactions on Pattern Analysis and Machine Intelligence

详情

展开后加载摘要…

URL PDF HTML 收藏
1804.02851 2019-07-08 cs.NE cs.AI 79%

Whale swarm algorithm with the mechanism of identifying and escaping from extreme points for multimodal function optimization

Bing Zeng, Xinyu Li, Liang Gao, Yuyan Zhang, Haozhen Dong

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.AI

Comments 28 pages, 11 figures, 9 tables, 39 references

详情

展开后加载摘要…

URL PDF HTML 收藏
1907.00661 2019-07-02 cs.CV 79%

The Resale Price Prediction of Secondhand Jewelry Items Using a Multi-modal Deep Model with Iterative Co-Attention

Yusuke Yamaura, Nobuya Kanemaki, Yukihiro Tsuboshita

专题命中 多模态评测 :multi-modal(title);multimodal(abstract);分类 cs.CV

Comments 10 pages, 6 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
1906.11114 2019-06-27 cs.AI cs.RO 79%

From Multi-modal Property Dataset to Robot-centric Conceptual Knowledge About Household Objects

Madhura Thosar, Christian A. Mueller, Georg Jaeger, Johannes Schleiss, Narender Pulugu, Ravi Mallikarjun Chennaboina, Sai Vivek Jeevangekar, Andreas Birk, Max Pfingsthorn, Sebastian Zug

专题命中 多模态评测 :multi-modal(title,abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
1810.02508 2019-06-05 cs.CL 79%

MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversations

Soujanya Poria, Devamanyu Hazarika, Navonil Majumder, Gautam Naik, Erik Cambria, Rada Mihalcea

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.CL

Comments https://affective-meld.github.io

详情

展开后加载摘要…

URL PDF HTML 收藏
1903.08678 2019-06-04 cs.CL 79%

Probing the Need for Visual Context in Multimodal Machine Translation

Ozan Caglayan, Pranava Madhyastha, Lucia Specia, Loïc Barrault

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.CL

Comments Accepted to NAACL-HLT 2019, reviewer comments addressed, camera-ready

详情

展开后加载摘要…

URL PDF HTML 收藏
1811.00232 2019-06-04 cs.CL 79%

Textbook Question Answering with Multi-modal Context Graph Understanding and Self-supervised Open-set Comprehension

Daesik Kim, Seonhoon Kim, Nojun Kwak

专题命中 多模态评测 :multi-modal(title,abstract);分类 cs.CL

Comments ACL2019 Camera-ready

详情

展开后加载摘要…

URL PDF HTML 收藏
1905.05812 2019-05-16 cs.CL 79%

Multi-task Learning for Multi-modal Emotion Recognition and Sentiment Analysis

Md Shad Akhtar, Dushyant Singh Chauhan, Deepanway Ghosal, Soujanya Poria, Asif Ekbal, Pushpak Bhattacharyya

专题命中 多模态评测 :multi-modal(title,abstract);分类 cs.CL

Comments Accepted for publication in NAACL:HLT-2019

详情

展开后加载摘要…

URL PDF HTML 收藏
1904.09507 2019-04-25 cs.CV 79%

Social Ways: Learning Multi-Modal Distributions of Pedestrian Trajectories with GANs

Javad Amirian, Jean-Bernard Hayet, Julien Pettre

专题命中 多模态评测 :multi-modal(title,abstract);分类 cs.CV

Comments Accepted at CVPR Workshops 2019

详情

展开后加载摘要…

URL PDF HTML 收藏
1811.07548 2019-04-23 cs.CV 79%

iQIYI-VID: A Large Dataset for Multi-modal Person Identification

Yuanliu Liu, Bo Peng, Peipei Shi, He Yan, Yong Zhou, Bing Han, Yi Zheng, Chao Lin, Jianbin Jiang, Yin Fan, Tingwei Gao, Ganwen Wang, Jian Liu, Xiangju Lu, Danming Xie

专题命中 多模态评测 :multi-modal(title,abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
1812.09877 2019-04-09 cs.CV 79%

Latent Filter Scaling for Multimodal Unsupervised Image-to-Image Translation

Yazeed Alharbi, Neil Smith, Peter Wonka

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.CV

Comments Accepted to CVPR2019

详情

展开后加载摘要…

URL PDF HTML 收藏
1904.01649 2019-04-04 cs.CV 79%

MVX-Net: Multimodal VoxelNet for 3D Object Detection

Vishwanath A. Sindagi, Yin Zhou, Oncel Tuzel

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.CV

Comments 7 pages

Journal ref International Conference on Robotics and Automation (ICRA), 2019

详情

展开后加载摘要…

URL PDF HTML 收藏
1812.00408 2019-04-02 cs.CV 79%

A Dataset and Benchmark for Large-scale Multi-modal Face Anti-spoofing

Shifeng Zhang, Xiaobo Wang, Ajian Liu, Chenxu Zhao, Jun Wan, Sergio Escalera, Hailin Shi, Zezheng Wang, Stan Z. Li

专题命中 多模态评测 :multi-modal(title,abstract);分类 cs.CV

Comments CVPR2019 Camera Ready

详情

展开后加载摘要…

URL PDF HTML 收藏
1903.09331 2019-03-25 cs.CV 79%

Unsupervised Deformable Registration for Multi-Modal Images via Disentangled Representations

Chen Qin, Bibo Shi, Rui Liao, Tommaso Mansi, Daniel Rueckert, Ali Kamen

专题命中 多模态评测 :multi-modal(title,abstract);分类 cs.CV

Comments Accepted as an oral presentation in IPMI 2019

详情

展开后加载摘要…

URL PDF HTML 收藏
1903.03591 2019-03-11 cs.RO cs.AI cs.LG 79%

Learning to Identify Object Instances by Touch: Tactile Recognition via Multimodal Matching

Justin Lin, Roberto Calandra, Sergey Levine

专题命中 多模态评测 :multimodal(title);multi-modal(abstract);分类 cs.AI

Comments 6 pages; accepted to IEEE International Conference on Robotics and Automation 2019 (ICRA 2019)

详情

展开后加载摘要…

URL PDF HTML 收藏
1811.04281 2019-03-07 cs.CV 79%

The Method of Multimodal MRI Brain Image Segmentation Based on Differential Geometric Features

Yongpei Zhu, Zicong Zhou, Guojun Liao, Qianxi Yang, Kehong Yuan

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.CV

Comments 18 pages,7 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
1902.05829 2019-02-18 cs.CV 79%

Deeply Supervised Multimodal Attentional Translation Embeddings for Visual Relationship Detection

Nikolaos Gkanatsios, Vassilis Pitsikalis, Petros Koutras, Athanasia Zlatintsi, Petros Maragos

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
1902.00623 2019-02-05 cs.CV 79%

Collaborative Quantization for Cross-Modal Similarity Search

Ting Zhang, Jingdong Wang

专题命中 多模态评测 :cross-modal(title,abstract);分类 cs.CV

Comments CVPR 2016

详情

展开后加载摘要…

URL PDF HTML 收藏
1811.11067 2019-01-17 cs.LG cs.AI stat.ML 79%

Learning State Representations in Complex Systems with Multimodal Data

Pavel Solovev, Vladimir Aliev, Pavel Ostyakov, Gleb Sterkin, Elizaveta Logacheva, Stepan Troeshestov, Roman Suvorov, Anton Mashikhin, Oleg Khomenko, Sergey I. Nikolenko

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.AI

Comments Fixed references

详情

展开后加载摘要…

URL PDF HTML 收藏
1811.00347 2018-12-10 cs.CL 79%

How2: A Large-scale Dataset for Multimodal Language Understanding

Ramon Sanabria, Ozan Caglayan, Shruti Palaskar, Desmond Elliott, Loïc Barrault, Lucia Specia, Florian Metze

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.CL

详情

展开后加载摘要…

URL PDF HTML 收藏
1811.10969 2018-11-29 cs.CV 79%

One-Shot Item Search with Multimodal Data

Jonghwa Yim, Junghun James Kim, Daekyu Shin

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.CV

Comments 6 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
1811.07859 2018-11-21 cs.CV 79%

OrthoSeg: A Deep Multimodal Convolutional Neural Network for Semantic Segmentation of Orthoimagery

Pankaj Bodani, Kumar Shreshtha, Shashikant Sharma

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.CV

Comments 8 pages, 9 figures, 3 tables

Journal ref Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., XLII-5, 621-628, 2018

详情

展开后加载摘要…

URL PDF HTML 收藏