arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 9189 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 多模态评测 9189 篇

2102.04139 2021-02-09 cs.CV 79%

APS: A Large-Scale Multi-Modal Indoor Camera Positioning System

Ali Ghofrani, Rahil Mahdian Toroghi, Seyed Mojtaba Tabatabaie

专题命中 多模态评测 :multi-modal(title,abstract);分类 cs.CV

Comments 15 pages, 11 figures, MedPRAI 2020

详情

展开后加载摘要…

URL PDF HTML 收藏
2007.07758 2021-01-19 cs.CL cs.LG 79%

Multimodal Word Sense Disambiguation in Creative Practice

Manuel Ladron de Guevara, Christopher George, Akshat Gupta, Daragh Byrne, Ramesh Krishnamurti

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.CL

Comments 9 pages, 5 figures, 2 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2012.15318 2021-01-01 eess.IV cs.CV 79%

H2NF-Net for Brain Tumor Segmentation using Multimodal MR Imaging: 2nd Place Solution to BraTS Challenge 2020 Segmentation Task

Haozhe Jia, Weidong Cai, Heng Huang, Yong Xia

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.CV

Comments Accepted by MICCAI BrainLesion Workshop 2020

详情

展开后加载摘要…

URL PDF HTML 收藏
2012.14833 2021-01-01 cs.CV cs.RO 79%

Visual-Thermal Camera Dataset Release and Multi-Modal Alignment without Calibration Information

Frank Mascarich, Kostas Alexis

专题命中 多模态评测 :multi-modal(title,abstract);分类 cs.CV

Comments 8 pages, 8 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2012.07098 2020-12-15 cs.CV 79%

MSVD-Turkish: A Comprehensive Multimodal Dataset for Integrated Vision and Language Research in Turkish

Begum Citamak, Ozan Caglayan, Menekse Kuyu, Erkut Erdem, Aykut Erdem, Pranava Madhyastha, Lucia Specia

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2012.04176 2020-12-09 cs.CV 79%

Multi-modal Visual Tracking: Review and Experimental Comparison

Pengyu Zhang, Dong Wang, Huchuan Lu

专题命中 多模态评测 :multi-modal(title,abstract);分类 cs.CV

Comments 39 pages, 9 figures, 7 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2012.03711 2020-12-08 cs.CV cs.LG 79%

Combining Deep Transfer Learning with Signal-image Encoding for Multi-Modal Mental Wellbeing Classification

Kieran Woodward, Eiman Kanjo, Athanasios Tsanas

专题命中 多模态评测 :multi-modal(title);multimodal(abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2011.11759 2020-11-25 eess.IV cs.CV cs.PF 79%

Patch-based field-of-view matching in multi-modal images for electroporation-based ablations

Luc Lafitte, Rémi Giraud, Cornel Zachiu, Mario Ries, Olivier Sutter, Antoine Petit, Olivier Seror, Clair Poignard, Baudouin Denis de Senneville

专题命中 多模态评测 :multi-modal(title,abstract);分类 cs.CV

Comments 22 pages, 9 figures

Journal ref Computerized Medical Imaging and Graphics (2020)

详情

展开后加载摘要…

URL PDF HTML 收藏
2010.01440 2020-11-20 cs.LG cs.SD eess.AS q-bio.QM 79%

Uncertainty-Aware Multi-Modal Ensembling for Severity Prediction of Alzheimer's Dementia

Utkarsh Sarawgi, Wazeer Zulfikar, Rishab Khincha, Pattie Maes

专题命中 多模态评测 :multi-modal(title,abstract);分类 eess.AS

Comments To appear at NeurIPS Machine Learning for Health (ML4H) 2020

详情

展开后加载摘要…

URL PDF HTML 收藏
2011.06214 2020-11-13 cs.CV 79%

Unimodal Cyclic Regularization for Training Multimodal Image Registration Networks

Zhe Xu, Jiangpeng Yan, Jie Luo, William Wells, Xiu Li, Jayender Jagadeesan

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.CV

Comments 5 pages, 5 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2011.04389 2020-11-12 cs.CV 79%

EDEN: Multimodal Synthetic Dataset of Enclosed GarDEN Scenes

Hoang-An Le, Thomas Mensink, Partha Das, Sezer Karaoglu, Theo Gevers

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.CV

Comments Accepted for publishing at WACV 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2011.03894 2020-11-10 cs.RO cs.AI cs.LG cs.MA 79%

Multimodal Trajectory Prediction via Topological Invariance for Navigation at Uncontrolled Intersections

Junha Roh, Christoforos Mavrogiannis, Rishabh Madan, Dieter Fox, Siddhartha S. Srinivasa

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.AI

Comments Preprint of a paper with the same title, accepted to the Conference on Robot Learning 2020

详情

展开后加载摘要…

URL PDF HTML 收藏
2011.00694 2020-11-03 cs.CV eess.IV 79%

Multi-Modal Active Learning for Automatic Liver Fibrosis Diagnosis based on Ultrasound Shear Wave Elastography

Lufei Gao, Ruisong Zhou, Changfeng Dong, Cheng Feng, Zhen Li, Xiang Wan, Li Liu

专题命中 多模态评测 :multi-modal(title,abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2004.03180 2020-10-26 cs.CL 79%

Towards Multimodal Simultaneous Neural Machine Translation

Aizhan Imankulova, Masahiro Kaneko, Tosho Hirasawa, Mamoru Komachi

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.CL

Comments 10 pages; WMT 2020

详情

展开后加载摘要…

URL PDF HTML 收藏
2008.00932 2020-10-20 cs.CV 79%

AUTSL: A Large Scale Multi-modal Turkish Sign Language Dataset and Baseline Methods

Ozge Mercanoglu Sincan, Hacer Yalim Keles

专题命中 多模态评测 :multi-modal(title,abstract);分类 cs.CV

Comments Preprint of the accepted paper at IEEE Access Journal. The revised version contains empirical results with Montalbano dataset, in addition to AUTSL. The abstract is revised accordingly

Journal ref IEEE Access (2020), vol. 8, pp. 181340-181355

详情

展开后加载摘要…

URL PDF HTML 收藏
2005.03545 2020-10-20 cs.CL cs.LG 79%

MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysis

Devamanyu Hazarika, Roger Zimmermann, Soujanya Poria

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.CL

Comments Accepted at ACM MM 2020 (Oral Paper)

详情

展开后加载摘要…

URL PDF HTML 收藏
2010.01114 2020-10-05 cs.CV 79%

Goal-GAN: Multimodal Trajectory Prediction Based on Goal Position Estimation

Patrick Dendorfer, Aljoša Ošep, Laura Leal-Taixé

专题命中 多模态评测 :multimodal(title);multi-modal(abstract);分类 cs.CV

Comments Oral presentation at ACCV 2020

详情

展开后加载摘要…

URL PDF HTML 收藏
2007.14987 2020-09-29 cs.RO cs.CL cs.HC 79%

Presentation and Analysis of a Multimodal Dataset for Grounded Language Learning

Patrick Jenkins, Rishabh Sachdeva, Gaoussou Youssouf Kebe, Padraig Higgins, Kasra Darvish, Edward Raff, Don Engel, John Winder, Francis Ferraro, Cynthia Matuszek

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.CL

Comments 11 pages, 6 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2009.10644 2020-09-23 stat.ML cs.AI cs.CR cs.LG 79%

Using Neural Architecture Search for Improving Software Flaw Detection in Multimodal Deep Learning Models

Alexis Cooper, Xin Zhou, Scott Heidbrink, Daniel M. Dunlavy

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.AI

Comments 10 pages, 5 figures, 4 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2009.06200 2020-09-15 cs.CV cs.LG 79%

Learning from Multimodal and Multitemporal Earth Observation Data for Building Damage Mapping

Bruno Adriano, Naoto Yokoya, Junshi Xia, Hiroyuki Miura, Wen Liu, Masashi Matsuoka, Shunichi Koshimura

专题命中 多模态评测 :multimodal(title);cross-modal(abstract);分类 cs.CV

Comments 15 pages, 6 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2005.04120 2020-09-15 cs.HC cs.AI 79%

K-EmoCon, a multimodal sensor dataset for continuous emotion recognition in naturalistic conversations

Cheul Young Park, Narae Cha, Soowon Kang, Auk Kim, Ahsan Habib Khandoker, Leontios Hadjileontiadis, Alice Oh, Yong Jeong, Uichin Lee

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.AI

Comments 20 pages, 4 figures, for associated dataset, see https://doi.org/10.5281/zenodo.3814370

Journal ref Sci Data 7, (2020) 293

详情

展开后加载摘要…

URL PDF HTML 收藏
2009.00700 2020-09-03 eess.AS cs.LG cs.SD stat.ML 79%

Multimodal Inductive Transfer Learning for Detection of Alzheimer's Dementia and its Severity

Utkarsh Sarawgi, Wazeer Zulfikar, Nouran Soliman, Pattie Maes

专题命中 多模态评测 :multimodal(title,abstract);分类 eess.AS

Comments To appear in INTERSPEECH 2020

详情

展开后加载摘要…

URL PDF HTML 收藏
2008.08735 2020-08-21 cs.CV 79%

Simultaneously-Collected Multimodal Lying Pose Dataset: Towards In-Bed Human Pose Monitoring under Adverse Vision Conditions

Shuangjun Liu, Xiaofei Huang, Nihang Fu, Cheng Li, Zhongnan Su, Sarah Ostadabbas

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2006.02662 2020-08-17 cs.CV eess.IV 79%

Exploiting the Transferability of Deep Learning Systems Across Multi-modal Retinal Scans for Extracting Retinopathy Lesions

Taimur Hassan, Muhammad Usman Akram, Naoufel Werghi

专题命中 多模态评测 :multi-modal(title,abstract);分类 cs.CV

Comments Accepted in the 20th IEEE International Conference on BioInformatics And BioEngineering (BIBE), 2020

详情

展开后加载摘要…

URL PDF HTML 收藏
2008.03435 2020-08-11 eess.IV cs.CV cs.LG 79%

Auto-weighting for Breast Cancer Classification in Multimodal Ultrasound

Wang Jian, Miao Juzheng, Yang Xin, Li Rui, Zhou Guangquan, Huang Yuhao, Lin Zehui, Xue Wufeng, Jia Xiaohong, Zhou Jianqiao, Huang Ruobing, Ni Dong

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.CV

Comments Early Accepted by MICCAI 2020

详情

展开后加载摘要…

URL PDF HTML 收藏
2004.04807 2020-07-17 cs.CV cs.LG cs.RO eess.IV 79%

6D Camera Relocalization in Ambiguous Scenes via Continuous Multimodal Inference

Mai Bui, Tolga Birdal, Haowen Deng, Shadi Albarqouni, Leonidas Guibas, Slobodan Ilic, Nassir Navab

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.CV

Comments Accepted for publication at ECCV 2020. Project page under https://multimodal3dvision.github.io

详情

展开后加载摘要…

URL PDF HTML 收藏
2006.12906 2020-07-14 cs.CV cs.RO 79%

Probabilistic Crowd GAN: Multimodal Pedestrian Trajectory Prediction using a Graph Vehicle-Pedestrian Attention Network

Stuart Eiffert, Kunming Li, Mao Shan, Stewart Worrall, Salah Sukkarieh, Eduardo Nebot

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.CV

Comments Accepted for publication in IEEE Robotics and Automation Letters (RA-L) Copyright may be transferred without notice, after which this version may no longer be accessible

详情

展开后加载摘要…

URL PDF HTML 收藏
1904.06618 2020-07-02 cs.LG cs.CL stat.ML 79%

UR-FUNNY: A Multimodal Language Dataset for Understanding Humor

Md Kamrul Hasan, Wasifur Rahman, Amir Zadeh, Jianyuan Zhong, Md Iftekhar Tanveer, Louis-Philippe Morency, Mohammed, Hoque

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.CL

Journal ref EMNLP-IJCNLP, 2019, 2046-2056

详情

展开后加载摘要…

URL PDF HTML 收藏
2006.00923 2020-06-26 cs.CV 79%

Multimodal grid features and cell pointers for Scene Text Visual Question Answering

Lluís Gómez, Ali Furkan Biten, Rubèn Tito, Andrés Mafla, Marçal Rusiñol, Ernest Valveny, Dimosthenis Karatzas

专题命中 多模态评测 :multimodal(title);multi-modal(abstract);分类 cs.CV

Comments This paper is under consideration at Pattern Recognition Letters

详情

展开后加载摘要…

URL PDF HTML 收藏
1906.03631 2020-06-09 cs.CV 79%

Overcoming Limitations of Mixture Density Networks: A Sampling and Fitting Framework for Multimodal Future Prediction

Osama Makansi, Eddy Ilg, Özgün Cicek, Thomas Brox

专题命中 多模态评测 :multimodal(title,abstract);分类 cs.CV

Comments In CVPR 2019

详情

展开后加载摘要…

URL PDF HTML 收藏