arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 9204 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 多模态评测 9204 篇

2212.13917 2022-12-29 cs.HC cs.CL cs.LG cs.SD eess.SP 74%

Multimodal Emotion Recognition among Couples from Lab Settings to Daily Life using Smartwatches

George Boateng

专题命中 多模态评测 :multimodal(title);分类 cs.CL

Comments PhD Thesis, 2022 - ETH Zurich

详情

展开后加载摘要…

URL PDF HTML 收藏
2205.01414 2022-12-13 cs.CV cs.LG cs.RO 74%

Multimodal Detection of Unknown Objects on Roads for Autonomous Driving

Daniel Bogdoll, Enrico Eisen, Maximilian Nitsche, Christin Scheib, J. Marius Zöllner

专题命中 多模态评测 :multimodal(title);分类 cs.CV

Comments Daniel Bogdoll, Enrico Eisen, Maximilian Nitsche, and Christin Scheib contributed equally. Accepted for publication at SMC 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2211.15071 2022-11-29 cs.CV 74%

Pitfalls of Conditional Batch Normalization for Contextual Multi-Modal Learning

Ivaxi Sheth, Aamer Abdul Rahman, Mohammad Havaei, Samira Ebrahimi Kahou

专题命中 多模态评测 :multi-modal(title);分类 cs.CV

Comments Accepted at ICBINB workshop @ NeurIPS 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2210.04570 2022-10-11 cs.CV 74%

The Eyecandies Dataset for Unsupervised Multimodal Anomaly Detection and Localization

Luca Bonfiglioli, Marco Toschi, Davide Silvestri, Nicola Fioraio, Daniele De Gregorio

专题命中 多模态评测 :multimodal(title);分类 cs.CV

Comments 14 pages, 6 figures. To be published in ACCV 2022. For the website and download links see https://eyecan-ai.github.io/eyecandies

详情

展开后加载摘要…

URL PDF HTML 收藏
2210.04050 2022-10-11 cs.CV 74%

Multi-Modal Human Authentication Using Silhouettes, Gait and RGB

Yuxiang Guo, Cheng Peng, Chun Pong Lau, Rama Chellappa

专题命中 多模态评测 :multi-modal(title);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2106.08409 2022-10-07 cs.AI 74%

Benchmark dataset of memes with text transcriptions for automatic detection of multi-modal misogynistic content

Francesca Gasparini, Giulia Rizzi, Aurora Saibene, Elisabetta Fersini

专题命中 多模态评测 :multi-modal(title);分类 cs.AI

Journal ref Data in brief 44 (2022): 108526

详情

展开后加载摘要…

URL PDF HTML 收藏
2209.07705 2022-09-19 eess.IV cs.CV cs.LG 74%

Automatic Tumor Segmentation via False Positive Reduction Network for Whole-Body Multi-Modal PET/CT Images

Yige Peng, Jinman Kim, Dagan Feng, Lei Bi

专题命中 多模态评测 :multi-modal(title);分类 cs.CV

Comments Pre-print paper for 2022 MICCAI AutoPET Challenge

详情

展开后加载摘要…

URL PDF HTML 收藏
2209.04966 2022-09-13 cs.CV cs.RO 74%

Multi-modal Streaming 3D Object Detection

Mazen Abdelfattah, Kaiwen Yuan, Z. Jane Wang, Rabab Ward

专题命中 多模态评测 :multi-modal(title);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2207.11001 2022-07-25 cs.CV 74%

POP: Mining POtential Performance of new fashion products via webly cross-modal query expansion

Christian Joppi, Geri Skenderi, Marco Cristani

专题命中 多模态评测 :cross-modal(title);分类 cs.CV

Comments ECCV 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2207.10994 2022-07-25 cs.CV cs.LG 74%

Learning Generalized Non-Rigid Multimodal Biomedical Image Registration from Generic Point Set Data

Zachary MC Baum, Tamas Ungi, Christopher Schlenger, Yipeng Hu, Dean C Barratt

专题命中 多模态评测 :multimodal(title);分类 cs.CV

Comments Accepted to ASMUS 2022 Workshop at MICCAI

详情

展开后加载摘要…

URL PDF HTML 收藏
2203.05683 2022-07-22 cs.CV 74%

Deep Multimodal Guidance for Medical Image Classification

Mayur Mallya, Ghassan Hamarneh

专题命中 多模态评测 :multimodal(title);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2206.12503 2022-06-28 cs.AI 74%

Multi-Modal and Multi-Factor Branching Time Active Inference

Théophile Champion, Marek Grześ, Howard Bowman

专题命中 多模态评测 :multi-modal(title);分类 cs.AI

Comments 26 pages, 12 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2206.10436 2022-06-22 cs.CV 74%

Transformer-Based Multi-modal Proposal and Re-Rank for Wikipedia Image-Caption Matching

Nicola Messina, Davide Alessandro Coccomini, Andrea Esuli, Fabrizio Falchi

专题命中 多模态评测 :multi-modal(title);分类 cs.CV

Comments Accepted for publication at the Wiki-M3L workshop, co-located with ICLR 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2205.05918 2022-05-13 cs.CV 74%

Fall detection using multimodal data

Thao V. Ha, Hoang Nguyen, Son T. Huynh, Trung T. Nguyen, Binh T. Nguyen

专题命中 多模态评测 :multimodal(title);分类 cs.CV

Comments 12 pages, 5 figures, 6 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2205.04565 2022-05-11 cs.CV 74%

Is my Depth Ground-Truth Good Enough? HAMMER -- Highly Accurate Multi-Modal Dataset for DEnse 3D Scene Regression

HyunJun Jung, Patrick Ruhkamp, Guangyao Zhai, Nikolas Brasch, Yitong Li, Yannick Verdie, Jifei Song, Yiren Zhou, Anil Armagan, Slobodan Ilic, Ales Leonardis, Benjamin Busam

专题命中 多模态评测 :multi-modal(title);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2204.14062 2022-05-02 cs.LG cs.AI 74%

Multimodal Transformer-based Model for Buchwald-Hartwig and Suzuki-Miyaura Reaction Yield Prediction

Shimaa Baraka, Ahmed M. El Kerdawy

专题命中 多模态评测 :multimodal(title);分类 cs.AI

Comments Presented at Drug Discovery Chemistry 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2011.05602 2022-04-27 cs.LG cs.AI 74%

Joint predictions of multi-modal ride-hailing demands: a deep multi-task multigraph learning-based approach

Jintao Ke, Siyuan Feng, Zheng Zhu, Hai Yang, Jieping Ye

专题命中 多模态评测 :multi-modal(title);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2005.04069 2022-03-24 q-bio.QM cs.CV eess.IV q-bio.GN 74%

Multi-Phase Cross-modal Learning for Noninvasive Gene Mutation Prediction in Hepatocellular Carcinoma

Jiapan Gu, Ziyuan Zhao, Zeng Zeng, Yuzhe Wang, Zhengyiren Qiu, Bharadwaj Veeravalli, Brian Kim Poh Goh, Glenn Kunnath Bonney, Krishnakumar Madhavan, Chan Wan Ying, Lim Kheng Choon, Thng Choon Hua, Pierce KH Chow

专题命中 多模态评测 :cross-modal(title);分类 cs.CV

Comments Accepted version to be published in the 42nd IEEE Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2020, Montreal, Canada

Journal ref 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC)

详情

展开后加载摘要…

URL PDF HTML 收藏
2202.11684 2022-03-09 cs.LG cs.CL cs.CY cs.IR cs.SI 74%

MuMiN: A Large-Scale Multilingual Multimodal Fact-Checked Misinformation Social Network Dataset

Dan Saattrup Nielsen, Ryan McConville

专题命中 多模态评测 :multimodal(title);分类 cs.CL

Comments 9+3 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
2109.09129 2021-10-26 eess.IV cs.CV 74%

Identifying Autism Spectrum Disorder Based on Individual-Aware Down-Sampling and Multi-Modal Learning

Li Pan, Jundong Liu, Mingqin Shi, Chi Wah Wong, Kei Hang Katie Chan

专题命中 多模态评测 :multi-modal(title);分类 cs.CV

Comments for code and support documents, see https://github.com/jhonP-Li/ASD_GP_GCN

详情

展开后加载摘要…

URL PDF HTML 收藏
2003.00951 2021-10-20 cs.CV 74%

DriverMHG: A Multi-Modal Dataset for Dynamic Recognition of Driver Micro Hand Gestures and a Real-Time Recognition Framework

Okan Köpüklü, Thomas Ledwon, Yao Rong, Neslihan Kose, Gerhard Rigoll

专题命中 多模态评测 :multi-modal(title);分类 cs.CV

Comments Accepted to IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020)

详情

展开后加载摘要…

URL PDF HTML 收藏
2110.03535 2021-10-08 q-bio.NC cs.CV cs.LG 74%

A Few-shot Learning Graph Multi-Trajectory Evolution Network for Forecasting Multimodal Baby Connectivity Development from a Baseline Timepoint

Alaa Bessadok, Ahmed Nebli, Mohamed Ali Mahjoub, Gang Li, Weili Lin, Dinggang Shen, Islem Rekik

专题命中 多模态评测 :multimodal(title);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2109.10020 2021-09-23 cs.LG cs.AI 74%

Online Multi-horizon Transaction Metric Estimation with Multi-modal Learning in Payment Networks

Chin-Chia Michael Yeh, Zhongfang Zhuang, Junpeng Wang, Yan Zheng, Javid Ebrahimi, Ryan Mercer, Liang Wang, Wei Zhang

专题命中 多模态评测 :multi-modal(title);分类 cs.AI

Comments 10 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
2106.15004 2021-09-17 cs.CV cs.RO 74%

Multimodal Trajectory Prediction Conditioned on Lane-Graph Traversals

Nachiket Deo, Eric M. Wolff, Oscar Beijbom

专题命中 多模态评测 :multimodal(title);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2011.00958 2021-08-24 cs.HC cs.AI cs.LG 74%

Collection and Validation of Psychophysiological Data from Professional and Amateur Players: a Multimodal eSports Dataset

Anton Smerdov, Bo Zhou, Paul Lukowicz, Andrey Somov

专题命中 多模态评测 :multimodal(title);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2103.11512 2021-08-03 cs.AI cs.RO 74%

Robust Multi-Modal Policies for Industrial Assembly via Reinforcement Learning and Demonstrations: A Large-Scale Study

Jianlan Luo, Oleg Sushkov, Rugile Pevceviciute, Wenzhao Lian, Chang Su, Mel Vecerik, Ning Ye, Stefan Schaal, Jon Scholz

专题命中 多模态评测 :multi-modal(title);分类 cs.AI

Comments RSS 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2105.07621 2021-07-15 cs.CV 74%

Style-Restricted GAN: Multi-Modal Translation with Style Restriction Using Generative Adversarial Networks

Sho Inoue, Tad Gonsalves

专题命中 多模态评测 :multi-modal(title);分类 cs.CV

Comments 20 pages, 11 figures, 6 tables; Our implementation is available at https://github.com/shinshoji01/Style-Restricted_GAN

详情

展开后加载摘要…

URL PDF HTML 收藏
2106.13974 2021-06-29 cs.CV 74%

Semantics-aware Multi-modal Domain Translation:From LiDAR Point Clouds to Panoramic Color Images

Tiago Cortinhal, Fatih Kurnaz, Eren Aksoy

专题命中 多模态评测 :multi-modal(title);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2010.02036 2021-06-08 cs.CV 74%

BalaGAN: Image Translation Between Imbalanced Domains via Cross-Modal Transfer

Or Patashnik, Dov Danon, Hao Zhang, Daniel Cohen-Or

专题命中 多模态评测 :cross-modal(title);分类 cs.CV

Journal ref Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2008.12085 2021-04-01 cs.CV cs.LG eess.IV 74%

DMD: A Large-Scale Multi-Modal Driver Monitoring Dataset for Attention and Alertness Analysis

Juan Diego Ortega, Neslihan Kose, Paola Cañas, Min-An Chao, Alexander Unnervik, Marcos Nieto, Oihana Otaegui, Luis Salgado

专题命中 多模态评测 :multi-modal(title);分类 cs.CV

Comments Accepted to ECCV 2020 workshop - Assistive Computer Vision and Robotics

详情

展开后加载摘要…

URL PDF HTML 收藏