arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 4895 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 其他多模态 4895 篇

2410.15158 2024-10-22 eess.IV cs.CV 74%

Automated Segmentation and Analysis of Cone Photoreceptors in Multimodal Adaptive Optics Imaging

Prajol Shrestha, Mikhail Kulyabin, Aline Sindel, Hilde R. Pedersen, Stuart Gilson, Rigmor Baraas, Andreas Maier

专题命中 其他多模态 :multimodal(title);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.03786 2024-10-08 cs.HC cs.AI cs.CY 74%

AI-rays: Exploring Bias in the Gaze of AI Through a Multimodal Interactive Installation

Ziyao Gao, Yiwen Zhang, Ling Li, Theodoros Papatheodorou, Wei Zeng

专题命中 其他多模态 :multimodal(title);分类 cs.AI

Comments Siggraph Asia 2024 Art Paper

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.03725 2024-10-08 cs.CL 74%

Realtime, multimodal invasive ventilation risk monitoring using language models and BoXHED

Arash Pakbin, Aaron Su, Donald K. K. Lee, Bobak J. Mortazavi

专题命中 其他多模态 :multimodal(title);分类 cs.CL

详情

展开后加载摘要…

URL PDF HTML 收藏
2409.11128 2024-09-18 cs.CV 74%

Genetic Information Analysis of Age-Related Macular Degeneration Fellow Eye Using Multi-Modal Selective ViT

Yoichi Furukawa, Satoshi Kamiya, Yoichi Sakurada, Kenji Kashiwagi, Kazuhiro Hotta

专题命中 其他多模态 :multi-modal(title);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2408.17233 2024-09-02 cs.AI 74%

A methodological framework for Resilience as a Service (RaaS) in multimodal urban transportation networks

Sara Jaber, Mostafa Ameli, S. M. Hassan Mahdavi, Neila Bhouri

专题命中 其他多模态 :multimodal(title);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2310.08574 2024-06-26 cs.HC cs.AI cs.LG 74%

Jigsaw: Supporting Designers to Prototype Multimodal Applications by Chaining AI Foundation Models

David Chuan-En Lin, Nikolas Martelaro

专题命中 其他多模态 :multimodal(title);分类 cs.AI

Comments https://jigsaw.to

详情

展开后加载摘要…

URL PDF HTML 收藏
2401.04206 2024-06-14 cs.HC cs.AI cs.RO 74%

Effects of Multimodal Explanations for Autonomous Driving on Driving Performance, Cognitive Load, Expertise, Confidence, and Trust

Robert Kaufman, Jean Costa, Everlyne Kimani

专题命中 其他多模态 :multimodal(title);分类 cs.AI

Comments 14 pages, published in Scientific Reports

Journal ref Scientific Reports volume 14, Article number: 13061 (2024)

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.07163 2024-05-14 physics.ed-ph cs.AI 74%

Realizing Visual Question Answering for Education: GPT-4V as a Multimodal AI

Gyeong-Geon Lee, Xiaoming Zhai

专题命中 其他多模态 :multimodal(title);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2201.09207 2024-03-19 cs.CV 74%

Visual Object Tracking on Multi-modal RGB-D Videos: A Review

Xue-Feng Zhu, Tianyang Xu, Xiao-Jun Wu

专题命中 其他多模态 :multi-modal(title);分类 cs.CV

Comments I prefer not to present this paper due to its subpar quality

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.07407 2024-03-13 cs.CV 74%

In-context learning enables multimodal large language models to classify cancer pathology images

Dyke Ferber, Georg Wölflein, Isabella C. Wiest, Marta Ligero, Srividhya Sainath, Narmin Ghaffari Laleh, Omar S. M. El Nahhas, Gustav Müller-Franzes, Dirk Jäger, Daniel Truhn, Jakob Nikolas Kather

专题命中 其他多模态 :multimodal(title);分类 cs.CV

Comments 40 pages, 5 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.15779 2024-02-27 cs.CR cs.AI cs.IR 74%

Cryptanalysis and improvement of multimodal data encryption by machine-learning-based system

Zakaria Tolba

专题命中 其他多模态 :multimodal(title);分类 cs.AI

Comments Doctoral thesis. Keywords: Cryptanalysis, Black-box, Deep learning, Machine learning, Ciphertext, Plaintext, Genetic algorithm, Permutation box, Substitution Box

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.08035 2024-02-14 cs.CV 74%

Multiple Random Masking Autoencoder Ensembles for Robust Multimodal Semi-supervised Learning

Alexandru-Raul Todoran, Marius Leordeanu

专题命中 其他多模态 :multimodal(title);分类 cs.CV

Comments 17 pages, 11 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2401.01487 2024-01-04 cs.LG cs.CL 74%

Natural Language Processing and Multimodal Stock Price Prediction

Kevin Taylor, Jerry Ng

专题命中 其他多模态 :multimodal(title);分类 cs.CL

Comments 13 pages, 13 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2311.01520 2023-11-21 cs.CV cs.RO 74%

4D-Former: Multimodal 4D Panoptic Segmentation

Ali Athar, Enxu Li, Sergio Casas, Raquel Urtasun

专题命中 其他多模态 :multimodal(title);分类 cs.CV

Comments accepted at CoRL 2023

详情

展开后加载摘要…

URL PDF HTML 收藏
2305.14083 2023-11-01 cs.LG cs.CL 74%

Counterfactual Augmentation for Multimodal Learning Under Presentation Bias

Victoria Lin, Louis-Philippe Morency, Dimitrios Dimitriadis, Srinagesh Sharma

专题命中 其他多模态 :multimodal(title);分类 cs.CL

Comments Accepted to Findings of EMNLP 2023

详情

展开后加载摘要…

URL PDF HTML 收藏
2308.10627 2023-08-22 cs.CV 74%

Polarimetric Information for Multi-Modal 6D Pose Estimation of Photometrically Challenging Objects with Limited Data

Patrick Ruhkamp, Daoyi Gao, HyunJun Jung, Nassir Navab, Benjamin Busam

专题命中 其他多模态 :multi-modal(title);分类 cs.CV

Comments Accepted at ICCV 2023 TRICKY Workshop

详情

展开后加载摘要…

URL PDF HTML 收藏
2307.11921 2023-07-25 cs.LG cs.CV 74%

Poverty rate prediction using multi-modal survey and earth observation data

Simone Fobi, Manuel Cardona, Elliott Collins, Caleb Robinson, Anthony Ortiz, Tina Sederholm, Rahul Dodhia, Juan Lavista Ferres

专题命中 其他多模态 :multi-modal(title);分类 cs.CV

Comments In 2023 ACM SIGCAS/SIGCHI Conference on Computing and Sustainable Societies (COMPASS 23) Short Papers Track

详情

展开后加载摘要…

URL PDF HTML 收藏
2306.09851 2023-06-19 cs.CV 74%

Joint multi-modal Self-Supervised pre-training in Remote Sensing: Application to Methane Source Classification

Paul Berg, Minh-Tan Pham, Nicolas Courty

专题命中 其他多模态 :multi-modal(title);分类 cs.CV

Comments 4 pages, 1 figure. Accepted to IGARSS 2023

详情

展开后加载摘要…

URL PDF HTML 收藏
2302.14124 2023-03-01 eess.IV cs.CV 74%

Multimodal Deep Learning to Differentiate Tumor Recurrence from Treatment Effect in Human Glioblastoma

Tonmoy Hossain, Zoraiz Qureshi, Nivetha Jayakumar, Thomas Eluvathingal Muttikkal, Sohil Patel, David Schiff, Miaomiao Zhang, Bijoy Kundu

专题命中 其他多模态 :multimodal(title);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2212.04812 2022-12-12 cs.CV cs.LG 74%

Reliable Multimodal Trajectory Prediction via Error Aligned Uncertainty Optimization

Neslihan Kose, Ranganath Krishnan, Akash Dhamasia, Omesh Tickoo, Michael Paulitsch

专题命中 其他多模态 :multimodal(title);分类 cs.CV

Comments Accepted to ECCV 2022 workshop - Safe Artificial Intelligence for Automated Driving

详情

展开后加载摘要…

URL PDF HTML 收藏
2212.03968 2022-12-09 cs.CV 74%

Multimodal Vision Transformers with Forced Attention for Behavior Analysis

Tanay Agrawal, Michal Balazia, Philipp Müller, François Brémond

专题命中 其他多模态 :multimodal(title);分类 cs.CV

Comments Preprint. Full paper accepted at the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, USA, Jan 2023. 11 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
2008.11921 2022-10-14 eess.IV cs.CV 74%

Unsupervised MRI Super-Resolution Using Deep External Learning and Guided Residual Dense Network with Multimodal Image Priors

Yutaro Iwamoto, Kyohei Takeda, Yinhao Li, Akihiko Shiino, Yen-Wei Chen

专题命中 其他多模态 :multimodal(title);分类 cs.CV

Comments 10 pages, 3 figures, Accepted by IEEE Transactions on Emerging Topics in Computational Intelligence (TETCI)

详情

展开后加载摘要…

URL PDF HTML 收藏
2208.10553 2022-09-28 cs.CV cs.CR cs.DC 74%

Split-U-Net: Preventing Data Leakage in Split Learning for Collaborative Multi-Modal Brain Tumor Segmentation

Holger R. Roth, Ali Hatamizadeh, Ziyue Xu, Can Zhao, Wenqi Li, Andriy Myronenko, Daguang Xu

专题命中 其他多模态 :multi-modal(title);分类 cs.CV

Comments Accepted to DeCaF 2022 held in conjunction with MICCAI 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2207.09953 2022-07-21 cs.CV cs.LG cs.RO 74%

Learning Pedestrian Group Representations for Multi-modal Trajectory Prediction

Inhwan Bae, Jin-Hwi Park, Hae-Gon Jeon

专题命中 其他多模态 :multi-modal(title);分类 cs.CV

Comments Accepted at ECCV 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2106.16031 2022-07-21 eess.IV cs.CV 74%

ResViT: Residual vision transformers for multi-modal medical image synthesis

Onat Dalmaz, Mahmut Yurt, Tolga Çukur

专题命中 其他多模态 :multi-modal(title);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2207.06695 2022-07-15 cs.CV 74%

DavarOCR: A Toolbox for OCR and Multi-Modal Document Understanding

Liang Qiao, Hui Jiang, Ying Chen, Can Li, Pengfei Li, Zaisheng Li, Baorui Zou, Dashan Guo, Yingda Xu, Yunlu Xu, Zhanzhan Cheng, Yi Niu

专题命中 其他多模态 :multi-modal(title);分类 cs.CV

Comments Short paper, Accept by ACM MM2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2110.11684 2022-03-15 eess.IV cs.CV 74%

Multimodal-Boost: Multimodal Medical Image Super-Resolution using Multi-Attention Network with Wavelet Transform

Fayaz Ali Dharejo, Muhammad Zawish, Farah Deeba Yuanchun Zhou, Kapal Dev, Sunder Ali Khowaja, Nawab Muhammad Faseeh Qureshi

专题命中 其他多模态 :multimodal(title);分类 cs.CV

Comments 14 pages, 13 Figures, and 3 Tables. Submitted to IEEE/ACM TCBB

详情

展开后加载摘要…

URL PDF HTML 收藏
2003.09572 2022-03-14 cs.CV 74%

Monocular Real-time Hand Shape and Motion Capture using Multi-modal Data

Yuxiao Zhou, Marc Habermann, Weipeng Xu, Ikhsanul Habibie, Christian Theobalt, Feng Xu

专题命中 其他多模态 :multi-modal(title);分类 cs.CV

Comments Accepted by CVPR 2020

详情

展开后加载摘要…

URL PDF HTML 收藏
2201.09693 2022-02-07 eess.IV cs.CV cs.LG 74%

Shape-consistent Generative Adversarial Networks for multi-modal Medical segmentation maps

Leo Segre, Or Hirschorn, Dvir Ginzburg, Dan Raviv

专题命中 其他多模态 :multi-modal(title);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2201.12386 2022-02-01 eess.IV cs.CV 74%

Few-shot Unsupervised Domain Adaptation for Multi-modal Cardiac Image Segmentation

Mingxuan Gu, Sulaiman Vesal, Ronak Kosti, Andreas Maier

专题命中 其他多模态 :multi-modal(title);分类 cs.CV

Comments Accepted t0 BVM2022

详情

展开后加载摘要…

URL PDF HTML 收藏