多模态大模型

HouseCat6D -- A Large-Scale Multi-Modal Category Level 6D Object Perception Dataset with Household Objects in Realistic Scenarios

HyunJun Jung, Guangyao Zhai, Shun-Cheng Wu, Patrick Ruhkamp, Hannah Schieber, Giulia Rizzoli, Pengyuan Wang, Hongcheng Zhao, Lorenzo Garattoni, Sven Meier, Daniel Roth, Nassir Navab, Benjamin Busam

专题命中 多模态评测 ：multi-modal(title)；分类 cs.CV

Multimodal Identification of Alzheimer's Disease: A Review

Guian Fang, Mengsha Liu, Yi Zhong, Zhuolin Zhang, Jiehui Huang, Zhenchao Tang, Calvin Yu-Chian Chen

专题命中 多模态评测 ：multimodal(title)；分类 cs.CV

Accommodating Missing Modalities in Time-Continuous Multimodal Emotion Recognition

Juan Vazquez-Rodriguez, Grégoire Lefebvre, Julien Cumin, James L. Crowley

专题命中 多模态评测 ：multimodal(title)；分类 cs.AI

Journal ref Affective Computing and Intelligent Interaction (ACII), Sep 2023, Cambridge (MA), United States

Multimodal Large Language Model for Visual Navigation

Yao-Hung Hubert Tsai, Vansh Dhar, Jialu Li, Bowen Zhang, Jian Zhang

专题命中 多模态评测 ：multimodal(title)；分类 cs.CV

InfraParis: A multi-modal and multi-task autonomous driving dataset

Gianni Franchi, Marwane Hariat, Xuanlong Yu, Nacim Belkhir, Antoine Manzanera, David Filliat

专题命中 多模态评测 ：multi-modal(title)；分类 cs.CV

Comments 15 pages, 7 figures. Accepted at WACV 2024

ZRG: A Dataset for Multimodal 3D Residential Rooftop Understanding

Isaac Corley, Jonathan Lwowski, Peyman Najafirad

专题命中 多模态评测 ：multimodal(title)；分类 cs.CV

Comments 9 pages, Preprint accepted to WACV 2024

FLODCAST: Flow and Depth Forecasting via Multimodal Recurrent Architectures

Andrea Ciamarra, Federico Becattini, Lorenzo Seidenari, Alberto Del Bimbo

专题命中 多模态评测 ：multimodal(title)；分类 cs.CV

Comments Submitted to Pattern Recognition

Graph-based multimodal multi-lesion DLBCL treatment response prediction from PET images

Oriane Thiery, Mira Rizkallah, Clément Bailly, Caroline Bodet-Milin, Emmanuel Itti, René-Olivier Casasnovas, Steven Le Gouill, Thomas Carlier, Diana Mateus

专题命中 多模态评测 ：multimodal(title)；分类 cs.AI

Journal ref AI4Treat, Oct 2023, Vancouver (Canada), Canada

A Multi-Modal Multilingual Benchmark for Document Image Classification

Yoshinari Fujinuma, Siddharth Varia, Nishant Sankaran, Srikar Appalaraju, Bonan Min, Yogarshi Vyas

专题命中 多模态评测 ：multi-modal(title)；分类 cs.CL

Comments Accepted to EMNLP 2023 (Findings)

Grounded and Well-rounded: A Methodological Approach to the Study of Cross-modal and Cross-lingual Grounding

Timothee Mickus, Elaine Zosa, Denis Paperno

专题命中 多模态评测 ：cross-modal(title)；分类 cs.CL

Comments accepted to Findings of EMNLP 2023

OpenViVQA: Task, Dataset, and Multimodal Fusion Models for Visual Question Answering in Vietnamese

Nghia Hieu Nguyen, Duong T. D. Vo, Kiet Van Nguyen, Ngan Luu-Thuy Nguyen

专题命中 多模态评测 ：multimodal(title)；分类 cs.CL

Comments submitted to Elsevier

Beyond Interpretable Benchmarks: Contextual Learning through Cognitive and Multimodal Perception

Nick DiSanto

专题命中 多模态评测 ：multimodal(title)；分类 cs.AI

Tensor Factorization for Leveraging Cross-Modal Knowledge in Data-Constrained Infrared Object Detection

Manish Sharma, Moitreya Chatterjee, Kuan-Chuan Peng, Suhas Lohit, Michael Jones

专题命中 多模态评测 ：cross-modal(title)；分类 cs.CV

Comments Accepted to ICCV 2023, LIMIT Workshop. The first two authors contributed equally

Metastatic Breast Cancer Prognostication Through Multimodal Integration of Dimensionality Reduction Algorithms and Classification Algorithms

Bliss Singhal, Fnu Pooja

专题命中 多模态评测 ：multimodal(title)；分类 cs.AI

Comments 10 pages, 14 figures

NTU4DRadLM: 4D Radar-centric Multi-Modal Dataset for Localization and Mapping

Jun Zhang, Huayang Zhuge, Yiyao Liu, Guohao Peng, Zhenyu Wu, Haoyuan Zhang, Qiyang Lyu, Heshan Li, Chunyang Zhao, Dogan Kircali, Sanat Mharolkar, Xun Yang, Su Yi, Yuanzhe Wang, Danwei Wang

专题命中 多模态评测 ：multi-modal(title)；分类 cs.CV

Comments 2023 IEEE International Intelligent Transportation Systems Conference (ITSC 2023)

Deep Boosting Multi-Modal Ensemble Face Recognition with Sample-Level Weighting

Sahar Rahimi Malakshan, Mohammad Saeed Ebrahimi Saadabadi, Nima Najafzadeh, Nasser M. Nasrabadi

专题命中 多模态评测 ：multi-modal(title)；分类 cs.CV

Comments 2023 IEEE International Joint Conference on Biometrics (IJCB)

M$^2$-3DLaneNet: Exploring Multi-Modal 3D Lane Detection

Yueru Luo, Xu Yan, Chaoda Zheng, Chao Zheng, Shuqi Mei, Tang Kun, Shuguang Cui, Zhen Li

专题命中 多模态评测 ：multi-modal(title)；分类 cs.CV

Comments update

Multimodal Indoor Localisation in Parkinson's Disease for Detecting Medication Use: Observational Pilot Study in a Free-Living Setting

Ferdian Jovan, Catherine Morgan, Ryan McConville, Emma L. Tonkin, Ian Craddock, Alan Whone

专题命中 多模态评测 ：multimodal(title)；分类 cs.AI

Comments 11 pages, 4 figures, 4 tables

Journal ref Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD 2023)

AircraftVerse: A Large-Scale Multimodal Dataset of Aerial Vehicle Designs

Adam D. Cobb, Anirban Roy, Daniel Elenius, F. Michael Heim, Brian Swenson, Sydney Whittington, James D. Walker, Theodore Bapty, Joseph Hite, Karthik Ramani, Christopher McComb, Susmit Jha

专题命中 多模态评测 ：multimodal(title)；分类 cs.AI

Comments The dataset is hosted at https://zenodo.org/record/6525446, baseline models and code at https://github.com/SRI-CSL/AircraftVerse, and the dataset description at https://aircraftverse.onrender.com/

Privacy in Multimodal Federated Human Activity Recognition

Alex Iacob, Pedro P. B. Gusmão, Nicholas D. Lane, Armand K. Koupai, Mohammud J. Bocus, Raúl Santos-Rodríguez, Robert J. Piechocki, Ryan McConville

专题命中 多模态评测 ：multimodal(title)；分类 cs.AI

Comments In 3rd On-Device Intelligence Workshop at MLSys 2023, 8 pages

MindBigData 2023 MNIST-8B The 8 billion datapoints Multimodal Dataset of Brain Signals

David Vivancos

专题命中 多模态评测 ：multimodal(title)；分类 cs.CV

Comments 9 pages, 10 figures

A Multi-modal Garden Dataset and Hybrid 3D Dense Reconstruction Framework Based on Panoramic Stereo Images for a Trimming Robot

Can Pu, Chuanyu Yang, Jinnian Pu, Radim Tylecek, Robert B. Fisher

专题命中 多模态评测 ：multi-modal(title)；分类 cs.CV

Comments 32 pages

SparseFusion: Fusing Multi-Modal Sparse Representations for Multi-Sensor 3D Object Detection

Yichen Xie, Chenfeng Xu, Marie-Julie Rakotosaona, Patrick Rim, Federico Tombari, Kurt Keutzer, Masayoshi Tomizuka, Wei Zhan

专题命中 多模态评测 ：multi-modal(title)；分类 cs.CV

Segmentation of glioblastomas in early post-operative multi-modal MRI with deep neural networks

Ragnhild Holden Helland, Alexandros Ferles, André Pedersen, Ivar Kommers, Hilko Ardon, Frederik Barkhof, Lorenzo Bello, Mitchel S. Berger, Tora Dunås, Marco Conti Nibali, Julia Furtner, Shawn Hervey-Jumper, Albert J. S. Idema, Barbara Kiesel, Rishi Nandoe Tewari, Emmanuel Mandonnet, Domenique M. J. Müller, Pierre A. Robe, Marco Rossi, Lisa M. Sagberg, Tommaso Sciortino, Tom Aalders, Michiel Wagemakers, Georg Widhalm, Marnix G. Witte, Aeilko H. Zwinderman, Paulina L. Majewska, Asgeir S. Jakola, Ole Solheim, Philip C. De Witt Hamer, Ingerid Reinertsen, Roelant S. Eijgelaar, David Bouget

专题命中 多模态评测 ：multi-modal(title)；分类 cs.CV

Comments 13 pages, 4 figures, 4 tables

SUPRA: Superpixel Guided Loss for Improved Multi-modal Segmentation in Endoscopy

Rafael Martinez-Garcia-Peña, Mansoor Ali Teevno, Gilberto Ochoa-Ruiz, Sharib Ali

专题命中 多模态评测 ：multi-modal(title)；分类 cs.CV

Comments This work has been accepted at the LatinX in Computer Vision Research Workshop at CVPR 2023

CIMI4D: A Large Multimodal Climbing Motion Dataset under Human-scene Interactions

Ming Yan, Xin Wang, Yudi Dai, Siqi Shen, Chenglu Wen, Lan Xu, Yuexin Ma, Cheng Wang

专题命中 多模态评测 ：multimodal(title)；分类 cs.CV

Comments CVPR 2023

Virtual Sparse Convolution for Multimodal 3D Object Detection

Hai Wu, Chenglu Wen, Shaoshuai Shi, Xin Li, Cheng Wang

专题命中 多模态评测 ：multimodal(title)；分类 cs.CV

Comments Accepted by CVPR 2023

Interpretable Medical Image Visual Question Answering via Multi-Modal Relationship Graph Learning

Xinyue Hu, Lin Gu, Kazuma Kobayashi, Qiyuan An, Qingyu Chen, Zhiyong Lu, Chang Su, Tatsuya Harada, Yingying Zhu

专题命中 多模态评测 ：multi-modal(title)；分类 cs.CV

The RW3D: A multi-modal panel dataset to understand the psychological impact of the pandemic

Isabelle van der Vegt, Bennett Kleinberg

专题命中 多模态评测 ：multi-modal(title)；分类 cs.CL

Comments preprint

LoRaLay: A Multilingual and Multimodal Dataset for Long Range and Layout-Aware Summarization

Laura Nguyen, Thomas Scialom, Benjamin Piwowarski, Jacopo Staiano

专题命中 多模态评测 ：multimodal(title)；分类 cs.CL

Comments To be published in EACL 2023