多模态大模型

OMuSense-23: A Multimodal Dataset for Contactless Breathing Pattern Recognition and Biometric Analysis

Manuel Lage Cañellas, Le Nguyen, Anirban Mukherjee, Constantino Álvarez Casado, Xiaoting Wu, Praneeth Susarla, Sasan Sharifipour, Dinesh B. Jayagopi, Miguel Bordallo López

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Multimodal Industrial Anomaly Detection by Crossmodal Feature Mapping

Alex Costanzino, Pierluigi Zama Ramirez, Giuseppe Lisanti, Luigi Di Stefano

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted at CVPR 2024

Cross-Modal Conditioned Reconstruction for Language-guided Medical Image Segmentation

Xiaoshuang Huang, Hongxiang Li, Meng Cao, Long Chen, Chenyu You, Dong An

专题命中 多模态评测 ：cross-modal(title,abstract)；分类 cs.CV

Oracle Bone Inscriptions Multi-modal Dataset

Bang Li, Donghao Luo, Yujie Liang, Jing Yang, Zengmao Ding, Xu Peng, Boyuan Jiang, Shengwei Han, Dan Sui, Peichao Qin, Pian Wu, Chaoyang Wang, Yun Qi, Taisong Jin, Chengjie Wang, Xiaoming Huang, Zhan Shu, Rongrong Ji, Yongge Liu, Yunsheng Wu

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Multimodal Variational Autoencoder for Low-cost Cardiac Hemodynamics Instability Detection

Mohammod N. I. Suvon, Prasun C. Tripathi, Wenrui Fan, Shuo Zhou, Xianyuan Liu, Samer Alabed, Venet Osmani, Andrew J. Swift, Chen Chen, Haiping Lu

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

OpenVNA: A Framework for Analyzing the Behavior of Multimodal Language Understanding System under Noisy Scenarios

Ziqi Yuan, Baozheng Zhang, Hua Xu, Zhiyun Liang, Kai Gao

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.MM

Comments 10 pages, 4 figures, to be published in ACL 2024 System Demonstration Track

Automated Assessment of Encouragement and Warmth in Classrooms Leveraging Multimodal Emotional Features and ChatGPT

Ruikun Hou, Tim Fütterer, Babette Bühler, Efe Bozkir, Peter Gerjets, Ulrich Trautwein, Enkelejda Kasneci

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments Accepted as a full paper by the 25th International Conference on Artificial Intelligence in Education (AIED 2024)

Journal ref Proceedings of the 25th International Conference on Artificial Intelligence in Education (AIED 2024)

Zero-Shot ECG Classification with Multimodal Learning and Test-time Clinical Knowledge Enhancement

Che Liu, Zhongwei Wan, Cheng Ouyang, Anand Shah, Wenjia Bai, Rossella Arcucci

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments Accepted by ICML2024

MM-MATH: Advancing Multimodal Math Evaluation with Process Evaluation and Fine-grained Classification

Kai Sun, Yushi Bai, Ji Qi, Lei Hou, Juanzi Li

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Exploring the Potential of Multi-Modal AI for Driving Hazard Prediction

Korawat Charoenpitaks, Van-Quang Nguyen, Masanori Suganuma, Masahiro Takahashi, Ryoma Niihara, Takayuki Okatani

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Comments Main Paper: 11 pages, Supplementary Materials: 25 pages

Journal ref IEEE Trans. Intell. Veh. (2024) 1-11

Multimodal Explainable Artificial Intelligence: A Comprehensive Review of Methodological Advances and Future Research Directions

Nikolaos Rodis, Christos Sardianos, Panagiotis Radoglou-Grammatikis, Panagiotis Sarigiannidis, Iraklis Varlamis, Georgios Th. Papadopoulos

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments 49 pages, 11 figures

MMRo: Are Multimodal LLMs Eligible as the Brain for In-Home Robotics?

Jinming Li, Yichen Zhu, Zhiyuan Xu, Jindong Gu, Minjie Zhu, Xin Liu, Ning Liu, Yaxin Peng, Feifei Feng, Jian Tang

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Multimodal Data Integration for Precision Oncology: Challenges and Future Directions

Huajun Zhou, Fengtao Zhou, Chenyu Zhao, Yingxue Xu, Luyang Luo, Hao Chen

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments 15 pages, 4 figures

Refining Myocardial Infarction Detection: A Novel Multi-Modal Composite Kernel Strategy in One-Class Classification

Muhammad Uzair Zahid, Aysen Degerli, Fahad Sohrab, Serkan Kiranyaz, Tahir Hamid, Rashid Mazhar, Moncef Gabbouj

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.AI

DeepSense-V2V: A Vehicle-to-Vehicle Multi-Modal Sensing, Localization, and Communications Dataset

Joao Morais, Gouranga Charan, Nikhil Srinivas, Ahmed Alkhateeb

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Comments 14 pages, 15 figures, 2 tables. The dataset is available on the DeepSense6G website: https://deepsense6g.net/

Anime Popularity Prediction Before Huge Investments: a Multimodal Approach Using Deep Learning

Jesús Armenta-Segura, Grigori Sidorov

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments 13 pages, 6 figures, 11 tables

Large Multimodal Model Compression via Efficient Pruning and Distillation at AntGroup

Maolin Wang, Yao Zhao, Jiajia Liu, Jingdong Chen, Chenyi Zhuang, Jinjie Gu, Ruocheng Guo, Xiangyu Zhao

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Revisiting Referring Expression Comprehension Evaluation in the Era of Large Multimodal Models

Jierun Chen, Fangyun Wei, Jinjing Zhao, Sizhe Song, Bohuai Wu, Zhuoxuan Peng, S. -H. Gary Chan, Hongyang Zhang

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

EMMI -- Empathic Multimodal Motivational Interviews Dataset: Analyses and Annotations

Lucie Galland, Catherine Pelachaud, Florian Pecune

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments 9 pages

Continual Road-Scene Semantic Segmentation via Feature-Aligned Symmetric Multi-Modal Network

Francesco Barbato, Elena Camuffo, Simone Milani, Pietro Zanuttigh

专题命中 多模态评测 ：multi-modal(title)；multimodal(abstract)；分类 cs.CV

Comments Accepted ad ICIP 2024, 6 pages, 5 figures, 3 tables, 7 equations

MODIPHY: Multimodal Obscured Detection for IoT using PHantom Convolution-Enabled Faster YOLO

Shubhabrata Mukherjee, Cory Beard, Zhu Li

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments This paper has been accepted for publication at the IEEE International Conference on Image Processing (ICIP) 2024

Can Large Multimodal Models Uncover Deep Semantics Behind Images?

Yixin Yang, Zheng Li, Qingxiu Dong, Heming Xia, Zhifang Sui

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

MM-SafetyBench: A Benchmark for Safety Evaluation of Multimodal Large Language Models

Xin Liu, Yichen Zhu, Jindong Gu, Yunshi Lan, Chao Yang, Yu Qiao

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

M4Fog: A Global Multi-Regional, Multi-Modal, and Multi-Stage Dataset for Marine Fog Detection and Forecasting to Bridge Ocean and Atmosphere

Mengqiu Xu, Ming Wu, Kaixin Chen, Yixiang Huang, Mingrui Xu, Yujia Yang, Yiqing Feng, Yiying Guo, Bin Huang, Dongliang Chang, Zhenwei Shi, Chuang Zhang, Zhanyu Ma, Jun Guo

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

CaMML: Context-Aware Multimodal Learner for Large Models

Yixin Chen, Shuai Zhang, Boran Han, Tong He, Bo Li

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments Preprint

ROCOv2: Radiology Objects in COntext Version 2, an Updated Multimodal Image Dataset

Johannes Rückert, Louise Bloch, Raphael Brüngel, Ahmad Idrissi-Yaghir, Henning Schäfer, Cynthia S. Schmidt, Sven Koitka, Obioma Pelka, Asma Ben Abacha, Alba G. Seco de Herrera, Henning Müller, Peter A. Horn, Felix Nensa, Christoph M. Friedrich

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted for Scientific Data

WarCov -- Large multilabel and multimodal dataset from social platform

Weronika Borek-Marciniec, Pawel Zyblewski, Jakub Klikowski, Pawel Ksieniewicz

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments 13 pages, 6 figures

An Open and Large-Scale Dataset for Multi-Modal Climate Change-aware Crop Yield Predictions

Fudong Lin, Kaleb Guillot, Summer Crawford, Yihe Zhang, Xu Yuan, Nian-Feng Tzeng

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Comments 13 pages

Journal ref KDD 2024 ADS track

Towards Comprehensive Multimodal Perception: Introducing the Touch-Language-Vision Dataset

Ning Cheng, You Li, Jing Gao, Bin Fang, Jinan Xu, Wenjuan Han

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted by ICIC 2024

Enhancing Incomplete Multi-modal Brain Tumor Segmentation with Intra-modal Asymmetry and Inter-modal Dependency

Weide Liu, Jingwen Hou, Xiaoyang Zhong, Huijing Zhan, Jun Cheng, Yuming Fang, Guanghui Yue

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV