多模态大模型 - arXivDaily 专题

2312.17010 2024-08-31 cs.CV 79%

Robust Multi-Modal Image Stitching for Improved Scene Understanding

Aritra Dutta, G Suseela, Asmita Sood

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments 8 pages, 11 figures

2407.03791 2024-08-27 cs.CL 79%

M5 -- A Diverse Benchmark to Assess the Performance of Large Multimodal Models Across Multilingual and Multicultural Vision-Language Tasks

Florian Schneider, Sunayana Sitaram

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

2408.13019 2024-08-26 cs.MM cs.HC 79%

VCEMO: Multi-Modal Emotion Recognition for Chinese Voiceprints

Jinghua Tang, Liyun Zhang, Yu Lu, Dian Ding, Lanqing Yang, YiChao Chen, Minjie Bian, Xiaoshan Li, Guangtao Xue

专题命中多模态评测：multi-modal(title)；multimodal(abstract)；分类 cs.MM

Comments 12 pages, 4 figures

2408.12895 2024-08-26 cs.MM 79%

Ada2I: Enhancing Modality Balance for Multimodal Conversational Emotion Recognition

Cam-Van Thi Nguyen, The-Son Le, Anh-Tuan Mai, Duc-Trong Le

专题命中多模态评测：multimodal(title,abstract)；分类 cs.MM

Comments Accepted at ACM Multimedia 2024

2408.00963 2024-08-22 cs.CV cs.LG 79%

MIS-ME: A Multi-modal Framework for Soil Moisture Estimation

Mohammed Rakib, Adil Aman Mohammed, D. Cole Diggins, Sumit Sharma, Jeff Michael Sadler, Tyson Ochsner, Arun Bagavathi

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by DSAA2024

2310.10942 2024-08-22 cs.CV 79%

UNK-VQA: A Dataset and a Probe into the Abstention Ability of Multi-modal Large Models

Yangyang Guo, Fangkai Jiao, Zhiqi Shen, Liqiang Nie, Mohan Kankanhalli

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by TPAMI

2408.09035 2024-08-20 cs.CV 79%

Multi Teacher Privileged Knowledge Distillation for Multimodal Expression Recognition

Muhammad Haseeb Aslam, Marco Pedersoli, Alessandro Lameiras Koerich, Eric Granger

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

2403.13315 2024-08-20 cs.CV 79%

PuzzleVQA: Diagnosing Multimodal Reasoning Challenges of Language Models with Abstract Visual Patterns

Yew Ken Chia, Vernon Toh Yan Han, Deepanway Ghosal, Lidong Bing, Soujanya Poria

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments ACL 2024 Camera Ready

2401.11818 2024-08-20 cs.MM 79%

MInD: Improving Multimodal Sentiment Analysis via Multimodal Information Disentanglement

Weichen Dai, Xingyu Li, Zeyu Wang, Pengbo Hu, Ji Qi, Jianlin Peng, Yi Zhou

专题命中多模态评测：multimodal(title)；multi-modal(abstract)；分类 cs.MM

2408.08708 2024-08-19 cs.CV 79%

Decoupling Feature Representations of Ego and Other Modalities for Incomplete Multi-modal Brain Tumor Segmentation

Kaixiang Yang, Wenqi Shan, Xudong Li, Xuan Wang, Xikai Yang, Xi Wang, Pheng-Ann Heng, Qiang Li, Zhiwei Wang

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments 8 pages, 4 figures

2408.08211 2024-08-16 eess.IV cs.CV 79%

Learned Multimodal Compression for Autonomous Driving

Hadi Hadizadeh, Ivan V. Bajić

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments 6 pages, 5 figures, IEEE MMSP 2024

2408.05941 2024-08-13 cs.CR cs.AI 79%

Multimodal Large Language Models for Phishing Webpage Detection and Identification

Jehyun Lee, Peiyuan Lim, Bryan Hooi, Dinil Mon Divakaran

专题命中多模态评测：multimodal(title,abstract)；分类 cs.AI

Comments To appear in eCrime 2024

2408.04110 2024-08-09 cs.CV 79%

PaveCap: The First Multimodal Framework for Comprehensive Pavement Condition Assessment with Dense Captioning and PCI Estimation

Blessing Agyei Kyem, Eugene Kofi Okrah Denteh, Joshua Kofi Asamoah, Armstrong Aboah

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

2408.04026 2024-08-09 cs.LG cs.AI cs.RO 79%

Multimodal Gender Fairness in Depression Prediction: Insights on Data from the USA & China

Joseph Cameron, Jiaee Cheong, Micol Spitale, Hatice Gunes

专题命中多模态评测：multimodal(title,abstract)；分类 cs.AI

Comments 9 Pages, 7 Tables. To be published and indexed in the IEEE Xplore Digital Library under the ACII 2024 Workshop Proceedings

2408.03120 2024-08-07 cs.CV 79%

Benchmarking In-the-wild Multimodal Disease Recognition and A Versatile Baseline

Tianqi Wei, Zhi Chen, Zi Huang, Xin Yu

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

2408.03065 2024-08-07 cs.CV 79%

SCOPE: A Synthetic Multi-Modal Dataset for Collective Perception Including Physical-Correct Weather Conditions

Jörg Gamerdinger, Sven Teufel, Patrick Schulz, Stephan Amann, Jan-Patrick Kirchner, Oliver Bringmann

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

2408.02954 2024-08-07 cs.CV 79%

WWW: Where, Which and Whatever Enhancing Interpretability in Multimodal Deepfake Detection

Juho Jung, Sangyoun Lee, Jooeon Kang, Yunjin Na

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments 4 pages, 2 figures, 2 tables, Accepted as Oral Presentation at The Trustworthy AI Workshop @ IJCAI 2024

2408.02568 2024-08-06 cs.LG cs.CV 79%

Cross-Modality Clustering-based Self-Labeling for Multimodal Data Classification

Paweł Zyblewski, Leandro L. Minku

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments 10 pages, 5 figures, 9 tables

2408.01091 2024-08-06 cs.AI 79%

Dissecting Dissonance: Benchmarking Large Multimodal Models Against Self-Contradictory Instructions

Jin Gao, Lei Gan, Yuankai Li, Yixin Ye, Dequan Wang

专题命中多模态评测：multimodal(title,abstract)；分类 cs.AI

Comments Accepted by the 18th European Conference on Computer Vision ECCV 2024

2407.20446 2024-07-31 cs.CV cs.DB 79%

MEVDT: Multi-Modal Event-Based Vehicle Detection and Tracking Dataset

Zaid A. El Shair, Samir A. Rawashdeh

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

2407.18716 2024-07-29 cs.CL 79%

ChatSchema: A pipeline of extracting structured information with Large Multimodal Models based on schema

Fei Wang, Yuewen Zheng, Qin Li, Jingyi Wu, Pengfei Li, Luxia Zhang

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

2407.18667 2024-07-29 cs.CV 79%

A Labeled Ophthalmic Ultrasound Dataset with Medical Report Generation Based on Cross-modal Deep Learning

Jing Wang, Junyan Fan, Meng Zhou, Yanzhu Zhang, Mingyu Shi

专题命中多模态评测：cross-modal(title,abstract)；分类 cs.CV

2308.01328 2024-07-24 eess.IV cs.CV q-bio.QM 79%

A vision transformer-based framework for knowledge transfer from multi-modal to mono-modal lymphoma subtyping models

Bilel Guetarni, Feryal Windal, Halim Benhabiles, Marianne Petit, Romain Dubois, Emmanuelle Leteurtre, Dominique Collard

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

2407.14277 2024-07-23 cs.CV 79%

Patch-based Intuitive Multimodal Prototypes Network (PIMPNet) for Alzheimer's Disease classification

Lisa Anita De Santi, Jörg Schlötterer, Meike Nauta, Vincenzo Positano, Christin Seifert

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments Accepted "late-breaking work" at XAI-2024

2312.02228 2024-07-19 cs.CV 79%

PixelLM: Pixel Reasoning with Large Multimodal Model

Zhongwei Ren, Zhicheng Huang, Yunchao Wei, Yao Zhao, Dongmei Fu, Jiashi Feng, Xiaojie Jin

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments (Accepted by CVPR 2024) Code and models are released at: https://pixellm.github.io/

2407.11637 2024-07-17 cs.CV 79%

REMM:Rotation-Equivariant Framework for End-to-End Multimodal Image Matching

Han Nie, Bin Luo, Jun Liu, Zhitao Fu, Weixing Liu, Xin Su

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments 13 pages, 13 figures

2312.08962 2024-07-16 cs.CV 79%

Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Models

Zhiyuan You, Zheyuan Li, Jinjin Gu, Zhenfei Yin, Tianfan Xue, Chao Dong

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted to ECCV2024, Camera Ready Version

2309.14550 2024-07-16 eess.IV cs.CV 79%

MEMO: Dataset and Methods for Robust Multimodal Retinal Image Registration with Large or Small Vessel Density Differences

Chiao-Yi Wang, Faranguisse Kakhi Sadrieh, Yi-Ting Shen, Shih-En Chen, Sarah Kim, Victoria Chen, Achyut Raghavendra, Dongyi Wang, Osamah Saeedi, Yang Tao

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments Biomedical Optics Express

Journal ref Biomed. Opt. Express 15, 3457-3479 (2024)

2407.08148 2024-07-12 cs.CV 79%

SCPNet: Unsupervised Cross-modal Homography Estimation via Intra-modal Self-supervised Learning

Runmin Zhang, Jun Ma, Si-Yuan Cao, Lun Luo, Beinan Yu, Shu-Jie Chen, Junwei Li, Hui-Liang Shen

专题命中多模态评测：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted by ECCV 2024

2403.10854 2024-07-12 cs.CV 79%

A Comprehensive Study of Multimodal Large Language Models for Image Quality Assessment

Tianhe Wu, Kede Ma, Jie Liang, Yujiu Yang, Lei Zhang

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

1. 多模态评测 9189 篇

Robust Multi-Modal Image Stitching for Improved Scene Understanding

M5 -- A Diverse Benchmark to Assess the Performance of Large Multimodal Models Across Multilingual and Multicultural Vision-Language Tasks

VCEMO: Multi-Modal Emotion Recognition for Chinese Voiceprints

Ada2I: Enhancing Modality Balance for Multimodal Conversational Emotion Recognition

MIS-ME: A Multi-modal Framework for Soil Moisture Estimation

UNK-VQA: A Dataset and a Probe into the Abstention Ability of Multi-modal Large Models

Multi Teacher Privileged Knowledge Distillation for Multimodal Expression Recognition

PuzzleVQA: Diagnosing Multimodal Reasoning Challenges of Language Models with Abstract Visual Patterns

MInD: Improving Multimodal Sentiment Analysis via Multimodal Information Disentanglement

Decoupling Feature Representations of Ego and Other Modalities for Incomplete Multi-modal Brain Tumor Segmentation

Learned Multimodal Compression for Autonomous Driving

Multimodal Large Language Models for Phishing Webpage Detection and Identification

PaveCap: The First Multimodal Framework for Comprehensive Pavement Condition Assessment with Dense Captioning and PCI Estimation

Multimodal Gender Fairness in Depression Prediction: Insights on Data from the USA & China

Benchmarking In-the-wild Multimodal Disease Recognition and A Versatile Baseline

SCOPE: A Synthetic Multi-Modal Dataset for Collective Perception Including Physical-Correct Weather Conditions

WWW: Where, Which and Whatever Enhancing Interpretability in Multimodal Deepfake Detection

Cross-Modality Clustering-based Self-Labeling for Multimodal Data Classification

Dissecting Dissonance: Benchmarking Large Multimodal Models Against Self-Contradictory Instructions

MEVDT: Multi-Modal Event-Based Vehicle Detection and Tracking Dataset

ChatSchema: A pipeline of extracting structured information with Large Multimodal Models based on schema

A Labeled Ophthalmic Ultrasound Dataset with Medical Report Generation Based on Cross-modal Deep Learning

A vision transformer-based framework for knowledge transfer from multi-modal to mono-modal lymphoma subtyping models

Patch-based Intuitive Multimodal Prototypes Network (PIMPNet) for Alzheimer's Disease classification

PixelLM: Pixel Reasoning with Large Multimodal Model

REMM:Rotation-Equivariant Framework for End-to-End Multimodal Image Matching

Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Models

MEMO: Dataset and Methods for Robust Multimodal Retinal Image Registration with Large or Small Vessel Density Differences

SCPNet: Unsupervised Cross-modal Homography Estimation via Intra-modal Self-supervised Learning

A Comprehensive Study of Multimodal Large Language Models for Image Quality Assessment