多模态大模型

Cross-Modal Consistency Learning for Sign Language Recognition

Kepeng Wu, Zecheng Li, Hezhen Hu, Wengang Zhou, Houqiang Li

专题命中 跨模态检索 ：cross-modal(title,abstract)；分类 cs.CV

HySurvPred: Multimodal Hyperbolic Embedding with Angle-Aware Hierarchical Contrastive Learning and Uncertainty Constraints for Survival Prediction

Jiaqi Yang, Wenting Chen, Xiaohan Xing, Sean He, Xiaoling Luo, Xinheng Lyu, Linlin Shen, Guoping Qiu

专题命中 跨模态检索 ：multimodal(title,abstract)；分类 cs.CV

Comments submitted to IJCAI2025

NeighborRetr: Balancing Hub Centrality in Cross-Modal Retrieval

Zengrong Lin, Zheng Wang, Tianwen Qian, Pan Mu, Sixian Chan, Cong Bai

专题命中 跨模态检索 ：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted at CVPR 2025, 18 pages, 7 figures, 13 tables

Lightweight Contrastive Distilled Hashing for Online Cross-modal Retrieval

Jiaxing Li, Lin Jiang, Zeqi Ma, Kaihang Jiang, Xiaozhao Fang, Jie Wen

专题命中 跨模态检索 ：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted by AAAI 2025

Range and Bird's Eye View Fused Cross-Modal Visual Place Recognition

Jianyi Peng, Fan Lu, Bin Li, Yuan Huang, Sanqing Qu, Guang Chen

专题命中 跨模态检索 ：cross-modal(title,abstract)；分类 cs.CV

MC2SleepNet: Multi-modal Cross-masking with Contrastive Learning for Sleep Stage Classification

Younghoon Na, Hyun Keun Ahn, Hyun-Kyung Lee, Yoongeol Lee, Seung Hun Oh, Hongkwon Kim, Jeong-Gun Lee

专题命中 跨模态检索 ：multi-modal(title,abstract)；分类 cs.AI

SCA3D: Enhancing Cross-modal 3D Retrieval via 3D Shape and Caption Paired Data Augmentation

Junlong Ren, Hao Wu, Hui Xiong, Hao Wang

专题命中 跨模态检索 ：cross-modal(title,abstract)；分类 cs.CV

Comments ICRA 2025

HyperGCL: Multi-Modal Graph Contrastive Learning via Learnable Hypergraph Views

Khaled Mohammed Saifuddin, Shihao Ji, Esra Akbas

专题命中 跨模态检索 ：multi-modal(title)；multimodal(abstract)；分类 cs.AI

Comments 9 pages, 2 figures

Contrastive Learning of English Language and Crystal Graphs for Multimodal Representation of Materials Knowledge

Yang Jeong Park, Mayank Kumaran, Chia-Wei Hsu, Elsa Olivetti, Ju Li

专题命中 跨模态检索 ：multimodal(title)；cross-modal(abstract)；分类 cs.CL

Comments 24 pages, 14 figure

Modeling Multi-modal Cross-interaction for Multi-label Few-shot Image Classification Based on Local Feature Selection

Kun Yan, Zied Bouraoui, Fangyun Wei, Chang Xu, Ping Wang, Shoaib Jameel, Steven Schockaert

专题命中 跨模态检索 ：multi-modal(title,abstract)；分类 cs.CV

Comments In Transactions on Multimedia Computing Communications and Applications. arXiv admin note: text overlap with arXiv:2112.01037

Can LLMs Improve Multimodal Fact-Checking by Asking Relevant Questions?

Alimohammad Beigi, Bohan Jiang, Dawei Li, Zhen Tan, Pouya Shaeri, Tharindu Kumarage, Amrita Bhattacharjee, Huan Liu

专题命中 跨模态检索 ：multimodal(title,abstract)；分类 cs.CL

Latent Distribution Decoupling: A Probabilistic Framework for Uncertainty-Aware Multimodal Emotion Recognition

Jingwang Huang, Jiang Zhong, Qin Lei, Jinpeng Gao, Yuming Yang, Sirui Wang, Peiguang Li, Kaiwen Wei

专题命中 跨模态检索 ：multimodal(title,abstract)；分类 cs.CL

CLASS: Enhancing Cross-Modal Text-Molecule Retrieval Performance and Training Efficiency

Hongyan Wu, Peijian Zeng, Weixiong Zheng, Lianxi Wang, Nankai Lin, Shengyi Jiang, Aimin Yang

专题命中 跨模态检索 ：cross-modal(title,abstract)；分类 cs.CL

Comments 12 pages

VisDoM: Multi-Document QA with Visually Rich Elements Using Multimodal Retrieval-Augmented Generation

Manan Suri, Puneet Mathur, Franck Dernoncourt, Kanika Goswami, Ryan A. Rossi, Dinesh Manocha

专题命中 跨模态检索 ：multimodal(title,abstract)；分类 cs.CL

Bridging the Gap for Test-Time Multimodal Sentiment Analysis

Zirun Guo, Tao Jin, Wenlong Xu, Wang Lin, Yangyang Wu

专题命中 跨模态检索 ：multimodal(title,abstract)；分类 cs.CL

Comments Accepted to AAAI 2025

MuRAR: A Simple and Effective Multimodal Retrieval and Answer Refinement Framework for Multimodal Question Answering

Zhengyuan Zhu, Daniel Lee, Hong Zhang, Sai Sree Harsha, Loic Feujio, Akash Maharaj, Yunyao Li

专题命中 跨模态检索 ：multimodal(title,abstract)；分类 cs.CL

Comments Accepted at COLING 2025

AliFuse: Aligning and Fusing Multi-modal Medical Data for Computer-Aided Diagnosis

Qiuhui Chen, Yi Hong

专题命中 跨模态检索 ：multi-modal(title)；multimodal(abstract)；分类 cs.CV

Comments BIBM 2024

Overcoming Uncertain Incompleteness for Robust Multimodal Sequential Diagnosis Prediction via Curriculum Data Erasing Guided Knowledge Distillation

Heejoon Koo

专题命中 跨模态检索 ：multimodal(title,abstract)；分类 cs.AI

Comments Accepted by ICASSP 2025 (2025 IEEE International Conference on Acoustics, Speech, and Signal Processing)

Code and Pixels: Multi-Modal Contrastive Pre-training for Enhanced Tabular Data Analysis

Kankana Roy, Lars Krämer, Sebastian Domaschke, Malik Haris, Roland Aydin, Fabian Isensee, Martin Held

专题命中 跨模态检索 ：multi-modal(title,abstract)；分类 cs.CV

Re-ranking the Context for Multimodal Retrieval Augmented Generation

Matin Mortaheb, Mohammad A. Amir Khojastepour, Srimat T. Chakradhar, Sennur Ulukus

专题命中 跨模态检索 ：multimodal(title)；multi-modal(abstract)；分类 cs.CV

RAG-Check: Evaluating Multimodal Retrieval Augmented Generation Performance

Matin Mortaheb, Mohammad A. Amir Khojastepour, Srimat T. Chakradhar, Sennur Ulukus

专题命中 跨模态检索 ：multimodal(title)；multi-modal(abstract)；分类 cs.CV

DiffCL: A Diffusion-Based Contrastive Learning Framework with Semantic Alignment for Multimodal Recommendations

Qiya Song, Jiajun Hu, Lin Xiao, Bin Sun, Xieping Gao, Shutao Li

专题命中 跨模态检索 ：multimodal(title,abstract)；分类 cs.MM

General-Purpose Multi-Modal OOD Detection Framework

Viet Duong, Qiong Wu, Zhengyi Zhou, Eric Zavesky, Jiahe Chen, Xiangzhou Liu, Wen-Ling Hsu, Huajie Shao

专题命中 跨模态检索 ：multi-modal(title,abstract)；分类 cs.CV

Journal ref Transactions on Machine Learning Research 2024

Multimodal Hypothetical Summary for Retrieval-based Multi-image Question Answering

Peize Li, Qingyi Si, Peng Fu, Zheng Lin, Yan Wang

专题命中 跨模态检索 ：multimodal(title,abstract)；分类 cs.CV

Comments AAAI 2025

Maybe you are looking for CroQS: Cross-modal Query Suggestion for Text-to-Image Retrieval

Giacomo Pacini, Fabio Carrara, Nicola Messina, Nicola Tonellotto, Giuseppe Amato, Fabrizio Falchi

专题命中 跨模态检索 ：cross-modal(title,abstract)；分类 cs.AI

Comments 15 pages, 5 figures. To be published as full paper in the Proceedings of the European Conference on Information Retrieval (ECIR) 2025

A Self-Learning Multimodal Approach for Fake News Detection

Hao Chen, Hui Guo, Baochen Hu, Shu Hu, Jinrong Hu, Siwei Lyu, Xi Wu, Xin Wang

专题命中 跨模态检索 ：multimodal(title,abstract)；分类 cs.CL

Multi-View Incongruity Learning for Multimodal Sarcasm Detection

Diandian Guo, Cong Cao, Fangfang Yuan, Yanbing Liu, Guangjie Zeng, Xiaoyan Yu, Hao Peng, Philip S. Yu

专题命中 跨模态检索 ：multimodal(title,abstract)；分类 cs.CL

Comments Accepted to COLING 2025

Multimodal Fact-Checking with Vision Language Models: A Probing Classifier based Solution with Embedding Strategies

Recep Firat Cekinel, Pinar Karagoz, Cagri Coltekin

专题命中 跨模态检索 ：multimodal(title,abstract)；分类 cs.CL

Comments Accepted to COLING2025

Zero-Shot Relational Learning for Multimodal Knowledge Graphs

Rui Cai, Shichao Pei, Xiangliang Zhang

专题命中 跨模态检索 ：multimodal(title,abstract)；分类 cs.MM

Comments In the Proceedings of the 2024 IEEE International Conference on Big Data (IEEE BigData 2024)

Cross-Modal Visual Relocalization in Prior LiDAR Maps Utilizing Intensity Textures

Qiyuan Shen, Hengwang Zhao, Weihao Yan, Chunxiang Wang, Tong Qin, Ming Yang

专题命中 跨模态检索 ：cross-modal(title,abstract)；分类 cs.CV