多模态大模型

Enhancing Scientific Figure Captioning Through Cross-modal Learning

Mateo Alejandro Rojas, Rafael Carranza

专题命中 图文多模态 ：cross-modal(title)；multimodal(abstract)；分类 cs.CV

Comments 7 pages

Multimodal Multilabel Classification by CLIP

Yanming Guo

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

CLIP-Decoder : ZeroShot Multilabel Classification using Multimodal CLIP Aligned Representation

Muhammad Ali, Salman Khan

专题命中 图文多模态 ：multimodal(title)；multi-modal(abstract)；分类 cs.CV

Comments Accepted at ICCVW- VLAR

Revealing Vision-Language Integration in the Brain with Multimodal Networks

Vighnesh Subramaniam, Colin Conwell, Christopher Wang, Gabriel Kreiman, Boris Katz, Ignacio Cases, Andrei Barbu

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.AI

Comments ICML 2024; 23 pages, 11 figures

Composing Object Relations and Attributes for Image-Text Matching

Khoi Pham, Chuong Huynh, Ser-Nam Lim, Abhinav Shrivastava

专题命中 图文多模态 ：image-text(title,abstract)；分类 cs.CV

Comments Accepted to CVPR'24

OVMR: Open-Vocabulary Recognition with Multi-Modal References

Zehong Ma, Shiliang Zhang, Longhui Wei, Qi Tian

专题命中 图文多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments CVPR2024

ProGEO: Generating Prompts through Image-Text Contrastive Learning for Visual Geo-localization

Chen Mao, Jingqi Hu

专题命中 图文多模态 ：image-text(title)；multi-modal(abstract)；分类 cs.CV

Language Augmentation in CLIP for Improved Anatomy Detection on Multi-modal Medical Images

Mansi Kakkar, Dattesh Shanbhag, Chandan Aladahalli, Gurunath Reddy M

专题命中 图文多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments $©$ 2024 IEEE. Accepted in 46th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) 2024

Machine Vision Therapy: Multimodal Large Language Models Can Enhance Visual Robustness via Denoising In-Context Learning

Zhuo Huang, Chang Liu, Yinpeng Dong, Hang Su, Shibao Zheng, Tongliang Liu

专题命中 图文多模态 ：multimodal(title)；multi-modal(abstract)；分类 cs.CV

Comments ICML 2024

Active Learning for Finely-Categorized Image-Text Retrieval by Selecting Hard Negative Unpaired Samples

Dae Ung Jo, Kyuewang Lee, JaeHo Chung, Jin Young Choi

专题命中 图文多模态 ：image-text(title,abstract)；分类 cs.CV

Mutual Information Analysis in Multimodal Learning Systems

Hadi Hadizadeh, S. Faegheh Yeganli, Bahador Rashidi, Ivan V. Bajić

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments 6 pages, 7 figures, IEEE MIPR 2024

TTD: Text-Tag Self-Distillation Enhancing Image-Text Alignment in CLIP to Alleviate Single Tag Bias

Sanghyun Jo, Soohyun Ryu, Sungyub Kim, Eunho Yang, Kyungsu Kim

专题命中 图文多模态 ：image-text(title,abstract)；分类 cs.CV

DEMO: A Statistical Perspective for Efficient Image-Text Matching

Fan Zhang, Xian-Sheng Hua, Chong Chen, Xiao Luo

专题命中 图文多模态 ：image-text(title,abstract)；分类 cs.CV

Adversarial Robustness for Visual Grounding of Multimodal Large Language Models

Kuofeng Gao, Yang Bai, Jiawang Bai, Yong Yang, Shu-Tao Xia

专题命中 图文多模态 ：multimodal(title)；multi-modal(abstract)；分类 cs.CV

Comments ICLR 2024 Workshop on Reliable and Responsible Foundation Models

CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts

Jiachen Li, Xinyao Wang, Sijie Zhu, Chia-Wen Kuo, Lu Xu, Fan Chen, Jitesh Jain, Humphrey Shi, Longyin Wen

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

FITA: Fine-grained Image-Text Aligner for Radiology Report Generation

Honglong Yang, Hui Tang, Xiaomeng Li

专题命中 图文多模态 ：image-text(title,abstract)；分类 cs.CV

Comments 11 pages, 3 figures

Automatic Creative Selection with Cross-Modal Matching

Alex Kim, Jia Huang, Rob Monarch, Jerry Kwac, Anikesh Kamath, Parmeshwar Khurd, Kailash Thiyagarajan, Goodman Gu

专题命中 图文多模态 ：cross-modal(title)；image-text(abstract)；分类 cs.CV

Multi-Modal Proxy Learning Towards Personalized Visual Multiple Clustering

Jiawei Yao, Qi Qian, Juhua Hu

专题命中 图文多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by CVPR 2024. Project page: https://github.com/Alexander-Yao/Multi-MaP

Progressive Multi-modal Conditional Prompt Tuning

Xiaoyu Qiu, Hao Feng, Yuechen Wang, Wengang Zhou, Houqiang Li

专题命中 图文多模态 ：multi-modal(title,abstract)；分类 cs.CV

TextCoT: Zoom In for Enhanced Multimodal Text-Rich Image Understanding

Bozhi Luan, Hao Feng, Hong Chen, Yonghui Wang, Wengang Zhou, Houqiang Li

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

FoodLMM: A Versatile Food Assistant using Large Multi-modal Model

Yuehao Yin, Huiyan Qi, Bin Zhu, Jingjing Chen, Yu-Gang Jiang, Chong-Wah Ngo

专题命中 图文多模态 ：multi-modal(title,abstract)；分类 cs.CV

Stacked Cross-modal Feature Consolidation Attention Networks for Image Captioning

Mozhgan Pourkeshavarz, Shahabedin Nabavi, Mohsen Ebrahimi Moghaddam, Mehrnoush Shamsfard

专题命中 图文多模态 ：cross-modal(title,abstract)；分类 cs.CV

Journal ref Multimedia Tools and Applications, Volume 83, pages 12209-12233, 2024

PairAug: What Can Augmented Image-Text Pairs Do for Radiology?

Yutong Xie, Qi Chen, Sinuo Wang, Minh-Son To, Iris Lee, Ee Win Khoo, Kerolos Hendy, Daniel Koh, Yong Xia, Qi Wu

专题命中 图文多模态 ：image-text(title,abstract)；分类 cs.CV

Comments Accepted to CVPR2024

Interpretable Detection of Out-of-Context Misinformation with Neural-Symbolic-Enhanced Large Multimodal Model

Yizhou Zhang, Loc Trinh, Defu Cao, Zijun Cui, Yan Liu

专题命中 图文多模态 ：multimodal(title)；cross-modal(abstract)；分类 cs.CL

Comments 9 Pages, 3 Figures

Image-Text Co-Decomposition for Text-Supervised Semantic Segmentation

Ji-Jia Wu, Andy Chia-Hao Chang, Chieh-Yu Chuang, Chun-Pei Chen, Yu-Lun Liu, Min-Hung Chen, Hou-Ning Hu, Yung-Yu Chuang, Yen-Yu Lin

专题命中 图文多模态 ：image-text(title,abstract)；分类 cs.CV

Comments CVPR 2024

HallE-Control: Controlling Object Hallucination in Large Multimodal Models

Bohan Zhai, Shijia Yang, Chenfeng Xu, Sheng Shen, Kurt Keutzer, Chunyuan Li, Manling Li

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments Our code is publicly available at https://github.com/bronyayang/HallE_Control

Multimodal Prompt Perceiver: Empower Adaptiveness, Generalizability and Fidelity for All-in-One Image Restoration

Yuang Ai, Huaibo Huang, Xiaoqiang Zhou, Jiexiang Wang, Ran He

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments 13 pages, 8 figures, 9 tables

End-to-end multi-modal product matching in fashion e-commerce

Sándor Tóth, Stephen Wilson, Alexia Tsoukara, Enric Moreu, Anton Masalovich, Lars Roemheld

专题命中 图文多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments 9 pages, submitted to SIGKDD

UniHDA: A Unified and Versatile Framework for Multi-Modal Hybrid Domain Adaptation

Hengjia Li, Yang Liu, Yuqi Lin, Zhanwei Zhang, Yibo Zhao, weihang Pan, Tu Zheng, Zheng Yang, Yuchun Jiang, Boxi Wu, Deng Cai

专题命中 图文多模态 ：multi-modal(title,abstract)；分类 cs.CV

VisionGPT: Vision-Language Understanding Agent Using Generalized Multimodal Framework

Chris Kelly, Luhui Hu, Bang Yang, Yu Tian, Deshun Yang, Cindy Yang, Zaoshan Huang, Zihao Li, Jiayin Hu, Yuexian Zou

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments 17 pages, 5 figures, and 1 table. arXiv admin note: substantial text overlap with arXiv:2311.10125