多模态大模型

Exploiting Modality-Specific Features For Multi-Modal Manipulation Detection And Grounding

Jiazhen Wang, Bin Liu, Changtao Miao, Zhiwei Zhao, Wanyi Zhuang, Qi Chu, Nenghai Yu

专题命中 图文多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments This work has been submitted to the IEEE for possible publication. Camera-ready version and supplementary material

Griffon-G: Bridging Vision-Language and Vision-Centric Tasks via Large Multimodal Models

Yufei Zhan, Hongyin Zhao, Yousong Zhu, Fan Yang, Ming Tang, Jinqiao Wang

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments This work has been submitted to the IEEE for possible publication. Codes and data will be later released at https://github.com/jefferyZhan/Griffon

MIND: Multimodal Shopping Intention Distillation from Large Vision-language Models for E-commerce Purchase Understanding

Baixuan Xu, Weiqi Wang, Haochen Shi, Wenxuan Ding, Huihao Jing, Tianqing Fang, Jiaxin Bai, Xin Liu, Changlong Yu, Zheng Li, Chen Luo, Qingyu Yin, Bing Yin, Long Chen, Yangqiu Song

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CL

Comments EMNLP 2024 main conference

Significantly improving zero-shot X-ray pathology classification via fine-tuning pre-trained image-text encoders

Jongseong Jang, Daeun Kyung, Seung Hwan Kim, Honglak Lee, Kyunghoon Bae, Edward Choi

专题命中 图文多模态 ：image-text(title,abstract)；分类 cs.CV

Journal ref Sci Rep 14, 23199 (2024)

CLIP Multi-modal Hashing for Multimedia Retrieval

Jian Zhu, Mingkai Sheng, Zhangmin Huang, Jingfei Chang, Jinling Jiang, Jian Long, Cheng Luo, Lei Liu

专题命中 图文多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by 31st International Conference on MultiMedia Modeling (MMM2025)

CoVLM: Leveraging Consensus from Vision-Language Models for Semi-supervised Multi-modal Fake News Detection

Devank, Jayateja Kalla, Soma Biswas

专题命中 图文多模态 ：multi-modal(title)；image-text(abstract)；分类 cs.CV

Comments Accepted in ACCV 2024

Removing Distributional Discrepancies in Captions Improves Image-Text Alignment

Yuheng Li, Haotian Liu, Mu Cai, Yijun Li, Eli Shechtman, Zhe Lin, Yong Jae Lee, Krishna Kumar Singh

专题命中 图文多模态 ：image-text(title,abstract)；分类 cs.CV

Enhancing Explainability in Multimodal Large Language Models Using Ontological Context

Jihen Amara, Birgitta König-Ries, Sheeba Samuel

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

CDChat: A Large Multimodal Model for Remote Sensing Change Description

Mubashir Noman, Noor Ahsan, Muzammal Naseer, Hisham Cholakkal, Rao Muhammad Anwer, Salman Khan, Fahad Shahbaz Khan

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

Instruction-guided Multi-Granularity Segmentation and Captioning with Large Multimodal Model

Li Zhou, Xu Yuan, Zenghui Sun, Zikun Zhou, Jingsong Lan

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments Code and dataset will be released at https://github.com/lizhou-cs/mglmm. 7 pages, 4 figures with Supplementary Material

Multi-Modal Instruction-Tuning Small-Scale Language-and-Vision Assistant for Semiconductor Electron Micrograph Analysis

Sakhinana Sagar Srinivas, Geethan Sannidhi, Venkataramana Runkana

专题命中 图文多模态 ：multi-modal(title)；multimodal(abstract)；分类 cs.CV

Comments Paper published at AAAI 2024 Spring Symposium Series

Filter & Align: Leveraging Human Knowledge to Curate Image-Text Data

Lei Zhang, Fangxun Shu, Tianyang Liu, Sucheng Ren, Hao Jiang, Cihang Xie

专题命中 图文多模态 ：image-text(title,abstract)；分类 cs.CV

Hyperbolic Learning with Multimodal Large Language Models

Paolo Mandica, Luca Franco, Konstantinos Kallidromitis, Suzanne Petryk, Fabio Galasso

专题命中 图文多模态 ：multimodal(title)；multi-modal(abstract)；分类 cs.AI

Comments ECCV 2024 - Beyond Euclidean Workshop

FKA-Owl: Advancing Multimodal Fake News Detection through Knowledge-Augmented LVLMs

Xuannan Liu, Peipei Li, Huaibo Huang, Zekun Li, Xing Cui, Jiahao Liang, Lixiong Qin, Weihong Deng, Zhaofeng He

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CL

Comments Accepted by ACM MM 2024.Project page: https://liuxuannan.github.io/FKA_Owl.github.io/

MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Models

Fanqing Meng, Jin Wang, Chuanhao Li, Quanfeng Lu, Hao Tian, Jiaqi Liao, Xizhou Zhu, Jifeng Dai, Yu Qiao, Ping Luo, Kaipeng Zhang, Wenqi Shao

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments Project Page: https://mmiu-bench.github.io/

Exploring Conditional Multi-Modal Prompts for Zero-shot HOI Detection

Ting Lei, Shaofeng Yin, Yuxin Peng, Yang Liu

专题命中 图文多模态 ：multi-modal(title,abstract)；分类 cs.CV

IWISDM: Assessing instruction following in multimodal models at scale

Xiaoxuan Lei, Lucas Gomez, Hao Yuan Bai, Pouya Bashivan

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.AI

Towards Multi-modal Transformers in Federated Learning

Guangyu Sun, Matias Mendieta, Aritra Dutta, Xin Li, Chen Chen

专题命中 图文多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments 2024 European Conference on Computer Vision (ECCV)

SoupLM: Model Integration in Large Language and Multi-Modal Models

Yue Bai, Zichen Zhang, Jiasen Lu, Yun Fu

专题命中 图文多模态 ：multi-modal(title)；multimodal(abstract)；分类 cs.AI

Can LLMs' Tuning Methods Work in Medical Multimodal Domain?

Jiawei Chen, Yue Jiang, Dingkang Yang, Mingcheng Li, Jinjie Wei, Ziyun Qian, Lihua Zhang

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted by MICCAI 2024

Improving Visual Storytelling with Multimodal Large Language Models

Xiaochuan Lin, Xiangyong Chen

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments 10 pages

At First Sight: Zero-Shot Classification of Astronomical Images with Large Multimodal Models

Dimitrios Tanoglidis, Bhuvnesh Jain

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.AI

Comments 5 pages, 3 images. Prepared for submission to RNAAS

Enhancing Scientific Figure Captioning Through Cross-modal Learning

Mateo Alejandro Rojas, Rafael Carranza

专题命中 图文多模态 ：cross-modal(title)；multimodal(abstract)；分类 cs.CV

Comments 7 pages

Multimodal Multilabel Classification by CLIP

Yanming Guo

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

CLIP-Decoder : ZeroShot Multilabel Classification using Multimodal CLIP Aligned Representation

Muhammad Ali, Salman Khan

专题命中 图文多模态 ：multimodal(title)；multi-modal(abstract)；分类 cs.CV

Comments Accepted at ICCVW- VLAR

Revealing Vision-Language Integration in the Brain with Multimodal Networks

Vighnesh Subramaniam, Colin Conwell, Christopher Wang, Gabriel Kreiman, Boris Katz, Ignacio Cases, Andrei Barbu

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.AI

Comments ICML 2024; 23 pages, 11 figures

Composing Object Relations and Attributes for Image-Text Matching

Khoi Pham, Chuong Huynh, Ser-Nam Lim, Abhinav Shrivastava

专题命中 图文多模态 ：image-text(title,abstract)；分类 cs.CV

Comments Accepted to CVPR'24

OVMR: Open-Vocabulary Recognition with Multi-Modal References

Zehong Ma, Shiliang Zhang, Longhui Wei, Qi Tian

专题命中 图文多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments CVPR2024

ProGEO: Generating Prompts through Image-Text Contrastive Learning for Visual Geo-localization

Chen Mao, Jingqi Hu

专题命中 图文多模态 ：image-text(title)；multi-modal(abstract)；分类 cs.CV

Language Augmentation in CLIP for Improved Anatomy Detection on Multi-modal Medical Images

Mansi Kakkar, Dattesh Shanbhag, Chandan Aladahalli, Gurunath Reddy M

专题命中 图文多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments $©$ 2024 IEEE. Accepted in 46th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) 2024