多模态大模型

Curriculum Point Prompting for Weakly-Supervised Referring Image Segmentation

Qiyuan Dai, Sibei Yang

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

Comments Accepted to CVPR 2024

A Progressive Framework of Vision-language Knowledge Distillation and Alignment for Multilingual Scene

Wenbo Zhang, Yifan Zhang, Jianfeng Lin, Binqiang Huang, Jinlu Zhang, Wenhao Yu

专题命中 图文多模态 ：cross-modal(abstract)；分类 cs.CV

Low-light Image Enhancement via CLIP-Fourier Guided Wavelet Diffusion

Minglong Xue, Jinhong He, Wenhai Wang, Mingliang Zhou

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV

Consistency and Uncertainty: Identifying Unreliable Responses From Black-Box Vision-Language Models for Selective Visual Question Answering

Zaid Khan, Yun Fu

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV

Comments CVPR 2024

Distilling Vision-Language Models on Millions of Videos

Yue Zhao, Long Zhao, Xingyi Zhou, Jialin Wu, Chun-Te Chu, Hui Miao, Florian Schroff, Hartwig Adam, Ting Liu, Boqing Gong, Philipp Krähenbühl, Liangzhe Yuan

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

Comments CVPR 2024. Project page: https://zhaoyue-zephyrus.github.io/video-instruction-tuning

PartDistill: 3D Shape Part Segmentation by Vision-Language Model Distillation

Ardian Umam, Cheng-Kun Yang, Min-Hung Chen, Jen-Hui Chuang, Yen-Yu Lin

专题命中 图文多模态 ：cross-modal(abstract)；分类 cs.CV

Comments CVPR 2024 Accepted

GPT-4V-AD: Exploring Grounding Potential of VQA-oriented GPT-4V for Zero-shot Anomaly Detection

Jiangning Zhang, Haoyang He, Xuhai Chen, Zhucun Xue, Yabiao Wang, Chengjie Wang, Lei Xie, Yong Liu

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV

RemoteCLIP: A Vision Language Foundation Model for Remote Sensing

Fan Liu, Delong Chen, Zhangqingyun Guan, Xiaocong Zhou, Jiale Zhu, Qiaolin Ye, Liyong Fu, Jun Zhou

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

Comments Accepted by IEEE Transactions on Geoscience and Remote Sensing (TGRS)

DetCLIPv3: Towards Versatile Generative Open-vocabulary Object Detection

Lewei Yao, Renjie Pi, Jianhua Han, Xiaodan Liang, Hang Xu, Wei Zhang, Zhenguo Li, Dan Xu

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

Comments Accepted to CVPR2024

Improving Continuous Sign Language Recognition with Adapted Image Models

Lianyu Hu, Tongkai Shi, Liqing Gao, Zekang Liu, Wei Feng

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

HRVDA: High-Resolution Visual Document Assistant

Chaohu Liu, Kun Yin, Haoyu Cao, Xinghua Jiang, Xin Li, Yinsong Liu, Deqiang Jiang, Xing Sun, Linli Xu

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV

Comments Accepted to CVPR 2024 main conference

Anchor-based Robust Finetuning of Vision-Language Models

Jinwei Han, Zhiwen Lin, Zhongyisun Sun, Yingguo Gao, Ke Yan, Shouhong Ding, Yuan Gao, Gui-Song Xia

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

Comments CVPR2024

Are We on the Right Way for Evaluating Large Vision-Language Models?

Lin Chen, Jinsong Li, Xiaoyi Dong, Pan Zhang, Yuhang Zang, Zehui Chen, Haodong Duan, Jiaqi Wang, Yu Qiao, Dahua Lin, Feng Zhao

专题命中 图文多模态 ：multi-modal(abstract)；分类 cs.CV

Comments Project page: https://mmstar-benchmark.github.io/

MULTIFLOW: Shifting Towards Task-Agnostic Vision-Language Pruning

Matteo Farina, Massimiliano Mancini, Elia Cunegatti, Gaowen Liu, Giovanni Iacca, Elisa Ricci

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV

Comments CVPR 2024

Self-Training Large Language Models for Improved Visual Program Synthesis With Visual Reinforcement

Zaid Khan, Vijay Kumar BG, Samuel Schulter, Yun Fu, Manmohan Chandraker

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

Comments CVPR 2024

Is CLIP the main roadblock for fine-grained open-world perception?

Lorenzo Bianchi, Fabio Carrara, Nicola Messina, Fabrizio Falchi

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV

Improved Zero-Shot Classification by Adapting VLMs with Text Descriptions

Oindrila Saha, Grant Van Horn, Subhransu Maji

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

What Are We Measuring When We Evaluate Large Vision-Language Models? An Analysis of Latent Factors and Biases

Anthony Meng Huat Tiong, Junqi Zhao, Boyang Li, Junnan Li, Steven C. H. Hoi, Caiming Xiong

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

Learning by Correction: Efficient Tuning Task for Zero-Shot Generative Vision-Language Reasoning

Rongjie Li, Yu Wu, Xuming He

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

Comments Accepted by CVPR2024

CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentation

Seokju Cho, Heeseong Shin, Sunghwan Hong, Anurag Arnab, Paul Hongsuck Seo, Seungryong Kim

专题命中 图文多模态 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted to CVPR 2024. Project page: https://ku-cvlab.github.io/CAT-Seg/

Negative Label Guided OOD Detection with Pretrained Vision-Language Models

Xue Jiang, Feng Liu, Zhen Fang, Hong Chen, Tongliang Liu, Feng Zheng, Bo Han

专题命中 图文多模态 ：multi-modal(abstract)；分类 cs.CV

Comments ICLR 2024 Spotlight

Text Data-Centric Image Captioning with Interactive Prompts

Yiyu Wang, Hao Luo, Jungang Xu, Yingfei Sun, Fan Wang

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

Envisioning MedCLIP: A Deep Dive into Explainability for Medical Vision-Language Models

Anees Ur Rehman Hashmi, Dwarikanath Mahapatra, Mohammad Yaqub

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV

ACES: Evaluating Automated Audio Captioning Models on the Semantics of Sounds

Gijs Wijngaard, Elia Formisano, Bruno L. Giordano, Michel Dumontier

专题命中 图文多模态 ：multimodal(abstract)；分类 eess.AS

Explaining CLIP's performance disparities on data from blind/low vision users

Daniela Massiceti, Camilla Longden, Agnieszka Słowik, Samuel Wills, Martin Grayson, Cecily Morrison

专题命中 图文多模态 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted at 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Supporting Vision-Language Model Inference with Confounder-pruning Knowledge Prompt

Jiangmeng Li, Wenyi Mo, Wenwen Qiang, Bing Su, Changwen Zheng, Hui Xiong, Ji-Rong Wen

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

Inducing High Energy-Latency of Large Vision-Language Models with Verbose Images

Kuofeng Gao, Yang Bai, Jindong Gu, Shu-Tao Xia, Philip Torr, Zhifeng Li, Wei Liu

专题命中 图文多模态 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted by ICLR 2024

UniChest: Conquer-and-Divide Pre-training for Multi-Source Chest X-Ray Classification

Tianjie Dai, Ruipeng Zhang, Feng Hong, Jiangchao Yao, Ya Zhang, Yanfeng Wang

专题命中 图文多模态 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted at IEEE Transactions on Medical Imaging

Chain-of-Spot: Interactive Reasoning Improves Large Vision-Language Models

Zuyan Liu, Yuhao Dong, Yongming Rao, Jie Zhou, Jiwen Lu

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV

Comments Project Page: https://sites.google.com/view/chain-of-spot/

Chart-based Reasoning: Transferring Capabilities from LLMs to VLMs

Victor Carbune, Hassan Mansoor, Fangyu Liu, Rahul Aralikatte, Gilles Baechler, Jindong Chen, Abhanshu Sharma

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CL

Comments Findings of NAACL 2024