视觉大模型 / VLM

Free Form Medical Visual Question Answering in Radiology

Abhishek Narayanan, Rushabh Musthyala, Rahul Sankar, Anirudh Prasad Nistala, Pranav Singh, Jacopo Cirrone

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments 6 pages and 4 figures

Object Attribute Matters in Visual Question Answering

Peize Li, Qingyi Si, Peng Fu, Zheng Lin, Yan Wang

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments AAAI 2024

Detection-based Intermediate Supervision for Visual Question Answering

Yuhang Liu, Daowan Peng, Wei Wei, Yuanyuan Fu, Wenfeng Xie, Dangyang Chen

专题命中 视觉问答 ：visual question answering(title)；grounding(abstract)；分类 cs.CV、cs.AI

Comments Accepted by AAAI24

Bidirectional Contrastive Split Learning for Visual Question Answering

Yuwei Sun, Hideya Ochiai

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Comments Accepted for AAAI 2024

Improving Zero-shot Visual Question Answering via Large Language Models with Reasoning Question Prompts

Yunshi Lan, Xiang Li, Xin Liu, Yang Li, Wei Qin, Weining Qian

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

VQA-GEN: A Visual Question Answering Benchmark for Domain Generalization

Suraj Jyothi Unni, Raha Moraffah, Huan Liu

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Language Guided Visual Question Answering: Elevate Your Multimodal Language Model Using Knowledge-Enriched Prompts

Deepanway Ghosal, Navonil Majumder, Roy Ka-Wei Lee, Rada Mihalcea, Soujanya Poria

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Enhancing BERT-Based Visual Question Answering through Keyword-Driven Sentence Selection

Davide Napolitano, Lorenzo Vaiani, Luca Cagliero

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.AI、cs.LG

Comments This paper is the technical research paper of CIKM 2023 DocIU challenges. The authors received the CIKM 2023 DocIU Winner Award, sponsored by Google, Microsoft, and the Centre for data-driven geoscience

Syntax Tree Constrained Graph Network for Visual Question Answering

Xiangrui Su, Qi Zhang, Chongyang Shi, Jiachang Liu, Liang Hu

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

VQA-GNN: Reasoning with Multimodal Knowledge via Graph Neural Networks for Visual Question Answering

Yanan Wang, Michihiro Yasunaga, Hongyu Ren, Shinya Wada, Jure Leskovec

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted at ICCV 2023

An Empirical Study on the Language Modal in Visual Question Answering

Daowan Peng, Wei Wei, Xian-Ling Mao, Yuanyuan Fu, Dangyang Chen

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted by IJCAI2023

SurgicalGPT: End-to-End Language-Vision GPT for Visual Question Answering in Surgery

Lalithkumar Seenivasan, Mobarakol Islam, Gokul Kannan, Hongliang Ren

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments The manuscript is accepted in MICCAI 2023. Code are available at: https://github.com/lalithjets/SurgicalGPT

Explaining Autonomous Driving Actions with Visual Question Answering

Shahin Atakishiyev, Mohammad Salameh, Housam Babiker, Randy Goebel

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted to the 2023 IEEE International Conference on Intelligent Transportation Systems (IEEE ITSC-2023)

Generative Visual Question Answering

Ethan Shen, Scotty Singh, Bhavesh Kumar

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Masked Vision and Language Pre-training with Unimodal and Multimodal Contrastive Losses for Medical Visual Question Answering

Pengfei Li, Gang Liu, Jinlong He, Zixu Zhao, Shenjun Zhong

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments accepted by MICCAI2023

Visual Question Answering in Remote Sensing with Cross-Attention and Multimodal Information Bottleneck

Jayesh Songara, Shivam Pande, Shabnam Choudhury, Biplab Banerjee, Rajbabu Velmurugan

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Medical Visual Question Answering: A Survey

Zhihong Lin, Donghao Zhang, Qingyi Tao, Danli Shi, Gholamreza Haffari, Qi Wu, Mingguang He, Zongyuan Ge

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Cross-Modal Causal Relational Reasoning for Event-Level Visual Question Answering

Yang Liu, Guanbin Li, Liang Lin

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments 17 pages, 9 figures. This work has been accepted by IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI). The datasets, code and models are available at https://github.com/HCPLab-SYSU/CMCIR

LiT-4-RSVQA: Lightweight Transformer-based Visual Question Answering in Remote Sensing

Leonard Hackel, Kai Norman Clasen, Mahdyar Ravanbakhsh, Begüm Demir

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Comments Accepted at IEEE International Geoscience and Remote Sensing Symposium 2023

Generate then Select: Open-ended Visual Question Answering Guided by World Knowledge

Xingyu Fu, Sheng Zhang, Gukyeong Kwon, Pramuditha Perera, Henghui Zhu, Yuhao Zhang, Alexander Hanbo Li, William Yang Wang, Zhiguo Wang, Vittorio Castelli, Patrick Ng, Dan Roth, Bing Xiang

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted to ACL 2023 Findings

Improving Visual Question Answering Models through Robustness Analysis and In-Context Learning with a Chain of Basic Questions

Jia-Hong Huang, Modar Alfadly, Bernard Ghanem, Marcel Worring

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments 28 pages

SC-ML: Self-supervised Counterfactual Metric Learning for Debiased Visual Question Answering

Xinyao Shu, Shiyang Yan, Xu Yang, Ziheng Wu, Zhongfeng Chen, Zhenyu Lu

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Transformer Module Networks for Systematic Generalization in Visual Question Answering

Moyuru Yamada, Vanessa D'Amario, Kentaro Takemoto, Xavier Boix, Tomotake Sasaki

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Polar-VQA: Visual Question Answering on Remote Sensed Ice sheet Imagery from Polar Region

Argho Sarkar, Maryam Rahnemoonfar

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Medical visual question answering using joint self-supervised learning

Yuan Zhou, Jing Mei, Yiqin Yu, Tanveer Syeda-Mahmood

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Visual Question Answering From Another Perspective: CLEVR Mental Rotation Tests

Christopher Beckham, Martin Weiss, Florian Golemo, Sina Honari, Derek Nowrouzezahrai, Christopher Pal

专题命中 视觉问答 ：visual question answering(title)；visual reasoning(abstract)；分类 cs.CV、cs.LG

Comments Accepted for publication to Pattern Recognition journal

PiggyBack: Pretrained Visual Question Answering Environment for Backing up Non-deep Learning Professionals

Zhihao Zhang, Siwen Luo, Junyi Chen, Sijia Lai, Siqu Long, Hyunsuk Chung, Soyeon Caren Han

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted by WSDM 2023

Text-Aware Dual Routing Network for Visual Question Answering

Luoqian Jiang, Yifan He, Jian Chen

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

LaKo: Knowledge-driven Visual Question Answering via Late Knowledge-to-Text Injection

Zhuo Chen, Yufeng Huang, Jiaoyan Chen, Yuxia Geng, Yin Fang, Jeff Pan, Ningyu Zhang, Wen Zhang

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments IJCKG 2022. Repository: github.com/hackerchenzhuo/LaKo

Self-supervised vision-language pretraining for Medical visual question answering

Pengfei Li, Gang Liu, Lin Tan, Jinying Liao, Shenjun Zhong

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments 5 pages, 3 figures