视觉大模型 / VLM

Solution for Meta KDD Cup'25: A Comprehensive Three-Step Framework for Vision Question Answering

Zijian Zhang, Xiaocheng Zhang, Yang Zhou, Zhimin Lin, Peng Yan

专题命中 视觉问答 ：visual question answering(abstract)

Enhancing Food-Domain Question Answering with a Multimodal Knowledge Graph: Hybrid QA Generation and Diversity Analysis

Srihari K B, Pushpak Bhattacharyya

专题命中 视觉问答 ：LLaVA(abstract)

Chart Question Answering from Real-World Analytical Narratives

Maeve Hutchinson, Radu Jianu, Aidan Slingsby, Jo Wood, Pranava Madhyastha

专题命中 视觉问答 ：multimodal large language model(abstract)

Comments This paper has been accepted to the ACL Student Research Workshop (SRW) 2025

Question Decomposition for Retrieval-Augmented Generation

Paul J. L. Ammann, Jonas Golde, Alan Akbik

机构 * Humboldt-Universität zu Berlin（柏林洪堡大学） 纠错

专题命中 视觉问答 ：grounding(abstract)

Comments Accepted to ACL SRW 2025. 9 Pages, 2 Figures, 4 Tables

Semantic-enhanced Modality-asymmetric Retrieval for Online E-commerce Search

Zhigong Zhou, Ning Ding, Xiaochuan Fan, Yue Shang, Yiming Qiu, Jingwei Zhuo, Zhiwei Ge, Songlin Wang, Lin Liu, Sulong Xu, Han Zhang

专题命中 视觉问答 ：visual question answering(abstract)

Comments published in sigir2023

MM-AttacKG: A Multimodal Approach to Attack Graph Construction with Large Language Models

Yongheng Zhang, Xinyun Zhao, Yunshan Ma, Haokai Ma, Yingxiao Guan, Guozheng Yang, Yuliang Lu, Xiang Wang

专题命中 视觉问答 ：multimodal large language model(abstract)

ChartReasoner: Code-Driven Modality Bridging for Long-Chain Reasoning in Chart Question Answering

Caijun Jia, Nan Xu, Jingxuan Wei, Qingli Wang, Lei Wang, Bihui Yu, Junnan Zhu

机构 * MAIS, Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所MAIS研究所） ； Shenyang Institute of Computing Technology, Chinese Academy of Sciences（中国科学院沈阳计算技术研究所） ； Beijing Wenge Technology Co., Ltd.（北京文耕科技有限公司） ； University of Chinese Academy of Sciences（中国科学院大学） 纠错

专题命中 视觉问答 ：visual reasoning(abstract)

ComposeRAG: A Modular and Composable RAG for Corpus-Grounded Multi-Hop Question Answering

Ruofan Wu, Youngwon Lee, Fan Shu, Danmei Xu, Seung-won Hwang, Zhewei Yao, Yuxiong He, Feng Yan

机构 * University of Houston（德克萨斯大学休斯敦分校） ； Seoul National University（首尔国立大学） ； Snowflake AI Research（Snowflake人工智能研究） 纠错

专题命中 视觉问答 ：grounding(abstract)

Addressing Blind Guessing: Calibration of Selection Bias in Multiple-Choice Question Answering by Video Language Models

Olga Loginova, Oleksandr Bezrukov, Ravi Shekhar, Alexey Kravets

机构 * University of Trento（特伦托大学） ； Gran Sasso Science Institute（格兰萨索科学研究所） ； University of Essex（埃塞克斯大学） ； University of Bath（巴斯大学） 纠错

专题命中 视觉问答 ：VLM(abstract)

Generative Semantic Communication via Textual Prompts: Latency Performance Tradeoffs

Mengmeng Ren, Li Qiao, Long Yang, Zhen Gao, Jian Chen, Mahdi Boloursaz Mashhadi, Pei Xiao, Rahim Tafazolli, Mehdi Bennis

专题命中 视觉问答 ：vision language model(abstract)

Comments Accepted by IEEE Transactions on Vehicular Technology

Talk Before You Retrieve: Agent-Led Discussions for Better RAG in Medical QA

Xuanzhao Dong, Wenhui Zhu, Hao Wang, Xiwen Chen, Peijie Qiu, Rui Yin, Yi Su, Yalin Wang

机构 * Arizona State University（亚利桑那州立大学） ； Clemson University（克莱姆森大学） ； Washington University in St.Louis（圣路易斯华盛顿大学） ； Banner Alzheimer’s Institute（班纳阿尔茨海默病研究所） 纠错

专题命中 视觉问答 ：VLM(abstract)

ChartQAPro: A More Diverse and Challenging Benchmark for Chart Question Answering

Ahmed Masry, Mohammed Saidul Islam, Mahir Ahmed, Aayush Bajaj, Firoz Kabir, Aaryaman Kartha, Md Tahmid Rahman Laskar, Mizanur Rahman, Shadikur Rahman, Mehrad Shahmohammadi, Megh Thakkar, Md Rizwan Parvez, Enamul Hoque, Shafiq Joty

专题命中 视觉问答 ：vision-language model(abstract)

Graph-Based Multimodal Contrastive Learning for Chart Question Answering

Yue Dai, Soyeon Caren Han, Wei Liu

专题命中 视觉问答 ：multimodal large language model(abstract)

Comments Accepted at SIGIR 2025

Right for Right Reasons: Large Language Models for Verifiable Commonsense Knowledge Graph Question Answering

Armin Toroghi, Willis Guo, Mohammad Mahdi Abdollah Pour, Scott Sanner

专题命中 视觉问答 ：grounding(abstract)

Comments 33 pages, EMNLP24

Chameleon: Mixed-Modal Early-Fusion Foundation Models

Chameleon Team

专题命中 视觉问答 ：visual question answering(abstract)

Open-Ended and Knowledge-Intensive Video Question Answering

Md Zarif Ul Alam, Hamed Zamani

专题命中 视觉问答 ：vision language model(abstract)

Expect the Unexpected: FailSafe Long Context QA for Finance

Kiran Kamble, Melisa Russak, Dmytro Mozolevskyi, Muayad Ali, Mateusz Russak, Waseem AlShikh

专题命中 视觉问答 ：grounding(abstract)

Advancing Singlish Understanding: Bridging the Gap with Datasets and Multimodal Models

Bin Wang, Xunlong Zou, Shuo Sun, Wenyu Zhang, Yingxu He, Zhuohan Liu, Chengwei Wei, Nancy F. Chen, AiTi Aw

专题命中 视觉问答 ：multimodal large language model(abstract)

Comments Open-Source: https://github.com/AudioLLMs/Singlish

From Models to Microtheories: Distilling a Model's Topical Knowledge for Grounded Question Answering

Nathaniel Weir, Bhavana Dalvi Mishra, Orion Weller, Oyvind Tafjord, Sam Hornstein, Alexander Sabol, Peter Jansen, Benjamin Van Durme, Peter Clark

专题命中 视觉问答 ：grounding(abstract)

Domain-specific Question Answering with Hybrid Search

Dewang Sultania, Zhaoyu Lu, Twisha Naik, Franck Dernoncourt, David Seunghyun Yoon, Sanat Sharma, Trung Bui, Ashok Gupta, Tushar Vatsa, Suhas Suresha, Ishita Verma, Vibha Belavadi, Cheng Chen, Michael Friedrich

专题命中 视觉问答 ：grounding(abstract)

Comments AAAI-25 Workshop on Document Understanding and Intelligence

Overview of TREC 2024 Biomedical Generative Retrieval (BioGen) Track

Deepak Gupta, Dina Demner-Fushman, William Hersh, Steven Bedrick, Kirk Roberts

专题命中 视觉问答 ：grounding(abstract)

De-biased Multimodal Electrocardiogram Analysis

Haitao Li, Ziyu Li, Yiheng Mao, Ziyi Liu, Zhoujian Sun, Zhengxing Huang

专题命中 视觉问答 ：multimodal large language model(abstract)

WorldMedQA-V: a multilingual, multimodal medical examination dataset for multimodal language models evaluation

João Matos, Shan Chen, Siena Placino, Yingya Li, Juan Carlos Climent Pardo, Daphna Idan, Takeshi Tohyama, David Restrepo, Luis F. Nakayama, Jose M. M. Pascual-Leone, Guergana Savova, Hugo Aerts, Leo A. Celi, A. Ian Wong, Danielle S. Bitterman, Jack Gallifant

专题命中 视觉问答 ：vision language model(abstract)

Comments submitted for review, total of 14 pages

LargePiG: Your Large Language Model is Secretly a Pointer Generator

Zhongxiang Sun, Zihua Si, Xiaoxue Zang, Kai Zheng, Yang Song, Xiao Zhang, Jun Xu

专题命中 视觉问答 ：vision language model(abstract)

Comments 24 pages

Measuring the Groundedness of Legal Question-Answering Systems

Dietrich Trautmann, Natalia Ostapuk, Quentin Grail, Adrian Alan Pol, Guglielmo Bonifazi, Shang Gao, Martin Gajek

专题命中 视觉问答 ：grounding(abstract)

Comments to appear NLLP @ EMNLP 2024

FoodieQA: A Multimodal Dataset for Fine-Grained Understanding of Chinese Food Culture

Wenyan Li, Xinyu Zhang, Jiaang Li, Qiwei Peng, Raphael Tang, Li Zhou, Weijia Zhang, Guimin Hu, Yifei Yuan, Anders Søgaard, Daniel Hershcovich, Desmond Elliott

专题命中 视觉问答 ：vision-language model(abstract)

Generate-then-Ground in Retrieval-Augmented Generation for Multi-hop Question Answering

Zhengliang Shi, Weiwei Sun, Shen Gao, Pengjie Ren, Zhumin Chen, Zhaochun Ren

专题命中 视觉问答 ：grounding(abstract)

Comments ACL 2024 (main conference)

Sportify: Question Answering with Embedded Visualizations and Personified Narratives for Sports Video

Chunggi Lee, Tica Lin, Hanspeter Pfister, Chen Zhu-Tian

专题命中 视觉问答 ：visual question answering(abstract)

Comments 14 pages, 8 figures, conference

MMPKUBase: A Comprehensive and High-quality Chinese Multi-modal Knowledge Graph

Xuan Yi, Yanzeng Li, Lei Zou

专题命中 视觉问答 ：visual question answering(abstract)

PipeNet: Question Answering with Semantic Pruning over Knowledge Graphs

Ying Su, Jipeng Zhang, Yangqiu Song, Tong Zhang

专题命中 视觉问答 ：grounding(abstract)

Comments 8 pages, 4 figures, accepted to *SEM 2024

Journal ref https://aclanthology.org/2024.starsem-1.29