视觉大模型 / VLM - arXivDaily 专题

2406.07080 2024-06-12 cs.CL 50%

DARA: Decomposition-Alignment-Reasoning Autonomous Language Agent for Question Answering over Knowledge Graphs

Haishuo Fang, Xiaodan Zhu, Iryna Gurevych

专题命中视觉问答：grounding(abstract)

Comments Accepted by ACL2024 findings

2311.11598 2024-06-11 cs.CL 50%

Filling the Image Information Gap for VQA: Prompting Large Language Models to Proactively Ask Questions

Ziyue Wang, Chi Chen, Peng Li, Yang Liu

专题命中视觉问答：visual question answering(abstract)

Comments Accepted to EMNLP2023 Findings

Journal ref https://aclanthology.org/2023.findings-emnlp.189/

2402.08327 2024-06-06 cs.CL 50%

PreFLMR: Scaling Up Fine-Grained Late-Interaction Multi-modal Retrievers

Weizhe Lin, Jingbiao Mei, Jinghong Chen, Bill Byrne

专题命中视觉问答：visual question answering(abstract)

Comments ACL 2024; Project page: https://preflmr.github.io/

2405.16021 2024-06-03 cs.RO 50%

VADER: Visual Affordance Detection and Error Recovery for Multi Robot Human Collaboration

Michael Ahn, Montserrat Gonzalez Arenas, Matthew Bennice, Noah Brown, Christine Chan, Byron David, Anthony Francis, Gavin Gonzalez, Rainer Hessmer, Tomas Jackson, Nikhil J Joshi, Daniel Lam, Tsang-Wei Edward Lee, Alex Luong, Sharath Maddineni, Harsh Patel, Jodilyn Peralta, Jornell Quiambao, Diego Reyes, Rosario M Jauregui Ruano, Dorsa Sadigh, Pannag Sanketi, Leila Takayama, Pavel Vodenski, Fei Xia

专题命中视觉问答：visual question answering(abstract)

Comments 9 pages, 4 figures

2404.14567 2024-04-24 cs.CL 50%

WangLab at MEDIQA-M3G 2024: Multimodal Medical Answer Generation using Large Language Models

Ronald Xie, Steven Palayew, Augustin Toma, Gary Bader, Bo Wang

专题命中视觉问答：visual question answering(abstract)

2403.19454 2024-03-29 cs.CL 50%

JDocQA: Japanese Document Question Answering Dataset for Generative Language Models

Eri Onami, Shuhei Kurita, Taiki Miyanishi, Taro Watanabe

专题命中视觉问答：visual question answering(abstract)

Comments LREC-COLING2024

2402.11770 2024-02-21 cs.CL 50%

Structured Chain-of-Thought Prompting for Few-Shot Generation of Content-Grounded QA Conversations

Md Arafat Sultan, Jatin Ganhotra, Ramón Fernandez Astudillo

专题命中视觉问答：grounding(abstract)

2311.07878 2024-01-04 cs.IR 50%

Evaluating LLMs on Document-Based QA: Exact Answer Selection and Numerical Extraction using Cogtale dataset

Zafaryab Rasool, Stefanus Kurniawan, Sherwin Balugo, Scott Barnett, Rajesh Vasa, Courtney Chesser, Benjamin M. Hampstead, Sylvie Belleville, Kon Mouzakis, Alex Bahar-Fuchs

专题命中视觉问答：grounding(abstract)

Comments 10 pages, 1 figure

2312.15021 2023-12-27 cs.CL 50%

Towards a Unified Multimodal Reasoning Framework

Abhinav Arun, Dipendra Singh Mal, Mehul Soni, Tomohiro Sawada

专题命中视觉问答：visual question answering(abstract)

Comments 6 pages, 11 figures

2305.10512 2023-12-19 cs.CL cs.HC 50%

IMAD: IMage-Augmented multi-modal Dialogue

Viktor Moskvoretskii, Anton Frolov, Denis Kuznetsov

专题命中视觉问答：visual question answering(abstract)

Comments Main part contains 6 pages, 4 figures. It was accepted on AINL. We wait the publication and DOI

2311.08584 2023-11-16 cs.CL 50%

Asking More Informative Questions for Grounded Retrieval

Sedrick Keh, Justin T. Chiu, Daniel Fried

专题命中视觉问答：visual question answering(abstract)

2310.20170 2023-11-01 cs.CL 50%

DIVKNOWQA: Assessing the Reasoning Ability of LLMs via Open-Domain Question Answering over Knowledge Base and Text

Wenting Zhao, Ye Liu, Tong Niu, Yao Wan, Philip S. Yu, Shafiq Joty, Yingbo Zhou, Semih Yavuz

专题命中视觉问答：grounding(abstract)

2310.16568 2023-10-26 cs.CL 50%

1-PAGER: One Pass Answer Generation and Evidence Retrieval

Palak Jain, Livio Baldini Soares, Tom Kwiatkowski

专题命中视觉问答：grounding(abstract)

Comments Accepted at EMNLP 2023 (Findings)

2305.15294 2023-10-24 cs.CL 50%

Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergy

Zhihong Shao, Yeyun Gong, Yelong Shen, Minlie Huang, Nan Duan, Weizhu Chen

专题命中视觉问答：grounding(abstract)

Comments Preprint

2305.12199 2023-07-05 cs.CL 50%

VNHSGE: VietNamese High School Graduation Examination Dataset for Large Language Models

Xuan-Quy Dao, Ngoc-Bich Le, The-Duy Vo, Xuan-Dung Phan, Bac-Bien Ngo, Van-Tien Nguyen, Thi-My-Thanh Nguyen, Hong-Phuoc Nguyen

专题命中视觉问答：visual question answering(abstract)

Comments 74 pages, 44 figures

2305.15225 2023-06-27 cs.CL 50%

SAIL: Search-Augmented Instruction Learning

Hongyin Luo, Yung-Sung Chuang, Yuan Gong, Tianhua Zhang, Yoon Kim, Xixin Wu, Danny Fox, Helen Meng, James Glass

专题命中视觉问答：grounding(abstract)

2306.07198 2023-06-13 cs.CL 50%

A Survey of Vision-Language Pre-training from the Lens of Multimodal Machine Translation

Jeremy Gwinnup, Kevin Duh

专题命中视觉问答：visual question answering(abstract)

Comments 10 pages

2305.13703 2023-05-24 cs.CL 50%

MemeCap: A Dataset for Captioning and Interpreting Memes

EunJeong Hwang, Vered Shwartz

专题命中视觉问答：visual question answering(abstract)

2302.04833 2023-02-10 cs.CR cs.DB 50%

Pushing the Boundaries of Private, Large-Scale Query Answering

Brendan Avent, Aleksandra Korolova

专题命中视觉问答：grounding(abstract)

Comments Workshop on Privacy-Preserving Artificial Intelligence (PPAI-23), AAAI, 2023

2211.05190 2022-11-11 cs.CL 50%

Towards Reasoning-Aware Explainable VQA

Rakesh Vaideeswaran, Feng Gao, Abhinav Mathur, Govind Thattai

专题命中视觉问答：visual question answering(abstract)

2208.10297 2022-08-23 cs.CL 50%

Locate Then Ask: Interpretable Stepwise Reasoning for Multi-hop Question Answering

Siyuan Wang, Zhongyu Wei, Zhihao Fan, Qi Zhang, Xuanjing Huang

专题命中视觉问答：grounding(abstract)

Comments 11 pages, 6 figures, 6 tables, accepted as a long paper to COLING 2022

2206.15030 2022-07-01 cs.CL 50%

Modern Question Answering Datasets and Benchmarks: A Survey

Zhen Wang

专题命中视觉问答：visual question answering(abstract)

2112.10255 2021-12-21 eess.SP 50%

Task-Oriented Multi-User Semantic Communications

Huiqiang Xie, Zhijin Qin, Xiaoming Tao, Khaled B. Letaief

专题命中视觉问答：visual question answering(abstract)

Comments 14 pages, 11 figures

2108.07357 2021-12-15 eess.SP 50%

Task-Oriented Multi-User Semantic Communications for VQA Task

Huiqiang Xie, Zhijin Qin, Geoffrey Ye Li

专题命中视觉问答：visual question answering(abstract)

Comments 5 pages, 4 figures

2109.04014 2021-09-10 cs.CL 50%

Weakly-Supervised Visual-Retriever-Reader for Knowledge-based Question Answering

Man Luo, Yankai Zeng, Pratyay Banerjee, Chitta Baral

专题命中视觉问答：visual question answering(abstract)

Comments accepted at EMNLP 2021

2105.11210 2021-05-25 cs.CL 50%

StructuralLM: Structural Pre-training for Form Understanding

Chenliang Li, Bin Bi, Ming Yan, Wei Wang, Songfang Huang, Fei Huang, Luo Si

专题命中视觉问答：visual question answering(abstract)

Comments Accepted by ACL2021 main conference

2104.06645 2021-04-15 cs.CL 50%

Jointly Learning Truth-Conditional Denotations and Groundings using Parallel Attention

Leon Bergen, Dzmitry Bahdanau, Timothy J. O'Donnell

专题命中视觉问答：visual question answering(abstract)

2011.00669 2020-11-03 cs.CL 50%

Reasoning Over History: Context Aware Visual Dialog

Muhammad A. Shah, Shikib Mehri, Tejas Srinivasan

专题命中视觉问答：visual question answering(abstract)

Comments Accepted to NLP Beyond Text workshop, EMNLP 2020

2010.03160 2020-10-08 cs.HC 50%

Vision Skills Needed to Answer Visual Questions

Xiaoyu Zeng, Yanan Wang, Tai-Yin Chiu, Nilavra Bhattacharya, Danna Gurari

专题命中视觉问答：visual question answering(abstract)

Comments To be published on Proceedings of the ACM on Human-Computer Interaction, Vol. 4, No. CSCW2, Article 149. Publication date: October 2020

2004.01894 2020-04-07 cs.CL 50%

Evaluating Multimodal Representations on Visual Semantic Textual Similarity

Oier Lopez de Lacalle, Ander Salaberria, Aitor Soroa, Gorka Azkune, Eneko Agirre

专题命中视觉问答：visual question answering(abstract)

Comments Accepted in ECAI-2020, 8 pages, 6 tables, 6 figures

1. 视觉问答 3153 篇

DARA: Decomposition-Alignment-Reasoning Autonomous Language Agent for Question Answering over Knowledge Graphs

Filling the Image Information Gap for VQA: Prompting Large Language Models to Proactively Ask Questions

PreFLMR: Scaling Up Fine-Grained Late-Interaction Multi-modal Retrievers

VADER: Visual Affordance Detection and Error Recovery for Multi Robot Human Collaboration

WangLab at MEDIQA-M3G 2024: Multimodal Medical Answer Generation using Large Language Models

JDocQA: Japanese Document Question Answering Dataset for Generative Language Models

Structured Chain-of-Thought Prompting for Few-Shot Generation of Content-Grounded QA Conversations

Evaluating LLMs on Document-Based QA: Exact Answer Selection and Numerical Extraction using Cogtale dataset

Towards a Unified Multimodal Reasoning Framework

IMAD: IMage-Augmented multi-modal Dialogue

Asking More Informative Questions for Grounded Retrieval

DIVKNOWQA: Assessing the Reasoning Ability of LLMs via Open-Domain Question Answering over Knowledge Base and Text

1-PAGER: One Pass Answer Generation and Evidence Retrieval

Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergy

VNHSGE: VietNamese High School Graduation Examination Dataset for Large Language Models

SAIL: Search-Augmented Instruction Learning

A Survey of Vision-Language Pre-training from the Lens of Multimodal Machine Translation

MemeCap: A Dataset for Captioning and Interpreting Memes

Pushing the Boundaries of Private, Large-Scale Query Answering

Towards Reasoning-Aware Explainable VQA

Locate Then Ask: Interpretable Stepwise Reasoning for Multi-hop Question Answering

Modern Question Answering Datasets and Benchmarks: A Survey

Task-Oriented Multi-User Semantic Communications

Task-Oriented Multi-User Semantic Communications for VQA Task

Weakly-Supervised Visual-Retriever-Reader for Knowledge-based Question Answering

StructuralLM: Structural Pre-training for Form Understanding

Jointly Learning Truth-Conditional Denotations and Groundings using Parallel Attention

Reasoning Over History: Context Aware Visual Dialog

Vision Skills Needed to Answer Visual Questions

Evaluating Multimodal Representations on Visual Semantic Textual Similarity