arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1809.01124cs.CVcs.AI
收藏

直奔事实:学习知识库检索的事实视觉问答

Straight to the Facts: Learning Knowledge Base Retrieval for Factual Visual Question Answering

University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)

Medhini Narasimhan, Alexander G. Schwing

摘要:

问答是自主智能体和虚拟助手的重要任务,并被证明可以支持残疾人有效地浏览压倒性的环境。许多现有的方法专注于基于观察的问题,忽略了我们将观察到的内容与一般知识无缝结合的能力。为了理解与知识库的交互,最近引入了一个数据集,关键字匹配技术被证明可以产生令人信服的结果,尽管由于同义词和同形异义词而容易产生误解。为了解决这个问题,我们开发了一种基于学习的方法,通过学习的嵌入空间直接进入事实。我们展示了最先进的结果,具有挑战性的最近推出的基于事实的视觉问答数据集,超过竞争的方法超过5%。

英文摘要:

Question answering is an important task for autonomous agents and virtual assistants alike and was shown to support the disabled in efficiently navigating an overwhelming environment. Many existing methods focus on observation-based questions, ignoring our ability to seamlessly combine observed content with general knowledge. To understand interactions with a knowledge base, a dataset has been introduced recently and keyword matching techniques were shown to yield compelling results despite being vulnerable to misconceptions due to synonyms and homographs. To address this issue, we develop a learning-based approach which goes straight to the facts via a learned embedding space. We demonstrate state-of-the-art results on the challenging recently introduced fact-based visual question answering dataset, outperforming competing methods by more than 5%.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑