arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2008.00544cs.CLcs.AIcs.CVcs.LG

Video Question Answering on Screencast Tutorials

Adobe Research(Adobe 研究院);Amazon Alexa AI(亚马逊 Alexa AI)

Wentian Zhao, Seokhwan Kim, Ning Xu, Hailin Jin

英文摘要:

This paper presents a new video question answering task on screencast tutorials. We introduce a dataset including question, answer and context triples from the tutorial videos for a software. Unlike other video question answering works, all the answers in our dataset are grounded to the domain knowledge base. An one-shot recognition algorithm is designed to extract the visual cues, which helps enhance the performance of video question answering. We also propose several baseline neural network architectures based on various aspects of video contexts from the dataset. The experimental results demonstrate that our proposed models significantly improve the question answering performances by incorporating multi-modal contexts and domain knowledge.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑