arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1805.06960cs.CLcs.CVcs.MM
收藏

不再问:在参考性视觉对话中决定何时猜测

Ask No More: Deciding when to guess in referential visual dialogue

University of Amsterdam(阿姆斯特丹大学);University of Trento(特伦托大学)

Ravi Shekhar, Tim Baumgartner, Aashish Venkatesh, Elia Bruni, Raffaella Bernardi, Raquel Fernandez

摘要:

我们的目标是探索如何在对话经理带来的能力,可以包括在端到端的视觉接地会话代理。我们通过增加一个面向任务的视觉对话模型来实现这一总体目标的初步步骤,该模型具有决策组件,该组件决定是否询问后续问题以确定图像中的目标所指对象,或者停止对话以进行猜测。我们的分析表明,增加决策组件会产生重复性更低的对话,包括更少的不必要的问题,从而可能导致更有效和更不自然的互动。

英文摘要:

Our goal is to explore how the abilities brought in by a dialogue manager can be included in end-to-end visually grounded conversational agents. We make initial steps towards this general goal by augmenting a task-oriented visual dialogue model with a decision-making component that decides whether to ask a follow-up question to identify a target referent in an image, or to stop the conversation to make a guess. Our analyses show that adding a decision making component produces dialogues that are less repetitive and that include fewer unnecessary questions, thus potentially leading to more efficient and less unnatural interactions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑