arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2205.09327cs.AIcs.CLcs.CV
收藏

我们谈谈吧!通过会话视觉问题生成启动会话

Let's Talk! Striking Up Conversations via Conversational Visual Question Generation

Academia Sinica(中央研究院);The Pennsylvania State University(宾夕法尼亚州立大学);Institute for Information Industry(资讯工业策进会)

Shih-Han Chan, Tsai-Lun Yang, Yun-Wei Chu, Chi-Yang Hsu, Ting-Hao Huang, Yu-Shian Chiu, Lun-Wei Ku

摘要:

一个吸引人和挑衅性的问题可以打开一个伟大的谈话。在这项工作中,我们探索了一个新的场景:会话代理查看一组用户的照片(例如,从社交媒体平台),并询问一个有吸引力的问题,发起与用户的对话。现有的视觉-问题模型大多生成乏味而明显的问题,这可能不是理想的会话启动器。本文介绍了一个两阶段的框架,首先生成一个视觉故事的照片集,然后使用的故事,以产生一个有趣的问题。人工评估表明,我们的框架比其他视觉到问题基线生成更多的引发响应的问题来开始对话。

英文摘要:

An engaging and provocative question can open up a great conversation. In this work, we explore a novel scenario: a conversation agent views a set of the user's photos (for example, from social media platforms) and asks an engaging question to initiate a conversation with the user. The existing vision-to-question models mostly generate tedious and obvious questions, which might not be ideals conversation starters. This paper introduces a two-phase framework that first generates a visual story for the photo set and then uses the story to produce an interesting question. The human evaluation shows that our framework generates more response-provoking questions for starting conversations than other vision-to-question baselines.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑