arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2003.00708cs.IRcs.AI
收藏

使用图像标题和多任务学习推荐查询重构

Using Image Captions and Multitask Learning for Recommending Query Reformulations

Adobe Research(奥多比研究院);IBM Research(国际商业机器公司研究院);Adobe Inc.(奥多比公司);Indian Institute of Technology Delhi(德里印度理工学院);Carnegie Mellon University(卡内基梅隆大学)

Gaurav Verma, Vishwa Vinay, Sahil Bansal, Shashank Oberoi, Makkunda Sharma, Prakhar Gupta

摘要:

交互式搜索会话通常包含多个查询,其中用户提交先前查询的重构版本以响应原始结果。我们的目标是提高商业图像搜索引擎的查询推荐体验。我们提出的方法结合了当前最先进的做法,从相关文献-使用基于生成的序列到序列模型,捕获会话上下文,和多任务架构,同时优化结果的排名。我们扩展了这种设置,通过使用点击图像的标题作为目标来驱动这种模型的学习,而不是使用会话中的后续查询。由于这些标题往往在语言上更丰富,因此可以将重构机制视为有助于构建更具描述性的查询。此外,通过使用成对损失的二级排名任务,我们表明,所产生的重新更多样化。

英文摘要:

Interactive search sessions often contain multiple queries, where the user submits a reformulated version of the previous query in response to the original results. We aim to enhance the query recommendation experience for a commercial image search engine. Our proposed methodology incorporates current state-of-the-art practices from relevant literature -- the use of generation-based sequence-to-sequence models that capture session context, and a multitask architecture that simultaneously optimizes the ranking of results. We extend this setup by driving the learning of such a model with captions of clicked images as the target, instead of using the subsequent query within the session. Since these captions tend to be linguistically richer, the reformulation mechanism can be seen as assistance to construct more descriptive queries. In addition, via the use of a pairwise loss for the secondary ranking task, we show that the generated reformulations are more diverse.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑