arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1707.06907cs.CV
收藏

什么看起来很好与我的沙发:多模态搜索引擎的室内设计

What Looks Good with my Sofa: Multimodal Search Engine for Interior Design

Polish-Japanese Academy of Information Technology(波兰日本信息技术学院);Tooploox;Warsaw University of Technology(华沙理工大学)

Ivona Tautkute, Aleksandra Możejko, Wojciech Stokowiec, Tomasz Trzciński, Łukasz Brocki, Krzysztof Marasek

摘要:

在本文中,我们提出了一个多模态的室内设计搜索引擎,结合视觉和文本查询。我们引擎的目标是检索与查询共享视觉和美学相似性的内部对象,例如家具或挂钟。我们的搜索引擎允许用户拍摄房间的照片,并以高召回率检索与照片中相同或视觉相似的项目列表。此外,它允许返回美学和风格上适合在一起的其他项目。为了实现这一目标,我们的系统融合了使用文本和视觉方式获得的结果。由于这种混合策略,我们将检索到的条目的平均风格相似度分数提高了11%。我们的工作是作为一个基于Web的应用程序,它计划向公众开放。

英文摘要:

In this paper, we propose a multi-modal search engine for interior design that combines visual and textual queries. The goal of our engine is to retrieve interior objects, e.g. furniture or wall clocks, that share visual and aesthetic similarities with the query. Our search engine allows the user to take a photo of a room and retrieve with a high recall a list of items identical or visually similar to those present in the photo. Additionally, it allows to return other items that aesthetically and stylistically fit well together. To achieve this goal, our system blends the results obtained using textual and visual modalities. Thanks to this blending strategy, we increase the average style similarity score of the retrieved items by 11%. Our work is implemented as a Web-based application and it is planned to be opened to the public.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑