arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2302.05093cs.IRcs.AIcs.MM
收藏

面向电子商业同类商品检索的统一视觉语言表示建模

Unified Vision-Language Representation Modeling for E-Commerce Same-Style Products Retrieval

Alibaba Group(阿里巴巴集团)

Ben Chen, Linbo Jin, Xinxin Wang, Dehong Gao, Wen Jiang, Wei Ning

摘要:

同类商品检索是电子商业平台中的一个重要环节,其目的是识别出可能具有不同文字描述或图片的同类商品。可用于不同供应商的同类产品检索或同一供应商的重复产品检测。常用的方法以图像为检测对象,但只考虑了图像的视觉特征,忽略了文本描述中包含的属性信息,对于机械、五金工具、电子元器件等图像不太重要的行业,即使增加文本匹配模块,效果也很差。本文提出了一种面向电子商业同类商品检索的统一视觉语言建模方法,该方法旨在用文本描述和视觉内容来表示同一商品。它包含一个抽样技术,收集积极的对用户点击日志与类别和相关性的约束,和一个新的对比损失单位模型的图像,文本,图像+文本表示到一个联合嵌入空间。它能够进行跨模态的产品到产品检索,以及风格转换和用户交互式搜索。离线测试表明它具有更好的检索性能,在线测试表明它可以吸引更多的点击和转换。此外,该模型已经在世界上最大的B2B电子商业平台alibaba.com上在线部署,用于类似产品检索。

英文摘要:

Same-style products retrieval plays an important role in e-commerce platforms, aiming to identify the same products which may have different text descriptions or images. It can be used for similar products retrieval from different suppliers or duplicate products detection of one supplier. Common methods use the image as the detected object, but they only consider the visual features and overlook the attribute information contained in the textual descriptions, and perform weakly for products in image less important industries like machinery, hardware tools and electronic component, even if an additional text matching module is added. In this paper, we propose a unified vision-language modeling method for e-commerce same-style products retrieval, which is designed to represent one product with its textual descriptions and visual contents. It contains one sampling skill to collect positive pairs from user click log with category and relevance constrained, and a novel contrastive loss unit to model the image, text, and image+text representations into one joint embedding space. It is capable of cross-modal product-to-product retrieval, as well as style transfer and user-interactive search. Offline evaluations on annotated data demonstrate its superior retrieval performance, and online testings show it can attract more clicks and conversions. Moreover, this model has already been deployed online for similar products retrieval in alibaba.com, the largest B2B e-commerce platform in the world.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑