Transformer赋能的电商图像搜索多模态商品嵌入
Transformer-empowered Multi-modal Item Embedding for Enhanced Image Search in E-Commerce
AI总结:
针对传统图像检索忽略语义且多图存储开销大,提出多模态商品嵌入模型MIEM,融合文本与多图语义提升检索准确率,部署于Shopee后点击与订单分别提升9.90%和4.23%。
摘要:
在过去十年中,电商应用的图像搜索领域取得了显著进展。传统的图像到图像检索模型仅关注图像细节(如纹理),往往忽略了图像中包含的有用语义信息。因此,检索到的商品可能具有相似的图像细节,但无法满足用户的搜索目标。此外,对于包含多张图像的商品,使用图像到图像检索模型会导致显著的在线商品特征存储开销和复杂的映射实现。在本文中,我们报告了所提出的多模态商品嵌入模型(MIEM)的设计与部署,以解决这些局限性。该模型能够利用商品的文本信息和多张图像来构建有意义的商品特征。通过利用图像的语义信息,MIEM有效补充了图像搜索过程,提高了检索结果的整体准确性。MIEM已成为Shopee图像搜索平台不可或缺的一部分。自2023年3月部署以来,在Shopee电商平台上,图像搜索功能的每用户点击量显著增加了9.90%,每用户订单量提升了4.23%。
英文摘要:
Over the past decade, significant advances have been made in the field of image search for e-commerce applications. Traditional image-to-image retrieval models, which focus solely on image details such as texture, tend to overlook useful semantic information contained within the images. As a result, the retrieved products might possess similar image details, but fail to fulfil the user's search goals. Moreover, the use of image-to-image retrieval models for products containing multiple images results in significant online product feature storage overhead and complex mapping implementations. In this paper, we report the design and deployment of the proposed Multi-modal Item Embedding Model (MIEM) to address these limitations. It is capable of utilizing both textual information and multiple images about a product to construct meaningful product features. By leveraging semantic information from images, MIEM effectively supplements the image search process, improving the overall accuracy of retrieval results. MIEM has become an integral part of the Shopee image search platform. Since its deployment in March 2023, it has achieved a remarkable 9.90% increase in terms of clicks per user and a 4.23% boost in terms of orders per user for the image search feature on the Shopee e-commerce platform.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。