There is a niche of companies responsible for intermediating the purchase of large batches of varied products for other companies, for which the main challenge is to perform product description standardization, i.e., matching an item described by a client with a product described in a catalog. The problem is complex since the client's product description may be: (1) potentially noisy; (2) short and uninformative (e.g., missing information about model and size); and (3) cross-language. In this paper, we formalize this problem as a ranking task: given an initial client product specification (query), return the most appropriate standardized descriptions (response). In this paper, we propose TPDR, a two-step Transformer-based Product and Class Description Retrieval method that is able to explore the semantic correspondence between IS and SD, by exploiting attention mechanisms and contrastive learning. First, TPDR employs the transformers as two encoders sharing the embedding vector space: one for encoding the IS and another for the SD, in which corresponding pairs (IS, SD) must be close in the vector space. Closeness is further enforced by a contrastive learning mechanism leveraging a specialized loss function. TPDR also exploits a (second) re-ranking step based on syntactic features that are very important for the exact matching (model, dimension) of certain products that may have been neglected by the transformers. To evaluate our proposal, we consider 11 datasets from a real company, covering different application contexts. Our solution was able to retrieve the correct standardized product before the 5th ranking position in 71% of the cases and its correct category in the first position in 80% of the situations. Moreover, the effectiveness gains over purely syntactic or semantic baselines reach up to 3.7 times, solving cases that none of the approaches in isolation can do by themselves.
DeepTileBars: Visualizing Term Distribution for Neural Information Retrieval
Georgetown University(乔治城大学)
大多数神经信息检索(Neu-IR)模型基于术语级匹配来获得查询到文档排序分数。受经典术语分布可视化方法TileBars的启发,本文提出了一种新的Neu-IR模型,该模型在子主题和更高级别上处理查询到文档的匹配。我们的系统首先将文档拆分为主题片段,“可视化”查询和片段之间的匹配,然后将交互矩阵馈送到Neu-IR模型DeepTileBars中,以获得最终的排名分数。DeepTileBars对文档主题层次结构中不同粒度的相关性信号进行建模。它更好地捕捉文档的话语结构,从而匹配模式。虽然它的设计和实现是轻量级的,但DeepTileBars在基准数据集上的表现优于其他最先进的Neu-IR模型,包括文本检索会议(TREC)2010-2012 Web Tracks和LETOR 4.0。