arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2310.03491cs.IRcs.LGcs.SE
收藏

TPDR:一种新颖的基于Transformer的两步式产品与类别描述匹配与检索方法

TPDR: A Novel Two-Step Transformer-based Product and Class Description Match and Retrieval Method

Federal University of Minas Gerais(米纳斯吉拉斯联邦大学);Federal University of São João del Rei(圣若昂德尔雷伊联邦大学)

Washington Cunha, Celso França, Leonardo Rocha, Marcos André Gonçalves

AI总结:

针对企业中介采购中的产品描述标准化匹配难题,提出基于Transformer的两步式检索方法TPDR,结合语义编码对比学习与句法特征重排序,在真实数据集上检索效果显著优于单一基线方法。

摘要:

有一类小众公司负责为其他企业中介采购大批量多样化产品,其面临的核心挑战是完成产品描述标准化,即将客户描述的商品与目录中收录的产品进行匹配。该问题十分复杂,因为客户的产品描述可能存在以下情况:(1)可能带有噪声;(2)内容简短且信息量不足(例如缺少型号和尺寸信息);(3)跨语言表述。本文将该问题形式化为一个排序任务:给定初始的客户产品规格(查询),返回最匹配的标准化描述(响应)。本文提出TPDR,即基于Transformer的两步式产品与类别描述检索方法,该方法通过利用注意力机制和对比学习,挖掘初始客户规格(IS)与标准化描述(SD)之间的语义对应关系。首先,TPDR将Transformer用作两个共享嵌入向量空间的编码器:一个用于编码IS,另一个用于编码SD,要求对应的(IS, SD)对在向量空间中距离相近。对比学习机制借助专门设计的损失函数进一步强化这种邻近性。TPDR还设置了第二个重排序步骤,基于句法特征进行排序,这些特征对于Transformer可能忽略的部分产品的精确匹配(如型号、尺寸)至关重要。为评估所提方法,我们采用了来自一家真实企业的11个数据集,覆盖不同的应用场景。我们的方案在71%的案例中能将正确的标准化产品检索到排序前5位,在80%的情况中能将正确类别排在首位。此外,相较于纯句法或纯语义基线方法,该方法的效果提升最高可达3.7倍,能够解决单一方法无法独立处理的案例。

英文摘要:

There is a niche of companies responsible for intermediating the purchase of large batches of varied products for other companies, for which the main challenge is to perform product description standardization, i.e., matching an item described by a client with a product described in a catalog. The problem is complex since the client's product description may be: (1) potentially noisy; (2) short and uninformative (e.g., missing information about model and size); and (3) cross-language. In this paper, we formalize this problem as a ranking task: given an initial client product specification (query), return the most appropriate standardized descriptions (response). In this paper, we propose TPDR, a two-step Transformer-based Product and Class Description Retrieval method that is able to explore the semantic correspondence between IS and SD, by exploiting attention mechanisms and contrastive learning. First, TPDR employs the transformers as two encoders sharing the embedding vector space: one for encoding the IS and another for the SD, in which corresponding pairs (IS, SD) must be close in the vector space. Closeness is further enforced by a contrastive learning mechanism leveraging a specialized loss function. TPDR also exploits a (second) re-ranking step based on syntactic features that are very important for the exact matching (model, dimension) of certain products that may have been neglected by the transformers. To evaluate our proposal, we consider 11 datasets from a real company, covering different application contexts. Our solution was able to retrieve the correct standardized product before the 5th ranking position in 71% of the cases and its correct category in the first position in 80% of the situations. Moreover, the effectiveness gains over purely syntactic or semantic baselines reach up to 3.7 times, solving cases that none of the approaches in isolation can do by themselves.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑