arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2307.15858cs.LG
收藏

用于商品项分类的多输出头部集成

Multi-output Headed Ensembles for Product Item Classification

Fidelity Investments(富达投资);Rakuten Institute of Technology(乐天技术研究所)

Hotaka Shiokawa, Pradipto Das, Arthur Toth, Justin Chiu

AI总结:

本文针对大规模电商目录中商家标签错误导致的分类模型质量下降问题,提出一种结合平均集成与融合分类器的可扩展深度学习框架,并引入基于用户会话的模型性能评估新方法。

摘要:

在本文中,我们重新研究了大规模电商目录的商品项分类问题。电商目录的分类体系由数千个类别组成,商家持续上传的商品项被分配到这些类别中。商家的类别分配通常是错误的,但在自动生成的训练集中被视为真实标签,从而产生反馈循环,导致模型质量随时间推移而下降。由于缺乏规模较大的精选训练集,这种分类体系分类问题变得非常突出。在这种情况下,通常会结合多个分类器来克服单一分类器泛化性能差的问题。我们提出了一种可扩展的基于深度学习的分类模型框架,该框架受益于平均集成和基于融合的分类器的简单性和鲁棒性。我们还能够使用元数据特征和低级特征工程来提升分类性能。我们展示了这些改进相对于采用超参数优化的稳健行业标准基线模型的表现。此外,由于现实世界中海量电商目录的持续插入、删除和更新,使用 A/B 测试和/或人工标注来评估部署的模型性能成为瓶颈。为此,我们还提出了一种使用用户会话评估模型性能的新颖方法,该方法除了传统的精确率和召回率指标外,还提供了更好的洞察。

英文摘要:

In this paper, we revisit the problem of product item classification for large-scale e-commerce catalogs. The taxonomy of e-commerce catalogs consists of thousands of genres to which are assigned items that are uploaded by merchants on a continuous basis. The genre assignments by merchants are often wrong but treated as ground truth labels in automatically generated training sets, thus creating a feedback loop that leads to poorer model quality over time. This problem of taxonomy classification becomes highly pronounced due to the unavailability of sizable curated training sets. Under such a scenario it is common to combine multiple classifiers to combat poor generalization performance from a single classifier. We propose an extensible deep learning based classification model framework that benefits from the simplicity and robustness of averaging ensembles and fusion based classifiers. We are also able to use metadata features and low-level feature engineering to boost classification performance. We show these improvements against robust industry standard baseline models that employ hyperparameter optimization. Additionally, due to continuous insertion, deletion and updates to real-world high-volume e-commerce catalogs, assessing model performance for deployment using A/B testing and/or manual annotation becomes a bottleneck. To this end, we also propose a novel way to evaluate model performance using user sessions that provides better insights in addition to traditional measures of precision and recall.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑