arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2408.11345cs.IR
收藏

学习高效的深度树结构检索器以提高推荐效率:理论与方法

Learning Deep Tree-based Retriever for Efficient Recommendation: Theory and Method

University of Science and Technology of China(中国科学技术大学)

Ze Liu, Jin Zhang, Chao Feng, Defu Lian, Jie Wang, Enhong Chen

AI总结:

本文提出深度树结构检索器DTR,通过softmax多类分类和树采样方法提升推荐效率,理论和实验验证其有效性。

摘要:

尽管深度学习的进步显著提高了深度推荐模型的推荐准确性,但这些方法仍然存在推荐效率低下的问题。最近提出的基于树的深度推荐模型通过在推荐目标的指导下直接学习树结构和表示来缓解这一问题。为了保证束搜索在推荐准确性上的有效性,这些模型努力确保树结构符合最大堆假设,即父节点的偏好应是其子节点偏好中的最大值。然而,它们采用了一对多的策略,将训练任务视为每个节点的独立二分类目标序列,这限制了它们完全满足最大堆假设的能力。为此,我们提出了一个深度树结构检索器(DTR,简称)以实现高效的推荐。DTR将训练任务视为树节点在同一层次上的softmax多类分类,使节点之间能够进行显式的横向竞争,并在它们之间产生更具判别性的top-k选择,这在训练过程中模拟了束搜索行为。为了缓解由于非叶节点标签带来的次优化问题,我们提出了一种修正损失函数的方法,进一步在期望上与最大堆假设保持一致。由于树节点数量随着层次增长呈指数级增加,我们采用采样softmax来近似优化,从而提高效率。此外,我们提出了一种基于树的采样方法以减少采样softmax中固有的偏差。理论结果揭示了DTR的泛化能力,且修正方法和基于树的采样都对提升泛化能力有所贡献。实验在四个真实世界数据集上进行,验证了所提出方法的有效性。

英文摘要:

Although advancements in deep learning have significantly enhanced the recommendation accuracy of deep recommendation models, these methods still suffer from low recommendation efficiency. Recently proposed tree-based deep recommendation models alleviate the problem by directly learning tree structure and representations under the guidance of recommendation objectives. To guarantee the effectiveness of beam search for recommendation accuracy, these models strive to ensure that the tree adheres to the max-heap assumption, where a parent node's preference should be the maximum among its children's preferences. However, they employ a one-versus-all strategy, framing the training task as a series of independent binary classification objectives for each node, which limits their ability to fully satisfy the max-heap assumption. To this end, we propose a Deep Tree-based Retriever (DTR for short) for efficient recommendation. DTR frames the training task as a softmax-based multi-class classification over tree nodes at the same level, enabling explicit horizontal competition and more discriminative top-k selection among them, which mimics the beam search behavior during training. To mitigate the suboptimality induced by the labeling of non-leaf nodes, we propose a rectification method for the loss function, which further aligns with the max-heap assumption in expectation. As the number of tree nodes grows exponentially with the levels, we employ sampled softmax to approximate optimization and thereby enhance efficiency. Furthermore, we propose a tree-based sampling method to reduce the bias inherent in sampled softmax. Theoretical results reveal DTR's generalization capability, and both the rectification method and tree-based sampling contribute to improved generalization. The experiments are conducted on four real-world datasets, validating the effectiveness of the proposed method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑