arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1708.03246cs.CLcs.AI
收藏

SESA:有监督的显式语义分析

SESA: Supervised Explicit Semantic Analysis

LinkedIn Corporation(领英公司)

Dasha Bogdanova, Majid Yazdani

摘要:

近年来,监督式表示学习已经在包括排序和信息检索的语义分析任务中提供了最新技术水平或接近最新技术水平的结果。其核心思想是学习如何将项目嵌入到潜在空间中,以便它们优化该潜在空间中的监督目标。潜在空间的维度没有明确的语义,这降低了系统的可解释性。例如,在个性化模型中,很难解释为什么特定项目对于给定的用户简档排名很高。我们提出了一种新的表示学习模型,称为监督显式语义分析(SESA),它以监督的方式进行训练,以将项目嵌入到一组具有显式语义的维度中。该模型通过在这个显式空间中表示两个对象来学习比较它们,其中每个维度对应于知识库中的一个概念。这项工作扩展了显式语义分析(ESA)与监督模型的排名问题。我们将此模型应用于LinkedIn中的工作简介相关性任务,其中一组技能定义了我们的空间的明确维度。每个配置文件和工作都被编码到这组技能中,它们的相似性在这个空间中计算。我们使用RNN将文本输入嵌入到这个空间中。除了可解释性之外,我们的模型还利用了用户为每个LinkedIn个人资料提供的网络规模的协作技能数据。我们的模型提供了最先进的结果,同时它仍然是可解释的。

英文摘要:

In recent years supervised representation learning has provided state of the art or close to the state of the art results in semantic analysis tasks including ranking and information retrieval. The core idea is to learn how to embed items into a latent space such that they optimize a supervised objective in that latent space. The dimensions of the latent space have no clear semantics, and this reduces the interpretability of the system. For example, in personalization models, it is hard to explain why a particular item is ranked high for a given user profile. We propose a novel model of representation learning called Supervised Explicit Semantic Analysis (SESA) that is trained in a supervised fashion to embed items to a set of dimensions with explicit semantics. The model learns to compare two objects by representing them in this explicit space, where each dimension corresponds to a concept from a knowledge base. This work extends Explicit Semantic Analysis (ESA) with a supervised model for ranking problems. We apply this model to the task of Job-Profile relevance in LinkedIn in which a set of skills defines our explicit dimensions of the space. Every profile and job are encoded to this set of skills their similarity is calculated in this space. We use RNNs to embed text input into this space. In addition to interpretability, our model makes use of the web-scale collaborative skills data that is provided by users for each LinkedIn profile. Our model provides state of the art result while it remains interpretable.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑