In recent years supervised representation learning has provided state of the art or close to the state of the art results in semantic analysis tasks including ranking and information retrieval. The core idea is to learn how to embed items into a latent space such that they optimize a supervised objective in that latent space. The dimensions of the latent space have no clear semantics, and this reduces the interpretability of the system. For example, in personalization models, it is hard to explain why a particular item is ranked high for a given user profile. We propose a novel model of representation learning called Supervised Explicit Semantic Analysis (SESA) that is trained in a supervised fashion to embed items to a set of dimensions with explicit semantics. The model learns to compare two objects by representing them in this explicit space, where each dimension corresponds to a concept from a knowledge base. This work extends Explicit Semantic Analysis (ESA) with a supervised model for ranking problems. We apply this model to the task of Job-Profile relevance in LinkedIn in which a set of skills defines our explicit dimensions of the space. Every profile and job are encoded to this set of skills their similarity is calculated in this space. We use RNNs to embed text input into this space. In addition to interpretability, our model makes use of the web-scale collaborative skills data that is provided by users for each LinkedIn profile. Our model provides state of the art result while it remains interpretable.
Weakly Supervised Semantic Segmentation for Large-Scale Point Cloud
Xiamen University(厦门大学);East China Normal University(华东师范大学);JD AI Research(京东人工智能研究院)
现有的大规模点云语义分割方法需要昂贵、繁琐且容易出错的手动逐点注释。直观的弱监督训练是降低标签成本的直接解决方案。然而,对于弱监督的大规模点云语义分割,标注过少必然导致网络学习效果不佳。我们提出了一个有效的弱监督方法包含两个组件来解决上述问题。首先,我们构建一个借口任务,\textit{i.e.,}点云着色,与自监督学习转移学习的先验知识,从大量的未标记的点云到一个弱监督网络。通过这种方式,弱监督网络的表示能力可以通过异构任务的指导来提高。此外,为了给未标记数据生成伪标签,提出了一种稀疏标签传播机制,利用生成的类原型来度量未标记点的分类置信度。我们的方法进行了评估大规模点云数据集与不同的场景,包括室内和室外。实验结果表明,大的增益对现有的弱监督和可比的结果完全监督的方法\footnote{Code based on mindspore: https://github.com/dmcv-ecnu/MindSpore\_ModelZoo/tree/main/WS3\_MindSpore}。
Omni-Granular Ego-Semantic Propagation for Self-Supervised Graph Representation Learning
Institute of Medical Technology, Health Science Center of Peking University(北京大学医学部医学技术研究院);National Institute of Health Data Science, Peking University(北京大学健康医疗大数据国家研究院)