arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2204.07922cs.DBcs.IR
收藏

基于神经网络嵌入的相似性映射高效处理研究综述

A Survey on Efficient Processing of Similarity Queries over Neural Embeddings

Yifan Wang

摘要:

相似性查询是基于某种相似性度量的一类查询。与大多基于值相等的传统数据库查询不同,相似性查询旨在根据一些相似性度量来找到与给定数据对象“足够相似”的目标,例如,为了度量数据对象之间的相似性,传统的方法通常工作在低级别或语法特征上(例如,图像的基本视觉特征或文本的词袋特征),这使得它们难以计算对象之间的语义相似性。因此,为了从语义上测量数据相似性,应用了神经嵌入。嵌入技术通过将原始数据对象表示为向量(所谓的“嵌入”或“神经嵌入”,因为它们主要由神经网络模型生成)来工作,该向量暴露原始数据的隐藏语义,基于该语义,嵌入确实在捕获数据相似性方面表现出突出的有效性,使其成为最先进的相似性查询处理研究中最广泛使用和研究的技术之一。但是基于嵌入的相似性查询处理的效率仍然存在许多挑战,这些挑战没有像有效性那样得到充分的研究。在这个调查中,我们首先提供了一个概述的“相似性查询”和“相似性查询处理”的问题。然后,我们讨论了最近在嵌入(或更一般地说,高维数据)之上设计索引和操作符以进行高效相似性查询处理的方法。最后,我们研究了在选定的应用领域的相似性查询,包括实体解析和信息检索的具体解决方案,使用和不使用嵌入。通过比较这些解决方案,我们展示了神经嵌入如何使这些应用受益。

英文摘要:

Similarity query is the family of queries based on some similarity metrics. Unlike the traditional database queries which are mostly based on value equality, similarity queries aim to find targets "similar enough to" the given data objects, depending on some similarity metric, e.g., Euclidean distance, cosine similarity and so on. To measure the similarity between data objects, traditional methods normally work on low level or syntax features(e.g., basic visual features on images or bag-of-word features of text), which makes them weak to compute the semantic similarities between objects. So for measuring data similarities semantically, neural embedding is applied. Embedding techniques work by representing the raw data objects as vectors (so called "embeddings" or "neural embeddings" since they are mostly generated by neural network models) that expose the hidden semantics of the raw data, based on which embeddings do show outstanding effectiveness on capturing data similarities, making it one of the most widely used and studied techniques in the state-of-the-art similarity query processing research. But there are still many open challenges on the efficiency of embedding based similarity query processing, which are not so well-studied as the effectiveness. In this survey, we first provide an overview of the "similarity query" and "similarity query processing" problems. Then we talk about recent approaches on designing the indexes and operators for highly efficient similarity query processing on top of embeddings (or more generally, high dimensional data). Finally, we investigate the specific solutions with and without using embeddings in selected application domains of similarity queries, including entity resolution and information retrieval. By comparing the solutions, we show how neural embeddings benefit those applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑