arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.02559cs.LGmath.OCstat.ML
收藏

最小失真嵌入

Minimum-Distortion Embedding

Akshay Agrawal, Alnur Ali, Stephen Boyd

摘要:

我们考虑向量嵌入问题。我们给出了一组有限的项目,目标是为每个项目分配一个代表性向量,可能在一些约束条件下(例如向量的集合被标准化,即,具有零均值和单位协方差)。我们得到的数据表明,一些对项目是相似的,并可选地,其他一些对是不相似的。对于相似项对,我们希望对应的向量彼此靠近,对于不相似项对,我们希望对应的向量彼此不靠近,以欧几里得距离测量。我们正式通过引入失真函数,定义为一些对的项目。我们的目标是选择一个嵌入,最大限度地减少总失真,受约束。我们称之为最小失真嵌入(MDE)问题。MDE框架简单但通用。它包括各种各样的嵌入方法,如光谱嵌入,主成分分析,多维缩放,降维方法(如Isomap和UMAP),力导向布局等。它还包括新的嵌入,并提供了验证历史和新嵌入的原则性方法。我们开发了一个投影拟牛顿方法,近似解决MDE问题和规模大的数据集。我们在PyMDE中实现了这个方法,PyMDE是一个开源的Python包。在PyMDE中,用户可以从失真函数和约束库中进行选择,或者指定自定义函数和约束,从而可以轻松地快速试验不同的嵌入。我们的软件可扩展到包含数百万项和数千万失真函数的数据集。为了证明我们的方法,我们计算了几个真实世界数据集的嵌入,包括图像,学术合著者网络,美国县人口统计数据和单细胞mRNA转录组。

英文摘要:

We consider the vector embedding problem. We are given a finite set of items, with the goal of assigning a representative vector to each one, possibly under some constraints (such as the collection of vectors being standardized, i.e., having zero mean and unit covariance). We are given data indicating that some pairs of items are similar, and optionally, some other pairs are dissimilar. For pairs of similar items, we want the corresponding vectors to be near each other, and for dissimilar pairs, we want the corresponding vectors to not be near each other, measured in Euclidean distance. We formalize this by introducing distortion functions, defined for some pairs of the items. Our goal is to choose an embedding that minimizes the total distortion, subject to the constraints. We call this the minimum-distortion embedding (MDE) problem. The MDE framework is simple but general. It includes a wide variety of embedding methods, such as spectral embedding, principal component analysis, multidimensional scaling, dimensionality reduction methods (like Isomap and UMAP), force-directed layout, and others. It also includes new embeddings, and provides principled ways of validating historical and new embeddings alike. We develop a projected quasi-Newton method that approximately solves MDE problems and scales to large data sets. We implement this method in PyMDE, an open-source Python package. In PyMDE, users can select from a library of distortion functions and constraints or specify custom ones, making it easy to rapidly experiment with different embeddings. Our software scales to data sets with millions of items and tens of millions of distortion functions. To demonstrate our method, we compute embeddings for several real-world data sets, including images, an academic co-author network, US county demographic data, and single-cell mRNA transcriptomes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑