arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.13622cs.LG
收藏

具有优化潜在位置的自组织映射

Self-Organizing Maps with Optimized Latent Positions

Graduate School of Informatics(信息科学研究生院);Osaka Metropolitan University(大阪 metropolitan 大学)

Seiki Ubukata, Akira Notsu, Katsuhiro Honda

AI总结:

本文提出SOM-OLP方法,通过引入连续潜在位置改进自组织映射,实现高效拓扑映射与量化,实验显示其在大规模数据和潜在节点下具有良好的可扩展性和性能。

摘要:

自组织映射(SOM)是一种经典的无监督学习方法,用于高维数据的向量量化和拓扑映射。然而,现有SOM公式往往在计算效率和明确的优化目标之间存在权衡。基于目标的变体如软拓扑向量量化(STVQ)提供了系统化的公式,但其邻域耦合计算随着潜在节点数量的增加而变得昂贵。在本文中,我们提出了具有优化潜在位置的自组织映射(SOM-OLP),一种基于目标的拓扑映射方法,为每个数据点引入连续的潜在位置。从STVQ的邻域畸变出发,我们基于其局部二次结构构建了可分离的替代局部成本,并基于此公式制定了基于熵正则化的目标。这导致了一个简单的块坐标下降方案,具有闭合形式的更新用于分配概率、潜在位置和参考向量,同时保证了目标的单调非递增,并保持了数据点和潜在节点数量的线性迭代复杂度。在合成鞍形流形、Digits和MNIST数据集的可扩展性研究以及16个基准数据集上的实验表明,SOM-OLP在竞争的邻域保持和量化性能、大规模潜在节点和大数据集的可扩展性方面表现良好,并在基准数据集上取得了最佳的平均排名。

英文摘要:

Self-Organizing Maps (SOM) are a classical method for unsupervised learning, vector quantization, and topographic mapping of high-dimensional data. However, existing SOM formulations often involve a trade-off between computational efficiency and a clearly defined optimization objective. Objective-based variants such as Soft Topographic Vector Quantization (STVQ) provide a principled formulation, but their neighborhood-coupled computations become expensive as the number of latent nodes increases. In this paper, we propose Self-Organizing Maps with Optimized Latent Positions (SOM-OLP), an objective-based topographic mapping method that introduces a continuous latent position for each data point. Starting from the neighborhood distortion of STVQ, we construct a separable surrogate local cost based on its local quadratic structure and formulate an entropy-regularized objective based on it. This yields a simple block coordinate descent scheme with closed-form updates for assignment probabilities, latent positions, and reference vectors, while guaranteeing monotonic non-increase of the objective and retaining linear per-iteration complexity in the numbers of data points and latent nodes. Experiments on a synthetic saddle manifold, scalability studies on the Digits and MNIST datasets, and 16 benchmark datasets show that SOM-OLP achieves competitive neighborhood preservation and quantization performance, favorable scalability for large numbers of latent nodes and large datasets, and the best average rank among the compared methods on the benchmark datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑