arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2102.11425stat.COstat.ME
收藏

intRinsic:一个基于模型的数据集内在维数估计的R包

intRinsic: an R Package for Model-Based Estimation of the Intrinsic Dimension of a Dataset

Francesco Denti

摘要:

这篇文章介绍了intRinsic,一个R包,它实现了数据集内在维度的最先进的基于可能性的估计,这是大多数降维技术的基本数量。为了使这些新颖的估计器易于访问,该软件包包含少量的高级函数,这些函数依赖于更广泛的高效低级例程。一般来说,intRinsic包含两类模型:同质和异质内在维度估计。第一类包含两个最近邻估计量,这是一种从每个数据点与其前两个最近邻之间的距离之比的分布特性导出的方法。专用于此方法的函数在频率论和贝叶斯框架下进行推理。在第二类中,我们发现了异构本征维算法,这是一种贝叶斯混合模型,并为其实现了高效的吉布斯采样器。在介绍了理论背景之后,我们在模拟数据集上展示了模型的性能。这样,我们可以通过立即评估结果的有效性来促进说明。然后,我们使用该软件包来研究从一个著名的微阵列实验中获得的Alon数据集的内在维数。最后,我们展示了如何估计同质和异质的内在维度,使我们能够获得有价值的见解的数据集的拓扑结构。

英文摘要:

This article illustrates intRinsic, an R package that implements novel state-of-the-art likelihood-based estimators of the intrinsic dimension of a dataset, an essential quantity for most dimensionality reduction techniques. In order to make these novel estimators easily accessible, the package contains a small number of high-level functions that rely on a broader set of efficient, low-level routines. Generally speaking, intRinsic encompasses models that fall into two categories: homogeneous and heterogeneous intrinsic dimension estimators. The first category contains the two nearest neighbors estimator, a method derived from the distributional properties of the ratios of the distances between each data point and its first two closest neighbors. The functions dedicated to this method carry out inference under both the frequentist and Bayesian frameworks. In the second category, we find the heterogeneous intrinsic dimension algorithm, a Bayesian mixture model for which an efficient Gibbs sampler is implemented. After presenting the theoretical background, we demonstrate the performance of the models on simulated datasets. This way, we can facilitate the exposition by immediately assessing the validity of the results. Then, we employ the package to study the intrinsic dimension of the Alon dataset, obtained from a famous microarray experiment. Finally, we show how the estimation of homogeneous and heterogeneous intrinsic dimensions allows us to gain valuable insights into the topological structure of a dataset.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑