arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2109.02596cs.LGstat.ML
收藏

Scikit-dimension:一个用于本征维数估计的 Python 软件包

Scikit-dimension: a Python package for intrinsic dimension estimation

Institut Curie, PSL Research University(居里研究所,PSL研究大学);INSERM(法国国家健康与医学研究院);CBIO-Centre for Computational Biology, Mines ParisTech, PSL Research University(计算生物学中心,巴黎高科矿业学院,PSL研究大学);University of Leicester(莱斯特大学);Lobachevsky University(罗巴切夫斯基大学)

Jonathan Bac, Evgeny M. Mirkes, Alexander N. Gorban, Ivan Tyukin, Andrei Zinovyev

AI总结:

本文介绍开源 Python 包 scikit-dimension,它基于 scikit-learn API 统一实现多种全局与局部本征维数估计器及数据集生成器,并通过 500 多个数据集的大规模基准测试验证其应用。

摘要:

在将机器学习应用于真实数据时,处理不确定性在很大程度上取决于对本征维数(ID)的了解。已有若干方法被提出用于估计 ID,但 Python 中尚未实现一个标准软件包,以便方便地逐个或同时应用这些方法。本技术说明介绍了 scikit-dimension,这是一个用于本征维数估计的开源 Python 软件包。scikit-dimension 软件包基于 scikit-learn 应用程序编程接口,统一实现了大多数已知的 ID 估计器,以评估全局和局部本征维数,同时还提供文献中广泛使用的合成玩具数据集与基准数据集生成器。该软件包在开发中使用了评估代码质量、覆盖率、单元测试和持续集成的工具。我们简要描述了该软件包,并在针对真实数据和合成数据的 ID 估计方法的大规模(超过 500 个数据集)基准测试中演示了其用法。源代码可从 https://github.com/j-bac/scikit-dimension 获取,文档可从 https://scikit-dimension.readthedocs.io 获取。

英文摘要:

Dealing with uncertainty in applications of machine learning to real-life data critically depends on the knowledge of intrinsic dimensionality (ID). A number of methods have been suggested for the purpose of estimating ID, but no standard package to easily apply them one by one or all at once has been implemented in Python. This technical note introduces \texttt{scikit-dimension}, an open-source Python package for intrinsic dimension estimation. \texttt{scikit-dimension} package provides a uniform implementation of most of the known ID estimators based on scikit-learn application programming interface to evaluate global and local intrinsic dimension, as well as generators of synthetic toy and benchmark datasets widespread in the literature. The package is developed with tools assessing the code quality, coverage, unit testing and continuous integration. We briefly describe the package and demonstrate its use in a large-scale (more than 500 datasets) benchmarking of methods for ID estimation in real-life and synthetic data. The source code is available from https://github.com/j-bac/scikit-dimension , the documentation is available from https://scikit-dimension.readthedocs.io .

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑