arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.10232stat.MLcs.DScs.LGmath.PR
收藏

Johnson-Lindenstrauss的简单统一分析及其应用

Simple, unified analysis of Johnson-Lindenstrauss with applications

The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))

Yingru Li

AI总结:

本文提出Johnson-Lindenstrauss引理的简化统一分析,统一多种构造并首次严格证明球形构造,扩展Hanson-Wright不等式至高维,去除独立性假设,增强理论并拓展实际应用。

摘要:

我们提出了对Johnson-Lindenstrauss(JL)引理的一种简化且统一的分析,该引理是用于管理高维数据的降维技术的基石。我们的方法简化了理解,并统一了JL框架下的各种构造,包括球形、二元硬币、稀疏JL、高斯和次高斯模型。这种统一保留了数据的固有几何结构,这对于从流算法到强化学习的应用至关重要。我们提供了球形构造有效性的首个严格证明,并在这一简化框架内引入了一类通用的次高斯构造。我们贡献的核心是对Hanson-Wright不等式在高维情形下的创新性扩展,并给出了显式常数。通过使用简单而强大的概率工具和分析技术,如增强的对角化过程,我们的分析通过去除一个独立性假设巩固了JL引理的理论基础,并将其实际适用性扩展到当代算法。

英文摘要:

We present a simplified and unified analysis of the Johnson-Lindenstrauss (JL) lemma, a cornerstone of dimensionality reduction for managing high-dimensional data. Our approach simplifies understanding and unifies various constructions under the JL framework, including spherical, binary-coin, sparse JL, Gaussian, and sub-Gaussian models. This unification preserves the intrinsic geometry of data, essential for applications from streaming algorithms to reinforcement learning. We provide the first rigorous proof of the spherical construction's effectiveness and introduce a general class of sub-Gaussian constructions within this simplified framework. Central to our contribution is an innovative extension of the Hanson-Wright inequality to high dimensions, complete with explicit constants. By using simple yet powerful probabilistic tools and analytical techniques, such as an enhanced diagonalization process, our analysis solidifies the theoretical foundation of the JL lemma by removing an independence assumption and extends its practical applicability to contemporary algorithms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑