数据草图中的调和分解
Harmonic Decomposition in Data Sketches
AI总结:
本文提出一种基于调和结构而非显式采样的通用草图SymmetricPoissonTower,通过拥抱哈希冲突节省空间,对近周期函数指数级优于采样方法,并猜想其能估计所有可处理函数。
摘要:
在旋转门流式模型中,动态向量 $\mathbf{x}=(\mathbf{x}_1,\ldots,\mathbf{x}_n)\in \mathbb{Z}^n$ 通过一系列逐项增减的流更新。设 $f\colon\mathbb{Z}\to \mathbb{R}_+$ 为满足 $f(0)=0$ 的对称函数。$\mathbf{x}$ 的 $f$-矩定义为 $f(\mathbf{x}) := \sum_{v\in[n]}f(\mathbf{x}_v)$。我们重新审视构建一个能够估计多种不同 $f$-矩的通用草图的问题。先前的通用草图构造依赖于基于 $L_0$-质量(均匀采样)或 $L_2$-质量($L_2$-重击者)的采样技术,其通用性源于能够在样本上评估函数 $f$。在这项工作中,我们采用一种新方法来构建通用草图,该方法不使用任何显式样本,而是依赖于目标函数 $f$ 的调和结构。新草图($\textsf{SymmetricPoissonTower}$)拥抱哈希冲突而非避免它们,这在空间上节省了多个 $\log n$ 因子,例如在估计所有 $L_p$-矩($f(z) = |z|^p,p\in[0,2]$)时。对于许多近周期函数,新草图比基于采样的方法高效指数级。我们猜想 $\textsf{SymmetricPoissonTower}$ 草图是能够估计每个可处理函数 $f$ 的通用草图。
英文摘要:
In the turnstile streaming model, a dynamic vector $\mathbf{x}=(\mathbf{x}_1,\ldots,\mathbf{x}_n)\in \mathbb{Z}^n$ is updated by a stream of entry-wise increments/decrements. Let $f\colon\mathbb{Z}\to \mathbb{R}_+$ be a symmetric function with $f(0)=0$. The \emph{$f$-moment} of $\mathbf{x}$ is defined to be $f(\mathbf{x}) := \sum_{v\in[n]}f(\mathbf{x}_v)$. We revisit the problem of constructing a \emph{universal sketch} that can estimate many different $f$-moments. Previous constructions of universal sketches rely on the technique of sampling with respect to the $L_0$-mass (uniform samples) or $L_2$-mass ($L_2$-heavy-hitters), whose universality comes from being able to evaluate the function $f$ over the samples. In this work we take a new approach to constructing a universal sketch that does not use \emph{any} explicit samples but relies on the \emph{harmonic structure} of the target function $f$. The new sketch ($\textsf{SymmetricPoissonTower}$) \emph{embraces} hash collisions instead of avoiding them, which saves multiple $\log n$ factors in space, e.g., when estimating all $L_p$-moments ($f(z) = |z|^p,p\in[0,2]$). For many nearly periodic functions, the new sketch is \emph{exponentially} more efficient than sampling-based methods. We conjecture that the $\textsf{SymmetricPoissonTower}$ sketch is \emph{the} universal sketch that can estimate every tractable function $f$.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。