arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2201.10638math.NAcs.DScs.NA
收藏

重新审视近似杠杆分数草图法用于矩阵最小二乘问题

Revisiting Approximate Leverage Score Sketching for Matrix Least Squares

Brett W. Larsen, Tamara G. Kolda

AI总结:

本文重新审视了用于矩阵最小二乘问题的近似杠杆分数草图法,通过理论分析改进了相关常数,并提出了混合确定性和随机采样方案以减少样本需求。

摘要:

本文重新审视了用于矩阵最小二乘问题的近似杠杆分数草图法,通过理论分析改进了相关常数,并提出了混合确定性和随机采样方案以减少样本需求。

英文摘要:

We revisit the problem of sketching using approximate leverage scores for matrix least squares problems of the form $\| AX - B \|_F^2$ where the design matrix $A \in \mathbb{R}^{N \times r}$ is tall and skinny with $N \gg r$. We derive the theoretical results from first principles and clarify the relation to previously stated bounds, improving some constants along the way. One can characterize the utility of a sketching scheme according to the number of samples it needs for an $\varepsilon$-accurate solution with high probability. Assuming $\varepsilon$ is suitably small, we will show that approximate leverage score sampling requires $4r/(βδ\varepsilon)$ samples, where $δ$ is the failure probability and $β\in (0,1]$ is a measure of the quality of the approximate leverage scores such that $β=1$ corresponds to using exact leverage scores. In cases where a few approximate leverage scores are very large (summing to $p_{\rm det}$), we also show that using a hybrid deterministic and random sampling scheme reduces the required number of samples by a factor of $1/(1-p_{\rm det})$.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑