稳定性算法无法可靠地找到孤立的感知机解
Stable algorithms cannot reliably find isolated perceptron solutions
AI总结:
研究了二元感知机问题,指出在正约束密度下,大多数解强孤立,但稳定性算法无法可靠找到这些解,其成功概率上限为0.84233。
摘要:
我们研究了二元感知机,一个随机约束满足问题,要求找到一个布尔向量,位于独立选择的随机半空间交集中。该模型的一个显著特征是,在每一个正约束密度下,预计有1-o_N(1)的解是强孤立的,即与其他解的汉明距离为Ω(N)。同时,已知高效的算法可以在某些正约束密度下找到解。这引发了一个自然的问题:任何孤立解能否被算法可靠地找到?我们回答这个问题为否定:任何在微小高斯重采样下输出稳定的算法都无法可靠地定位孤立解。我们证明任何稳定算法的成功概率至多为(3√17−9)/4+o_N(1)≤0.84233。此外,任何以1-o_N(1)概率找到解的稳定算法,找到孤立解的概率为o_N(1)。我们考虑的稳定算法类别包括度数为D的多项式,其中D≤o(N/log N);根据低次启发法,这表明定位强孤立解需要指数级时间exp(Θ(N))。我们的证明不使用重叠间隙性质。相反,我们通过Pitt的相关不等式证明,在随机扰动后,靠近现有孤立解的解的数量无法集中在1。
英文摘要:
We study the binary perceptron, a random constraint satisfaction problem that asks to find a Boolean vector in the intersection of independently chosen random halfspaces. A striking feature of this model is that at every positive constraint density, it is expected that a $1-o_N(1)$ fraction of solutions are \emph{strongly isolated}, i.e. separated from all others by Hamming distance $Ω(N)$. At the same time, efficient algorithms are known to find solutions at certain positive constraint densities. This raises a natural question: can any isolated solution be algorithmically visible? We answer this in the negative: no algorithm whose output is stable under a tiny Gaussian resampling of the disorder can \emph{reliably} locate isolated solutions. We show that any stable algorithm has success probability at most $\frac{3\sqrt{17}-9}{4}+o_N(1)\leq 0.84233$. Furthermore, every stable algorithm that finds a solution with probability $1-o_N(1)$ finds an isolated solution with probability $o_N(1)$. The class of stable algorithms we consider includes degree-$D$ polynomials up to $D\leq o(N/\log N)$; under the low-degree heuristic \cite{hopkins2018statistical}, this suggests that locating strongly isolated solutions requires running time $\exp(\widetildeΘ(N))$. Our proof does not use the overlap gap property. Instead, we show via Pitt's correlation inequality that after a random perturbation of the disorder, the number of solutions located close to a pre-existing isolated solution cannot concentrate at $1$.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。