arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1502.05680stat.MLcond-mat.stat-mechcs.SI
收藏

在稀疏图中寻找一个社区

Finding One Community in a Sparse Graph

Andrea Montanari

摘要:

考虑一个平均度有界的随机稀疏图,其中一个顶点子集具有比背景更高的连通度。特别是,这个顶点子集内部的平均度大于外部(但仍然有界)。给出了这种图的一个实现,我们的目标是确定隐藏的顶点子集。这可以被视为在社交网络中找到紧密联系的社区或在关系数据集中找到集群的问题的模型。在本文中,我们提出了两套的贡献:$(i)$我们使用腔方法从自旋玻璃理论推导出一个精确的相图重建问题。特别是,随着边缘概率的差异增加,问题经历了两个相变,静态相变和动态相变。$(ii)$我们建立严格的动态相变的界限,并证明,在一定的阈值以上,一个本地算法(信念传播)正确地识别大部分的隐藏集。低于相同的阈值\emph{no local algorithm}可以实现该目标。然而,在这种情况下,可以通过穷举搜索来识别子集。对于小的隐藏集和大的平均度,局部算法的相变采取了一种有趣的简单形式。局部算法对于${\rm deg}_{\rm in} - {\rm deg}_{\rm out} > \sqrt{{\rm deg}_{\rm out}/e}$成功的概率很高,对于${\rm deg}_{\rm in} - {\rm deg}_{\rm out} < \sqrt{{\rm deg}_{\rm out}/e}$失败的概率很高(对于${\rm deg}_{\rm in}$,${\rm deg}_{\rm out}$是社区内外的平均度)。我们认为,光谱算法也是无效的,在后者政权。对于${\rm deg}_{\rm in} - {\rm deg}_{\rm out} < \sqrt{{\rm deg}_{\rm out}/e}$,任何多项式时间算法是否可能成功是一个开放的问题。

英文摘要:

We consider a random sparse graph with bounded average degree, in which a subset of vertices has higher connectivity than the background. In particular, the average degree inside this subset of vertices is larger than outside (but still bounded). Given a realization of such graph, we aim at identifying the hidden subset of vertices. This can be regarded as a model for the problem of finding a tightly knitted community in a social network, or a cluster in a relational dataset. In this paper we present two sets of contributions: $(i)$ We use the cavity method from spin glass theory to derive an exact phase diagram for the reconstruction problem. In particular, as the difference in edge probability increases, the problem undergoes two phase transitions, a static phase transition and a dynamic one. $(ii)$ We establish rigorous bounds on the dynamic phase transition and prove that, above a certain threshold, a local algorithm (belief propagation) correctly identify most of the hidden set. Below the same threshold \emph{no local algorithm} can achieve this goal. However, in this regime the subset can be identified by exhaustive search. For small hidden sets and large average degree, the phase transition for local algorithms takes an intriguingly simple form. Local algorithms succeed with high probability for ${\rm deg}_{\rm in} - {\rm deg}_{\rm out} > \sqrt{{\rm deg}_{\rm out}/e}$ and fail for ${\rm deg}_{\rm in} - {\rm deg}_{\rm out} < \sqrt{{\rm deg}_{\rm out}/e}$ (with ${\rm deg}_{\rm in}$, ${\rm deg}_{\rm out}$ the average degrees inside and outside the community). We argue that spectral algorithms are also ineffective in the latter regime. It is an open problem whether any polynomial time algorithms might succeed for ${\rm deg}_{\rm in} - {\rm deg}_{\rm out} < \sqrt{{\rm deg}_{\rm out}/e}$.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑