Universality of Approximate Message Passing Algorithms

State Evolution for General Approximate Message Passing Algorithms, with Applications to Spatial Coupling

We consider a class of approximated message passing (AMP) algorithms and characterize their high-dimensional behavior in terms of a suitable state evolution recursion. Our proof applies to Gaussian matrices with independent but not necessarily identically distributed entries. It covers --in particular-- the analysis of generalized AMP, introduced by Rangan, and of AMP reconstruction in compressed sensing with spatially coupled sensing matrices. The proof technique builds on the one of [BM11], while simplifying and generalizing several steps.

Robust Group Synchronization via Cycle-Edge Message Passing

We propose a general framework for solving the group synchronization problem, where we focus on the setting of adversarial or uniform corruption and sufficiently small noise. Specifically, we apply a novel message passing procedure that uses cycle consistency information in order to estimate the corruption levels of group ratios and consequently solve the synchronization problem in our setting. We first explain why the group cycle consistency information is essential for effectively solving group synchronization problems. We then establish exact recovery and linear convergence guarantees for t…

Complete convergence of message passing algorithms for some satisfiability problems

In this paper we analyze the performance of Warning Propagation, a popular message passing algorithm. We show that for 3CNF formulas drawn from a certain distribution over random satisfiable 3CNF formulas, commonly referred to as the planted-assignment distribution, running Warning Propagation in the standard way (run message passing until convergence, simplify the formula according to the resulting assignment, and satisfy the remaining subformula, if necessary, using a simple "off the shelf" heuristic) results in a satisfying assignment when the clause-variable ratio is a sufficiently large c…

Message passing and moment closure for susceptible-infected-recovered epidemics on finite networks

The message passing approach of Karrer and Newman [Phys. Rev. E 82, 016101 (2010)] is an exact and practicable representation of susceptible-infected-recovered dynamics on finite trees. Here we show that, assuming Poisson contact processes, a pair-based moment closure representation [Sharkey, J. Math. Biol. 57, 311 (2008)] can be derived from their equations. We extend the applicability of both representations and discuss their relative merits. On arbitrary time-independent networks, as was shown for the message passing formalism, the pair-based moment closure equations also provide a rigorous…

Message passing for the coloring problem: Gallager meets Alon and Kahale

Message passing algorithms are popular in many combinatorial optimization problems. For example, experimental results show that {\em survey propagation} (a certain message passing algorithm) is effective in finding proper $k$-colorings of random graphs in the near-threshold regime. In 1962 Gallager introduced the concept of Low Density Parity Check (LDPC) codes, and suggested a simple decoding algorithm based on message passing. In 1994 Alon and Kahale exhibited a coloring algorithm and proved its usefulness for finding a $k$-coloring of graphs drawn from a certain planted-solution distributio…

复杂传染的消息传递方法

Message-Passing Methods for Complex Contagions

本文回顾了复杂传染研究中的消息传递方法，推导了配置模型网络下的级联条件解析表达式，将方法推广至有限网络并得到广义级联条件，以Watts阈值模型进行示例说明。