Complete convergence of message passing algorithms for some satisfiability problems

Message passing and moment closure for susceptible-infected-recovered epidemics on finite networks

The message passing approach of Karrer and Newman [Phys. Rev. E 82, 016101 (2010)] is an exact and practicable representation of susceptible-infected-recovered dynamics on finite trees. Here we show that, assuming Poisson contact processes, a pair-based moment closure representation [Sharkey, J. Math. Biol. 57, 311 (2008)] can be derived from their equations. We extend the applicability of both representations and discuss their relative merits. On arbitrary time-independent networks, as was shown for the message passing formalism, the pair-based moment closure equations also provide a rigorous…

Message passing for the coloring problem: Gallager meets Alon and Kahale

Message passing algorithms are popular in many combinatorial optimization problems. For example, experimental results show that {\em survey propagation} (a certain message passing algorithm) is effective in finding proper $k$-colorings of random graphs in the near-threshold regime. In 1962 Gallager introduced the concept of Low Density Parity Check (LDPC) codes, and suggested a simple decoding algorithm based on message passing. In 1994 Alon and Kahale exhibited a coloring algorithm and proved its usefulness for finding a $k$-coloring of graphs drawn from a certain planted-solution distributio…

Universality of Approximate Message Passing Algorithms

We consider a broad class of Approximate Message Passing (AMP) algorithms defined as a Lipschitzian functional iteration in terms of an $n\times n$ random symmetric matrix $A$. We establish universality in noise for this AMP in the $n$-limit and validate this behavior in a number of AMPs popularly adapted in compressed sensing, statistical inferences, and optimizations in spin glasses.

State Evolution for General Approximate Message Passing Algorithms, with Applications to Spatial Coupling

We consider a class of approximated message passing (AMP) algorithms and characterize their high-dimensional behavior in terms of a suitable state evolution recursion. Our proof applies to Gaussian matrices with independent but not necessarily identically distributed entries. It covers --in particular-- the analysis of generalized AMP, introduced by Rangan, and of AMP reconstruction in compressed sensing with spatially coupled sensing matrices. The proof technique builds on the one of [BM11], while simplifying and generalizing several steps.

复杂传染的消息传递方法

Message-Passing Methods for Complex Contagions

本文回顾了复杂传染研究中的消息传递方法，推导了配置模型网络下的级联条件解析表达式，将方法推广至有限网络并得到广义级联条件，以Watts阈值模型进行示例说明。

Message Passing and Combinatorial Optimization

Graphical models use the intuitive and well-studied methods of graph theory to implicitly represent dependencies between variables in large systems. They can model the global behaviour of a complex system by specifying only local factors. This thesis studies inference in discrete graphical models from an algebraic perspective and the ways inference can be used to express and approximate NP-hard combinatorial problems. We investigate the complexity and reducibility of various inference problems, in part by organizing them in an inference hierarchy. We then investigate tractable approximations f…