Cutoff for Almost All Random Walks on Abelian Groups
Jonathan Hermon, Sam Olesker-Taylor
备注:
Accepted at Journal of European Mathematical Society (JEMS), Sept '25. This is part of a multi-paper project investigating properties of Cayley graphs with divergently many generators chosen uniformly at random. There is some textual overlap between the introductions of the different papers
Consider the random Cayley graph of a finite group $G$ with respect to $k$ generators chosen uniformly at random, with $1 \ll \log k \ll \log |G|$; denote it $G_k$. A conjecture of Aldous and Diaconis (1985) asserts, for $k \gg \log |G|$, that the random walk on this graph exhibits cutoff. Further, the cutoff time should be a function only of $k$ and $|G|$, to sub-leading order. This was verified for all Abelian groups in the '90s. We extend the conjecture to $1 \ll k \lesssim \log |G|$. We establish cutoff for all Abelian groups under the condition $k - d(G) \gg 1$, where $d(G)$ is the minimal size of a generating subset of $G$, which is almost optimal. The cutoff time is described (abstractly) in terms of the entropy of random walk on $\mathbb Z^k$. This abstract definition allows us to deduce that the cutoff time can be written as a function only of $k$ and $|G|$ when $d(G) \ll \log |G|$ and $k - d(G) \asymp k \gg 1$; this is not the case when $d(G) \asymp \log |G| \asymp k$. For certain regimes of $k$, we find the limit profile of the convergence to equilibrium. Wilson (1997) conjectured that $\mathbb Z_2^d$ gives rise to the slowest mixing time for $G_k$ amongst all groups of size at most $2^d$. We give a partial answer, verifying the conjecture for nilpotent groups. This is obtained via a comparison result of independent interest between the mixing times of nilpotent $G$ and a corresponding Abelian group $\overline G$, namely the direct sum of the Abelian quotients in the lower central series of $G$. We use this to refine a celebrated result of Alon and Roichman (1994): we show for nilpotent $G$ that $G_k$ is an expander provided $k - d(\overline G) \gtrsim \log |G|$. As another consequence, we establish cutoff for nilpotent groups with relatively small commutators, including high-dimensional special groups, such as Heisenberg groups.
We examine the mixing time for random walks on graphs. In particular we are interested on investigating graphs with bottlenecks. Furthermore, the cutoff phenomenon is examined.
The sequence of the simple random walks on Hamming schemes $\{H(n, q)\}_{n=1}^{\infty}$ has a cutoff phenomenon for each integer $q$ greater than or equal to $3$. In this paper, for the sequence of simple random walks on Hamming schemes $\{H(n, q)\}_{n=1}^{\infty}$ with $q\geq 3$, we give a simple majorant and a sharp minorant function for total variance distances between transition distributions and stationary distributions.
We make a connection between the continuous time and lazy discrete time Markov chains through the comparison of cutoffs and mixing time in total variation distance. For illustration, we consider finite birth and death chains and provide a criterion on cutoffs using eigenvalues of the transition matrix.
We analyse a random walk on the ring of integers mod $n$, which at each time point can make an additive `step' or a multiplicative `jump'. When the probability of making a jump tends to zero as an appropriate power of $n$ we prove the existence of a total variation pre-cutoff for this walk. In addition, we show that the process obtained by subsampling our walk at jump times exhibits a true cutoff, with mixing time dependent on whether the step distribution has zero mean.
In this article, we consider products of random walks on finite groups with moderate growth and discuss their cutoffs in the total variation. Based on several comparison techniques, we are able to identify the total variation cutoff of discrete time lazy random walks with the Hellinger distance cutoff of continuous time random walks. Along with the cutoff criterion for Laplace transforms, we derive a series of equivalent conditions on the existence of cutoffs, including the existence of pre-cutoffs, Peres' product condition and a formula generated by the graph diameters. For illustration, we c…
This paper explores the mixing time of the random transposition walk on permutations with one-sided interval restrictions. In particular, we're interested in the notion of cutoff, a phenomenon which occurs when mixing occurs in a window of order smaller than the mixing time. One of the main tools of the paper is the diagonalization obtained by Hanlon; the use of the spectral information is inspired by the famous paper of Diaconis and Shahshahani on the mixing time of the random transposition walk on the entire symmetric group. The diagonalization allows us to prove chi-squared cutoff for a bro…
Let ζbe the intersection exponent of random walks in Z^3 and αbe a positive real number. We construct a stochastic process from a simple random walk by erasing loops of length at most N^α. We will prove that for α< \frac{1}{1+2ζ}, the limiting distribution is Gaussian. For α> 2 the limiting distribution will be shown to be equal to the limiting distribution of the loop erased walk.
We show that a sequence of birth-and-death chains, given by lazy random walks in a (transient) environment (RWRE) on [0; n], exhibits a cutoff in the ballistic regime but does not exhibit a cutoff in the (interior of) the subballistic regime. We investigate the growth of the mixing times for this model. As an important step in the proof, we derive bounds for the quenched expectation and the quenched variance of the hitting times of the RWRE, which are of independent interest.
We consider the random walk on the hypercube which moves by picking an ordered pair $(i,j)$ of distinct coordinates uniformly at random and adding the bit at location $i$ to the bit at location $j$, modulo $2$. We show that this Markov chain has cutoff at time $\frac{3}{2}n\log n$ with window of size $n$, solving a question posed by Chung and Graham (1997).
We present an overview of the representation theoretic techniques used to study the mixing times of random walks on finite groups. We focus on the card shuffle studied by Diaconis and Shahshahani in the 1980s and a recent improvement on their result by Teyssier
Random walk on the irreducible representations of the symmetric and general linear groups is studied. A separation distance cutoff is proved and the exact separation distance asymptotics are determined. A key tool is a method for writing the multiplicities in the Kronecker tensor powers of a fixed representation as a sum of non-negative terms. Connections are made with the Lagrange-Sylvester interpolation approach to Markov chains.
We consider dynamical percolation on the complete graph $K_n$, where each edge refreshes its state at rate $μ\ll 1/n$, and is then declared open with probability $p = λ/n$ where $λ> 1$. We study a random walk on this dynamical environment which jumps at rate $1/n$ along every open edge. We show that the mixing time of the full system exhibits cutoff at $\log n/μ$. We do this by showing that the random walk component mixes faster than the environment process; along the way, we control the time it takes for the walk to become isolated.
We consider Activated Random Walks on arbitrary finite networks, with particles being inserted at random and absorbed at the boundary. Despite the non-reversibility of the dynamics and the lack of knowledge on the stationary distribution, we explicitly determine the relaxation time of the process, and prove that separation cutoff is equivalent to the product condition. We also provide sharp estimates on the center and width of the cutoff window. Finally, we illustrate those results by establishing explicit separation cutoffs on various networks, including: (i) large finite subgraphs of any fix…
It is a fact simple to establish that the mixing time of the simple random walk on a d-regular graph $G_n$ with n vertices is asymptotically bounded from below by $d/ ((d-2)\log (d-1))\log n$. Such a bound is obtained by comparing the walk on $G_n$ to the walk on the infinite $d$-regular tree. If one can map another infinite transitive graph onto $G_n$, then we can improve the strategy by using a comparison with the random walk on this transitive graph (instead of that of the regular tree), and we obtain a lower bound of the form $1/h \log n$, where $h$ is the entropy rate associated with the …
The total-variation cutoff phenomenon has been conjectured to hold for simple random walk on all transitive expanders. However, very little is actually known regarding this conjecture, and cutoff on sparse graphs in general. In this paper we establish total-variation cutoff for simple random walk on Ramanujan complexes of type $\widetilde{A}_{d}$ $(d\geq1)$. As a result, we obtain explicit generators for the finite classical groups $\mathrm{PGL}_{n}(\mathbb{F}_{q})$ for which the associated Cayley graphs exhibit total-variation cutoff.
A finite ergodic Markov chain is said to exhibit cutoff if its distance to stationarity remains close to 1 over a certain number of iterations and then abruptly drops to near 0 on a much shorter time scale. Discovered in the context of card shuffling (Aldous-Diaconis, 1986), this phenomenon is now believed to be rather typical among fast mixing Markov chains. Yet, establishing it rigorously often requires a challengingly detailed understanding of the underlying chain. Here we consider non-backtracking random walks on random graphs with a given degree sequence. Under a general sparsity conditio…
We show that for lazy simple random walks on finite spherically symmetric trees, the ratio of the mixing time and the relaxation time is bounded by a universal constant. Consequently, lazy simple random walks on any sequence of finite spherically symmetric trees do not exhibit pre-cutoff; this conclusion also holds for continuous-time simple random walks. This answers a question recently proposed by Gantert, Nestoridi, and Schmid. We also show that for lazy simple random walks on finite spherically symmetric trees, hitting times of vertices are (uniformly) non concentrated. Finally, we study t…
The cutoff phenomenon for an ergodic Markov chain describes a sharp transition in the convergence to its stationary distribution, over a negligible period of time, known as cutoff window. We study the cutoff phenomenon for simple random walks on Kneser graphs, which is a family of ergodic Markov chains. Given two integers $n$ and $k$, the Kneser graph $K(2n+k,n)$ is defined as the graph with vertex set being all subsets of $\{1,\ldots,2n+k\}$ of size $n$ and two vertices $A$ and $B$ being connected by an edge if $A\cap B =\emptyset$. We show that for any $k=O(n)$, the random walk on $K(2n+k,n)…
We investigate the asymptotic in $N$ of the mixing times of a Markov dynamics on $N-1$ ordered particles in an interval. This dynamics consists in resampling at independent Poisson times each particle according to a probability measure on the segment formed by its nearest neighbours. In the setting where the resampling probability measures are symmetric, the asymptotic of the mixing times were obtained and a cutoff phenomenon holds. In the present work, we focus on an asymmetric version of the model and we establish a cutoff phenomenon. An important part of our analysis consists in the derivat…
Consider the random Cayley graph of a finite group $G$ with respect to $k$ generators chosen uniformly at random, with $1 \ll \log k \ll \log |G|$ (ie $1 \ll k = |G|^{o(1)}$). A conjecture of Aldous and Diaconis (1985) asserts, for $k\gg\log|G|$, that the random walk on this graph exhibits cutoff. When $\log k \lesssim \log\log|G|$ (ie $k = (\log |G|)^{\mathcal O(1)}$), the only example of a non-Abelian group for which cutoff has been established is the dihedral group. We establish cutoff (as $p\to infty$) for the group of $d \times d$ unit upper triangular matrices with integer entries modulo…
We consider random walk on the group of uni-upper triangular matrices with entries in $\mathbb{F}_2$ which forms an important example of a nilpotent group. Peres and Sly (2013) proved tight bounds on the mixing time of this walk up to constants. It is well known that the single column projection of this chain is the one dimensional East process. In this article, we complement the Peres-Sly result by proving a cutoff result for the mixing of finitely many columns in the upper triangular matrix walk at the same location as the East process of the same dimension. Moreover, we also show that the s…
The cutoff phenomenon describes a sharp transition in the convergence of a family of ergodic finite Markov chains to equilibrium. Many natural families of chains are believed to exhibit cutoff, and yet establishing this fact is often extremely challenging. An important such family of chains is the random walk on $\G(n,d)$, a random $d$-regular graph on $n$ vertices. It is well known that almost every such graph for $d\geq 3$ is an expander, and even essentially Ramanujan, implying a mixing-time of $O(\log n)$. According to a conjecture of Peres, the simple random walk on $\G(n,d)$ for such $d$…
The cutoff phenomenon describes a sharp transition in the convergence of an ergodic finite Markov chain to equilibrium. Of particular interest is understanding this convergence for the simple random walk on a bounded-degree expander graph. The first example of a family of bounded-degree graphs where the random walk exhibits cutoff in total-variation was provided only very recently, when the authors showed this for a typical random regular graph. However, no example was known for an explicit (deterministic) family of expanders with this phenomenon. Here we construct a family of cubic expanders …
In this thesis we introduce a new type of card shuffle called the one-sided transposition shuffle. At each step a card is chosen uniformly from the pack and then transposed with another card chosen uniformly from below it. This defines a random walk on the symmetric group generated by a distribution which is non-constant on the conjugacy class of transpositions. Nevertheless, we provide an explicit formula for all eigenvalues of the shuffle by demonstrating a useful correspondence between eigenvalues and standard Young tableaux. This allows us to prove the existence of a total-variation cutoff…
We prove a conjecture raised by the work of Diaconis and Shahshahani (1981) about the mixing time of random walks on the permutation group induced by a given conjugacy class. To do this we exploit a connection with coalescence and fragmentation processes and control the Kantorovitch distance by using a variant of a coupling due to Oded Schramm. Recasting our proof in the language of Ricci curvature, our proof establishes the occurrence of a phase transition, which takes the following form in the case of random transpositions: at time $cn/2$, the curvature is asymptotically zero for $c\le 1$ an…
We show that the measure on markings of $\mathbf {Z}_n^d$, $d\geq3$, with elements of ${0,1}$ given by i.i.d. fair coin flips on the range $\mathcal {R}$ of a random walk $X$ run until time $T$ and 0 otherwise becomes indistinguishable from the uniform measure on such markings at the threshold $T=1/2T_{\mathrm {cov}}(\mathbf {Z}_n^d)$. As a consequence of our methods, we show that the total variation mixing time of the random walk on the lamplighter graph $\mathbf {Z}_2\wr \mathbf {Z}_n^d$, $d\geq3$, has a cutoff with threshold $1/2T_{\mathrm {cov}}(\mathbf {Z}_n^d)$. We give a general criteri…
It is recently proved by Lubetzky and Peres that the simple random walk on a Ramanujan graph exhibits a cutoff phenomenon, that is to say, the total variation distance of the random walk distribution from the uniform distribution drops abruptly from near $1$ to near $0$. There are already a few alternative proofs of this fact. In this note, we give yet another proof based on functional analysis and entropic consideration.
We establish universality of cutoff for simple random walk on a class of random graphs defined as follows. Given a finite graph $G=(V,E)$ with $|V|$ even we define a random graph $ G^*=(V,E \cup E')$ obtained by picking $E'$ to be the (unordered) pairs of a random perfect matching of $V$. We show that for a sequence of such graphs $G_n$ of diverging sizes and of uniformly bounded degree, if the minimal size of a connected component of $G_n$ is at least 3 for all $n$, then the random walk on $G_n^*$ exhibits cutoff w.h.p. This provides a simple generic operation of adding some randomness to a g…
In the present paper we find necessary and sufficient conditions for recurrence of random walks on arbitrary subgroups of the group of rational numbers $\mathbb{Q}$.
We construct a family of trees on which a lazy simple random walk exhibits total variation cutoff. The main idea behind the construction is that hitting times of large sets should be concentrated around their means. For this sequence of trees we compute the mixing time, the relaxation time and the cutoff window.
In this short note we give various near optimal characterizations of random walks over finite Abelian groups with large maximum discrepancy from the uniform measure. We also provide several interesting connections to existing results in the literature.
In this paper, we are interested in the impact of communities on the mixing behavior of the non-backtracking random walk. We consider sequences of sparse random graphs of size $N$ generated according to a variant of the classical configuration model which incorporates a two-community structure. The strength of the bottleneck is measured by a parameter $α$ which roughly corresponds to the fraction of edges that go from one community to the other. We show that if $α\gg \frac{1}{\log N}$, then the non-backtracking random walk exhibits cutoff at the same time as in the one-community case, but with…
A finite ergodic Markov chain exhibits cutoff if its distance to equilibrium remains close to its initial value over a certain number of iterations and then abruptly drops to near 0 on a much shorter time scale. Originally discovered in the context of card shuffling (Aldous-Diaconis, 1986), this remarkable phenomenon is now rigorously established for many reversible chains. Here we consider the non-reversible case of random walks on sparse directed graphs, for which even the equilibrium measure is far from being understood. We work under the configuration model, allowing both the in-degrees an…
We prove a cutoff for the random walk on random $n$-lifts of finite weighted graphs, even when the random walk on the base graph $\mathcal{G}$ of the lift is not reversible. The mixing time is w.h.p. $t_{mix}=h^{-1}\log n$, where $h$ is a constant associated to $\mathcal{G}$, namely the entropy of its universal cover. Moreover, this mixing time is the smallest possible among all $n$-lifts of $\mathcal{G}$. In the particular case where the base graph is a vertex with $d/2$ loops, $d$ even, we obtain a cutoff for a $d$-regular random graph (as did Lubetzky and Sly in \cite{cutoffregular} with a …
This paper studies Markov chains on the chambers of real hyperplane arrangements, a model that generalizes famous examples, such as the Tsetlin library and riffle shuffles. We discuss cutoff for the Tsetlin library for general weights, and we give an exact formula for the separation distance for the hyperplane arrangement walk. We introduce lower bounds, which allow for the first time to study cutoff for hyperplane arrangement walks under certain conditions. Using similar techniques, we also prove a uniform lower bound for the mixing time of Glauber dynamics on a monotone system.
Discovered in the context of card shuffling by Aldous, Diaconis and Shahshahani, the cutoff phenomenon has since then been established in a variety of Markov chains. However, proving cutoff remains a delicate affair, which requires a detailed knowledge of the chain. Identifying the general mechanisms underlying this phase transition -- without having to pinpoint its precise location -- remains one of the most fundamental open problems in the area of mixing times. In the present paper, we make a step in this direction by establishing cutoff for Markov chains with non-negative curvature, under a…
A scenery $f$ on a finite group $G$ is a function from $G$ to $\{0,1\}$. A random walk $v(t)$ on $G$ is said to be reconstructive if the distributions of 2 sceneries evaluated on the random walk with uniform initial distribution are identical only if one scenery is a shift of the other scenery. Previous results gave a sufficient condition for reconstructivity on finite abelian groups. This paper gives a ready generalization of this sufficient condition to one for reconstructivity on finite non-abelian groups but shows that no random walks on finite non-abelian groups satisfy this sufficient co…
We show that on every Ramanujan graph $G$, the simple random walk exhibits cutoff: when $G$ has $n$ vertices and degree $d$, the total-variation distance of the walk from the uniform distribution at time $t=\frac{d}{d-2}\log_{d-1} n + s\sqrt{\log n}$ is asymptotically $\mathbb{P}(Z > c\, s)$ where $Z$ is a standard normal variable and $c=c(d)$ is an explicit constant. Furthermore, for all $1 \leq p \leq \infty$, $d$-regular Ramanujan graphs minimize the asymptotic $L^p$-mixing time for SRW among all $d$-regular graphs. Our proof also shows that, for every vertex $x$ in $G$ as above, its distan…
The cutoff phenomenon was recently confirmed for random walks on Ramanujan graphs by the first author and Peres. In this work, we obtain analogs in higher dimensions, for random walk operators on any Ramanujan complex associated with a simple group $G$ over a local field $F$. We show that if $T$ is any $k$-regular $G$-equivariant operator on the Bruhat-Tits building with a simple combinatorial property (collision-free), the associated random walk on the $n$-vertex Ramanujan complex has cutoff at time $\log_k n$. The high dimensional case, unlike that of graphs, requires tools from non-commutat…
We study the simple random walk on trees and give estimates on the mixing and relaxation time. Relying on a recent characterization by Basu, Hermon and Peres, we give geometric criteria, which are easy to verify and allow to determine whether the cutoff phenomenon occurs. We thoroughly discuss families of trees with cutoff, and show how our criteria can be used to prove the absence of cutoff for several classes of trees, including spherically symmetric trees, Galton-Watson trees of a fixed height, and sequences of random trees converging to the Brownian CRT.
We survey recent results concerning the total-variation mixing time of the simple exclusion process on the segment (symmetric and asymmetric) and a continuum analog, the simple random walk on the simplex with an emphasis on cutoff results. A Markov chain is said to exhibit cutoff if on a certain time scale, the distance to equilibrium drops abruptly from $1$ to $0$. We also review a couple of techniques used to obtain these results by exposing and commenting some elements of proof.
Let $\Cal S$ be an abelian group of automorphisms of a probability space $(X, {\Cal A}, μ)$ with a finite system of generators $(A_1, ..., A_d)$. Let $A^{\el}$ denote $A_1^{\ell_1} ... A_d^{\ell_d}$, for ${\el}= (\ell_1, ..., \ell_d)$. If $(Z_k)$ is a random walk on $\Z^d$, one can study the asymptotic distribution of the sums $\sum_{k=0}^{n-1} \, f \circ A^{\,{Z_k(ω)}}$ and $\sum_{\el \in \Z^d} \PP(Z_n= \el) \, A^\el f$, for a function $f$ on $X$. In particular, given a random walk on commuting matrices in $SL(ρ, \Z)$ or in ${\Cal M}^*(ρ, \Z)$ acting on the torus $\T^ρ$, $ρ\geq 1$, what is th…