This is the story of the encounter between two worlds: the world of random walks and the world of Variable Length Markov Chains (VLMC). The meeting point turns around the semi-Markov property of underlying processes.
The recurrence features of persistent random walks built from variable length Markov chains are investigated. We observe that these stochastic processes can be seen as L{é}vy walks for which the persistence times depend on some internal Markov chain: they admit Markov random walk skeletons. A recurrence versus transience dichotomy is highlighted. We first give a sufficient Fourier criterion for the recurrence, close to the usual Chung-Fuchs one, assuming in addition the positive recurrence of the driving chain and a series criterion is derived. The key tool is the Nagaev-Guivarc'h method. Fina…
We study a family of memory-based persistent random walks and we prove weak convergences after space-time rescaling. The limit processes are not only Brownian motions with drift. We have obtained a continuous but non-Markov process $(Z_t)$ which can be easely expressed in terms of a counting process $(N_t)$. In a particular case the counting process is a Poisson process, and $(Z_t)$ permits to represent the solution of the telegraph equation. We study in detail the Markov process $((Z_t,N_t); t\ge 0)$.
We consider the two-dimensional simple random walk conditioned on never hitting the origin, which is,formally speaking, the Doob's $h$-transform of the simple random walk with respect to the potential kernel. We then study the behavior of the future minimum distance of the walk to the origin, and also prove that two independent copies of the conditioned walk, although both transient, will nevertheless meet infinitely many times a.s.
We give a complete and unified description -- under some stability assumptions -- of the functional scaling limits associated with some persistent random walks for which the recurrent or transient type is studied in [1]. As a result, we highlight a phase transition phenomenon with respect to the memory. It turns out that the limit process is either Markovian or not according to -- to put it in a nutshell -- the rate of decrease of the distribution tails corresponding to the persistent times. In the memoryless situation, the limits are classical strictly stable L{é}vy processes of infinite vari…
A classical random walk $(S_t, t\in\mathbb{N})$ is defined by $S_t:=\displaystyle\sum_{n=0}^t X_n$, where $(X_n)$ are i.i.d. When the increments $(X_n)_{n\in\mathbb{N}}$ are a one-order Markov chain, a short memory is introduced in the dynamics of $(S_t)$. This so-called "persistent" random walk is nolonger Markovian and, under suitable conditions, the rescaled process converges towards the integrated telegraph noise (ITN) as the time-scale and space-scale parameters tend to zero (see Herrmann and Vallois, 2010; Tapiero-Vallois, Tapiero-Vallois2}). The ITN process is effectively non-Markovian …
We discuss the question of recurrence for persistent, or Newtonian, random walks in Z^2, i.e., random walks whose transition probabilities depend both on the walker's position and incoming direction. We use results by Toth and Schmidt-Conze to prove recurrence for a large class of such processes, including all "invertible" walks in elliptic random environments. Furthermore, rewriting our Newtonian walks as ordinary random walks in a suitable graph, we gain a better idea of the geometric features of the problem, and obtain further examples of recurrence.
We consider a walker that at each step keeps the same direction with a probabilitythat depends on the time already spent in the direction the walker is currently moving. In this paper, we study some asymptotic properties of this persistent random walk and give the conditions of recurrence or transience in terms of "transition" probabilities to keep on the same direction or to change, without assuming that the latter admits any stationary probability. Examples are exhibited when this process is recurrent even if the random walk is not symmetric.
In a simple model of a continuous random walk a particle moves in one dimension with the velocity fluctuating between V and -V. If V is associated with the thermal velocity of a Brownian particle and allowed to be position dependent, the model accounts readily for the particle's drift along the temperature gradient and recovers basic results of the conventional thermophoresis theory.
Excited random walk is a process that has a drift to the right whenever it encounters a new vertex. The paper shows that in two dimensions it drifts to the right linearly in time.
Suppose that attached to each site z in Z is a coin with bias theta(z), and only finitely many of these coins have non-zero bias. Allow a simple random walker to generate observations by tossing, at each move, the coin attached to its current position. Then we can determine the biases {theta(z) : z in Z}, using only the outcomes of these coin tosses and no information about the path of the random walker, up to a shift and reflection of Z. This generalizes a result of Harris and Keane.
We consider a non-homogeneous random walks system on $\bbZ$ in which each active particle performs a nearest neighbor random walk and activates all inactive particles it encounters up to a total amount of $L$ jumps. We present necessary and sufficient conditions for the process to survive, which means that an infinite number of random walks become activated.
We analyze random walk in the upper half of a three dimensional lattice which goes down whenever it encounters a new vertex, a.k.a. excited random walk. We show that it is recurrent with an expected number of returns of square-root log n.
Recently, in ["The coin-turning walk and its scaling limit", Electronic Journal of Probability, 25 (2020)], the ``coin-turning walk'' was introduced on ${\mathbb Z}$. It is a non-Markovian process where the steps form a (possibly) time-inhomogeneous Markov chain. In this article, we follow up the investigation by introducing analogous processes in ${\mathbb Z}^d$, $d\ge 2$: at time $n$ the direction of the process is ``updated'' with probability $p_n$; otherwise the next step repeats the previous one. We study some of the fundamental properties of these walks, such as transience/recurrence and…
Consider a random walk in random environment on a supercritical Galton--Watson tree, and let $τ_n$ be the hitting time of generation $n$. The paper presents a large deviation principle for $τ_n/n$, both in quenched and annealed cases. Then we investigate the subexponential situation, revealing a polynomial regime similar to the one encountered in one dimension. The paper heavily relies on estimates on the tail distribution of the first regeneration time.
Let $ξ(n, x)$ be the local time at $x$ for a recurrent one-dimensional random walk in random environment after $n$ steps, and consider the maximum $ξ^*(n) = \max_x ξ(n,x)$. It is known that $\limsup ξ^*(n)/n$ is a positive constant a.s. We prove that $\liminf_n (\log\log\log n)ξ^*(n)/n$ is a positive constant a.s.; this answers a question of P. Révész (1990). The proof is based on an analysis of the {\em valleys /} in the environment, defined as the potential wells of record depth. In particular, we show that almost surely, at any time $n$ large enough, the random walker has spent almost all o…
We consider a system of independent branching random walks on $\R$ which start off a Poisson point process with intensity of the form $e_λ(du)=e^{-λu}du$, where $λ\in\R$ is chosen in such a way that the overall intensity of particles is preserved. Denote by $χ$ the cluster distribution and let $ϕ$ be the log-Laplace transform of the intensity of $χ$. If $λϕ'(λ)>0$, we show that the system is persistent (stable) meaning that the point process formed by the particles in the $n$-th generation converges as $n\to\infty$ to a non-trivial point process $Π_{e_λ}^χ$ with intensity $e_λ$. If $λϕ'(λ)<0$,…
We introduce a technique using nonbacktracking random walk for estimating the spectral radius of simple random walk. This technique relates the density of nontrivial cycles in simple random walk to that in nonbacktracking random walk. We apply this to infinite Ramanujan graphs, which are regular graphs whose spectral radius equals that of the tree of the same degree. Kesten showed that the only infinite Ramanujan graphs that are Cayley graphs are trees. This result was extended to unimodular random rooted regular graphs by Abért, Glasner and Virág. We show that an analogous result holds for al…
Random walk in random environment (RWRE) is a fundamental model of statistical mechanics, describing the movement of a particle in a highly disordered and inhomogeneous medium as a random walk with random jump probabilities. It has been introduced in a series of papers by Chernov and Temkin as a model for DNA chain replication and crystal growth, and also as a model for turbulent behavior in fluids through a Lorentz gas description by Sinai. It is a simple but powerful model for a variety of complex large-scale disordered phenomena arising from fields such as physics, biology and engineering. …
This paper considers non-backtracking random walks on random graphs generated according to the configuration model. The quantity of interest is the scaling of the mixing time of the random walk as the number of vertices of the random graph tends to infinity. Subject to mild general conditions, we link two mixing times: one for a static version of the random graph, the other for a class of dynamic versions of the random graph in which the edges are randomly rewired but the degrees are preserved. The link is provided by the probability that the random walk has not yet stepped along a previously …
Researchers have designed many algorithms to measure the distances between graph nodes, such as average hitting times of random walks, cosine distances from DeepWalk, personalized PageRank, etc. Successful although these algorithms are, still they are either underperforming or too time-consuming to be applicable to huge graphs that we encounter daily in this big data era. To address these issues, here we propose a faster algorithm based on an improved version of random walks that can beat DeepWalk results with more than ten times acceleration. The reason for this significant acceleration is th…
We consider a model of space-continuous one-dimensional random walk with simple correlation between the steps: the probability that two consecutive steps have same sign is $q$ with $0\leq q\leq 1$. The parameter $q$ allows thus to control the persistence of the random walk. We compute analytically the survival probability of a walk of $n$ steps, showing that it is independent of the jump distribution for any finite $n$. This universality is a consequence of the Sparre-Andersen theorem for random walks with uncorrelated and symmetric steps. We then apply this result to derive the distribution o…
The numerical solution of stochastic partial differential equations (SPDE) presents challenges not encountered in the simulation of PDEs or SDEs. Indeed, the roughness of the noise in conjunction with nonlinearities in the drift typically make these equations particularly stiff. In practice, this means that it is tricky to construct, operate, and validate numerical methods for SPDEs. This is especially true if one is interested in path-dependent expected values, long-time simulations, or in the simulation of SPDEs whose solutions have constraints on their domains. To address these numerical is…
While records and order statistics of independent and identically distributed (i.i.d.) random variables X_1, ..., X_N are fully understood, much less is known for strongly correlated random variables, which is often the situation encountered in statistical physics. Recently, it was shown, in a series of works, that one-dimensional random walk (RW) is an interesting laboratory where the influence of strong correlations on records and order statistics can be studied in detail. We review here recent exact results which have been obtained for these questions about RW, using techniques borrowed fro…