We consider a Markovian jumping process with two absorbing barriers, for which the waiting-time distribution involves a position-dependent coefficient. We solve the Fokker-Planck equation with boundary conditions and calculate the mean first passage time (MFPT) which appears always finite, also for the subdiffusive case. Then, for the case of the jumping-size distribution in form of the Lévy distribution, we determine the probability density distributions and MFPT by means of numerical simulations. Dependence of the results on process parameters, as well as on the Lévy distribution width, is discussed.
We consider a Markovian jumping process which is defined in terms of the jump-size distribution and the waiting-time distribution with a position-dependent frequency, in the diffusion limit. We assume the power-law form for the frequency. For small steps, we derive the Fokker-Planck equation and show the presence of the normal diffusion, subdiffusion and superdiffusion. For the Lévy distribution of the step-size, we construct a fractional equation, which possesses a variable coefficient, and solve it in the diffusion limit. Then we calculate fractional moments and define fractional diffusion c…
First passage time plays a fundamental role in dynamical characterization of stochastic processes. Crucially, our current understanding on the problem is almost entirely relies on the theoretical formulations, which assume the processes under consideration are Markovian, despite abundant non-Markovian dynamics found in complex systems. Here we introduce a simple and physically appealing analytical framework to calculate the first passage time statistics of non-Markovian walkers grounded in a fundamental principle of nonequilibrium statistical physics that connects the fluctuations in stochasti…
The computation of the probability of the first-passage time through a given threshold of a stochastic process is a classic problem that appears in many branches of physics. When the stochastic dynamics is markovian, the probability admits elegant analytic solutions derived from the Fokker-Planck equation with an absorbing boundary condition while, when the underlying dynamics is non-markovian, the equation for the probability becomes non-local due to the appearance of memory terms, and the problem becomes much harder to solve. We show that the computation of the probability distribution and o…
Motivated by the dynamics of resonant neurons we consider a differentiable, non-Markovian random process $x(t)$ and particularly the time after which it will reach a certain level $x_b$. The probability density of this first passage time is expressed as infinite series of integrals over joint probability densities of $x$ and its velocity $\dot{x}$. Approximating higher order terms of this series through the lower order ones leads to closed expressions in the cases of vanishing and moderate correlations between subsequent crossings of $x_b$. For a linear oscillator driven by white or coloured G…
A jumping process, defined in terms of jump size distribution and waiting time distribution, is presented. The jumping rate depends on the process value. The process, which is Markovian and stationary, relaxes to an equilibrium and is characterized by the power-law autocorrelation function. Therefore, it can serve as a model of the 1/f noise as well as a model of the stochastic force in the generalized Langevin equation. This equation is solved for the noise correlations 1/t; the resulting velocity distribution has sharply falling tails. The system preserves the memory about the initial condit…
The first-passage time (FPT), defined as the time a random walker takes to reach a target point in a confining domain, is a key quantity in the theory of stochastic processes. Its importance comes from its crucial role to quantify the efficiency of processes as varied as diffusion-limited reactions, target search processes or spreading of diseases. Most methods to determine the FPT properties in confined domains have been limited to Markovian (memoryless) processes. However, as soon as the random walker interacts with its environment, memory effects can not be neglected. Examples of non Markov…
Resonant activation is an effect of a noise-induced escape over a modulated potential barrier. The modulation of a energy landscape facilitates the escape kinetics and makes it optimal as measured by the mean first passage time. A canonical example of resonant activation is a Brownian particle moving in a time-dependent potential under action of Gaussian white noise. Resonant activation is observed not only in typical Markovian-Gaussian systems but also in far from equilibrium and far from Markovianity regimes. We demonstrate that using an alternative to the mean first passage time, robust mea…
Persistence, defined as the probability that a fluctuating signal has not reached a threshold up to a given observation time, plays a crucial role in the theory of random processes. It quantifies the kinetics of processes as varied as phase ordering, reaction diffusion or interface relaxation dynamics. The fact that persistence can decay algebraically with time with non trivial exponents has triggered a number of experimental and theoretical studies. However, general analytical methods to calculate persistence exponents cannot be applied to the ubiquitous case of non-Markovian systems relaxing…
The aim of this paper is to investigate how the correlation properties of a stationary Markovian stochastic processes affect the First Passage Time distribution. First Passage Time issues are a classical topic in stochastic processes research. They also have relevant applications, for example, in many fields of finance such as the assessment of the default risk for firms' assets. By using some explicit examples, in this paper we will show that the tail of the First Passage Time distribution crucially depends on the correlation properties of the process and it is independent from its stationary…
Based on the analysis of probability flow, where the First Passage (FP) is realised as the sink of probability, we summarise the protocol to find the distribution of the First Passage Time (FTP). We also describe the corresponding formula for the discrete time case.
We discuss a problem of cyclization of a polymer molecule, which is an important example of reaction in a system showing strongly non-Markovian behavior on the timescales of interest. We show that the knowledge of the joint three-time probability distribution of the end-to-end distance is sufficient for the full description of the cyclization kinetics, so that the survival probability follows rigorously as a solution of the Volterra integral equation. The corresponding kinetics can easily be evaluated numerically. We moreover discuss how do some well-known approximations appear from this exact…
We uncover a duality between relaxation and first passage processes in ergodic reversible Markovian dynamics in both discrete and continuous state-space. The duality exists in the form of a spectral interlacing -- the respective time scales of relaxation and first passage are shown to interlace. Our canonical theory allows for the first time to determine the full first passage time distribution analytically from the simpler relaxation eigenspectrum. The duality is derived and proven rigorously for both discrete state Markov processes in arbitrary dimension and effectively one-dimensional diffu…
We derive a functional equation for the mean first-passage time (MFPT) of a generic self-similar Markovian continuous process to a target in a one-dimensional domain and obtain its exact solution. We show that the obtained expression of the MFPT for continuous processes is actually different from the large system size limit of the MFPT for discrete jump processes allowing leapovers. In the case considered here, the asymptotic MFPT admits non-vanishing corrections, which we call residual MFPT. The case of L/'evy flights with diverging variance of jump lengths is investigated in detail, in parti…
We obtain the first passage time density for a Lévy flight random process from a subordination scheme. By this method, we infer the asymptotic behavior directly from the Brownian solution and the Sparre Andersen theorem, avoiding explicit reference to the fractional diffusion equation. Our results corroborate recent findings for Markovian Lévy flights and generalize to broad waiting times.
Fluctuations in stochastic systems are usually characterized by the full counting statistics, which analyzes the distribution of the number of events taking place in the fixed time interval. In an alternative approach, the distribution of the first-passage times, i.e. the time delays after which the counting variable reaches a certain threshold value, is studied. This paper presents the approach to calculate the first-passage time distribution in systems in which the analyzed current is associated with an arbitrary set of transitions within the Markovian network. Using this approach it is show…
Emergence of generic first-passage time distributions for large Markovian networks
University of Heidelberg（海德堡大学）；Institute for Theoretical Physics, University of Heidelberg（海德堡大学理论物理研究所）；BioQuant-Center for Quantitative Biology, University of Heidelberg（海德堡大学生物定量中心）
The diffusive non-Markovian motion over a single-well potential barrier in the presence of a weak sinusoidal time-modulation is studied. We found non-monotonic dependence of the mean escape time from the barrier on a frequency of the periodic modulation that is character to the stochastic resonance phenomenon. The resonant acceleration of diffusion over the barrier occurs at the frequency inversely proportional to the mean first-passage time for the motion in the absence of the time-modulation.
We study the kinetics of protein folding via statistical energy landscape theory. We concentrate on the local-connectivity case, where the configurational changes can only occur among neighboring states, with the folding progress described in terms of an order parameter given by the fraction of native conformations. The non-Markovian diffusion dynamics is analyzed in detail and an expression for the mean first-passage time (MFPT) from non-native unfolded states to native folded state is obtained. It was found that the MFPT has a V-shaped dependence on the temperature. We also find that the MFP…
We consider a generalization of the model by Doering and Gadoua to non-Markovian potential-switching generated by arbitrary renewal processes. For the Markovian switching process, we extend the original results by Doering and Gadoua by giving a complete description of the absorption process. For all non-Markovian processes having the first moment of the waiting time distributions, we get qualitatively the same results as in the Markovian case. However, for distributions without the first moment, the mean first passage time curves do not exhibit the resonant activation minimum. We thus come to …
Many out of equilibrium phenomena, such as diffusion-limited reactions or target search processes, are controlled by first-passage events. So far the general determination of the mean first-passage time (FPT) to a target in confinement has left aside aging processes, involved in contexts as varied as glassy dynamics, tracer diffusion in biological membranes or transport of cold atoms in optical lattices. Here we consider general non-Markovian scale-invariant processes in arbitrary dimension, displaying aging, and demonstrate that all the moments of the FPT obey universal scalings with the conf…
We consider an anisotropic needle-like Brownian particle with nematic symmetry confined in a $2D$ domain. For this system, the coupling of translational and rotational diffusion makes the process ${\bf x} (t)$ of the positions of the particle non Markovian. Using scaling arguments, a Gaussian approximation and numerical methods, we determine the mean first passage time $\langle\mathbf{T}\rangle$ of the particle to a target of radius $a$ and show in particular that $\langle\mathbf{T}\rangle \sim a^{-1/2}$ for $a\to 0$, in contrast with the classical logarithmic divergence obtained in the case o…
We study the diffusive motion of a test particle in a two-dimensional comb structure consisting of a main backbone channel with continuously distributed side branches, in the presence of stochastic Markovian resetting to the initial position of the particle. We assume that the motion along the infinitely long branches is biased by a confining potential. The crossover to the steady state is quantified in terms of a large deviation function, which is derived for the first time for comb structures in present paper. We show that the relaxation region is demarcated by a nonlinear "light-cone" beyon…
We introduce a perturbative method to calculate all moments of the first-passage time distribution in stochastic one-dimensional processes which are subject to both white and coloured noise. This class of non-Markovian processes is at the centre of the study of thermal active matter, that is self-propelled particles subject to diffusion. The perturbation theory about the Markov process considers the effect of self-propulsion to be small compared to that of thermal fluctuations. To illustrate our method, we apply it to the case of active thermal particles (i) in a harmonic trap (ii) on a ring. …
How much time does it take for a fluctuating system, such as a polymer chain, to reach a target configuration that is rarely visited -- typically because of a high energy cost ? This question generally amounts to the determination of the first-passage time statistics to a target zone in phase space with lower occupation probability. Here, we present an analytical method to determine the mean first-passage time of a generic non-Markovian random walker to a rarely visited threshold, which goes beyond existing weak-noise theories. We apply our method to polymer systems, to determine (i) the first…
We investigate models in which blocking can interrupt a particulate flow process at any time. Filtration, and flow in micro/nano-channels and traffic flow are examples of such processes. We first consider concurrent flow models where particles enter a channel randomly. If at any time two particles are simultaneously present in the channel, failure occurs. The key quantities are the survival probability and the distribution of the number of particles that pass before failure. We then consider a counterflow model with two opposing Poisson streams. There is no restriction on the number of particl…
The aim of the paper is to understand how the inclusion of more and more time-scales into a stochastic stationary Markovian process affects its conditional probability. To this end, we consider two Gaussian processes: (i) a short-range correlated process with an infinite set of time-scales bounded from below, and (ii) a power-law correlated process with an infinite and unbounded set of time-scales. For these processes we investigate the equal position conditional probability P(x,t|x,0) and the mean First Passage Time T(L). The function P(x,t|x,0) can be considered as a proxy of the persistence…
The mean first passage time, one of the important characteristics for a stochastic process, is often calculated assuming the observation time is infinite. However, in practice, the observation time, T, is always finite and the mean first passage time (MFPT) is dependent on the length of the observation time. In this work, we investigate the observation time dependence of the MFPT of a particle freely moving in the interval [-L,L] for a simple diffusion model and four different models of subdiffusion, the fractional diffusion equation (FDE), scaled Brown motion (SBM), fractional Brownian motion…
We consider a walker moving in a one-dimensional interval with absorbing boundaries under the effect of Markovian resettings to the initial position. The walker's motion follows a random walk characterized by a general waiting time distribution between consecutive short jumps. We investigate the existence of an optimal reset rate, which minimizes the mean exit passage time, in terms of the statistical properties of the waiting time probability. Generalizing previous results restricted to Markovian random walks, we here find that, depending on the value of the relative standard deviation of the…
We study the problem of random search in finite networks with a tree topology, where it is expected that the distribution of the first-passage time F(t) decays exponentially. We show that the slope of the exponential tail is independent of the initial conditions of entering the tree in general, and scales exponentially or as a power law with the extent of the tree L, depending on the tendency p to jump toward the target node. It is unfeasible to uniquely determine L and p from measuring the tail slope or the mean first-passage time (MFPT) of an ordinary diffusion along the tree. To unravel the…
The statistics of first-passage times of random walks to target sites has proved to play a key role in determining the kinetics of space exploration in various contexts. In parallel, the number of distinct sites visited by a random walker and related observables have been introduced to characterize the geometry of space exploration. Here, we address the question of the joint distribution of the first-passage time to a target and the number of distinct sites visited when the target is reached, which fully quantifies the coupling between kinetics and geometry of search trajectories. Focusing on …
Self-interacting random walks are endowed with long range memory effects that emerge from the interaction of the random walker at time $t$ with the territory that it has visited at earlier times $t'<t$. This class of non Markovian random walks has applications in a broad range of examples, ranging from insects to living cells, where a random walker modifies locally its environment -- leaving behind footprints along its path, and in turn responds to its own footprints. Because of their inherent non Markovian nature, the exploration properties of self-interacting random walks have remained elusi…
We investigate statistics of occupation times for an over-damped Brownian particle in an external force field. A backward Fokker-Planck equation introduced by Majumdar and Comtet describing the distribution of occupation times is solved. The solution gives a general relation between occupation time statistics and probability currents which are found from solutions of the corresponding problem of first passage time. This general relationship between occupation times and first passage times, is valid for normal Markovian diffusion and for non-Markovian sub-diffusion, the latter modeled using the…
We study the mean first-passage time (MFPT) for asymmetric continuous-time random walks in continuous-space characterised by waiting-times with finite mean and by jump-sizes with both finite mean and finite variance. In the asymptotic limit, this well-controlled process is governed by an advection-diffusion equation and the MFPT results to be finite when the advecting velocity is in the direction of the boundary. We derive a nonhomogeneous Wiener-Hopf integral equation that allows for the exact calculation of the MFPT by avoiding asymptotic limits and it emerges to depend on the whole distribu…
Random walks with memory typically involve rules where a preference for either revisiting or avoiding those sites visited in the past are introduced somehow. Such effects have a direct consequence on the statistics of first-passage and subsequent recurrence times through a site; typically, a preference for revisiting sites is expected to result in a positive correlation between consecutive recurrence times. Here we derive a continuous-time generalization of the random walk model with preferential relocation to visited sites proposed in [Phys. Rev. Lett. 112, 240601] to explore this effect, tog…
For many stochastic processes, the probability $S(t)$ of not-having reached a target in unbounded space up to time $t$ follows a slow algebraic decay at long times, $S(t)\sim S_0/t^θ$. This is typically the case of symmetric compact (i.e. recurrent) random walks. While the persistence exponent $θ$ has been studied at length, the prefactor $S_0$, which is quantitatively essential, remains poorly characterized, especially for non-Markovian processes. Here we derive explicit expressions for $S_0$ for a compact random walk in unbounded space by establishing an analytic relation with the mean first…
Stochastic search processes are ubiquitous in nature and are expected to become more efficient when equipped with a memory, where the searcher has been before. A natural realization of a search process with long-lasting memory is a migrating cell that is repelled from the diffusive chemotactic signal that it secrets on its way, denoted as auto-chemotactic searcher. To analyze the efficiency of this class of non-Markovian search processes we present a general formalism that allows to compute the mean first passage time (MFPT) for a given set of conditional transition probabilities for non-Marko…
In this paper, we develop an encounter-based model of partial surface adsorption for fractional diffusion in a bounded domain. We take the probability of adsorption to depend on the amount of particle-surface contact time, as specified by a Brownian functional known as the boundary local time $\ell(t)$. If the rate of adsorption is state dependent, then the adsorption process is non-Markovian, reflecting the fact that surface activation/deactivation proceeds progressively by repeated particle encounters. The generalized adsorption event is identified as the first time that the local time cross…
We consider the usual Langevin equation depending on an internal time. This parameter is substituted by a first passage time of a self-similar Markov process. Then the Gaussian process is parent, and the hitting time process is directing. The probability to find the resulting process at the real time is defined by the integral relationship between the probability densities of the parent and directing processes. The corresponding master equation becomes the fractional Fokker-Planck equation. We show that the resulting process has non-Markovian properties, all its moments are finite, the fluctua…
Intracellular transport of organelles is fundamental to cell function and health. The mounting evidence suggests that this transport is in fact anomalous. However, the reasons for the anomaly is still under debate. We examined experimental trajectories of organelles inside a living cell and propose a mathematical model that describes the previously reported transition from sub-diffusive to super-diffusive motion. In order to explain super-diffusive behaviour at long times, we introduce non-Markovian detachment kinetics of the cargo: the rate of detachment is inversely proportional to the time …
Recent single molecule experiments probing the passage process of a short single-stranded DNA (ssDNA) through a membrane channel (translocation) allow to measure the passage time distribution. Building on a recent modelling approach (D. K. Lubensky and D. R. Nelson, Biophys. J. 77, 1824 (1999)), which has been demonstrated to be valid for chains of up to $\simeq 300$ nucleotides and therefore well applies to the system we have in mind, we discuss the consequences if the associated dynamics is not of Markov origin, but if strong memory effects prevail during the translocation. Motivation is dra…
In this review we discuss the persistence and the related first-passage properties in extended many-body nonequilibrium systems. Starting with simple systems with one or few degrees of freedom, such as random walk and random acceleration problems, we progressively discuss the persistence properties in systems with many degrees of freedom. These systems include spins models undergoing phase ordering dynamics, diffusion equation, fluctuating interfaces etc. Persistence properties are nontrivial in these systems as the effective underlying stochastic process is non-Markovian. Several exact and ap…
