We study the evolution of the maximum energy $E_\max(t)$ reached between time $0$ and time $t$ in the dynamics of simple models with glassy energy landscapes, in instant quenches from infinite temperature to a target temperature $T$. Through a detailed description of the activated dynamics, we are able to describe the evolution of $E_\max(t)$ from short times, through the aging regime, until after equilibrium is reached, thus providing a detailed description of the long-time dynamics. Finally, we compare our findings with numerical simulations of the $p$-spin glass and show how the maximum energy record can be used to identify the threshold energy in this model.
In this paper we expose the results of our recent work on the dynamical TAP approach to mean field glassy systems. Our aim is to clarify the connection between free energy landscape and out of equilibrium dynamics in solvable models. Frequently qualitative explanations of glassy behaviour are based on the ``Free Energy Landscape Paradigm''. If its relevance for equilibrium properties is clear, the relationship between free energy landscape and out of equilibrium dynamics is not well understood yet. In this paper we clarify this relationship for the class of spin glass models which reproduce ph…
We introduce a generalization of the cavity, or Bethe-Peierls, method that allows to follow Gibbs states when an external parameter, e.g. the temperature, is adiabatically changed. This allows to obtain new quantitative results on the static and dynamic behavior of mean field disordered systems such as models of glassy and amorphous materials or random constraint satisfaction problems. As a first application, we discuss the residual energy after a very slow annealing, the behavior of out-of-equilibrium states, and demonstrate the presence of temperature chaos in equilibrium. We also explore th…
We present the study of the landscape structure of athermal soft spheres both as a function of the packing fraction and of the energy. We find that, on approaching the jamming transition, the number of different configurations available to the system has a steep increase and that a hierarchical organization of the landscape emerges. We use the knowledge of the structure of the landscape to predict the values of thermodynamic observables on the edge of the transition.
We propose a way to analyze the landscape geometry explored by a glassy system after a quench solely based on time series of energy values recorded during a simulation. Entry and exit times for landscape `valleys' are defined operationally by the occurrence of anomalous energy changes revealed by barrier and energy records. Linking these non-equilibrium events--or `earthquakes'-- to the record statistics of the thermal noise immediately leads to the $\ln t$ relaxation behavior ubiquitous in glassy dynamics. Aging of Ising spin glasses in two and three dimensions is studied as a check for a num…
We present a simple mathematical framework for the description of the dynamics of glassy systems in terms of a random walk in a complex energy landscape pictured as a network of minima. We show how to use the tools developed for the study of dynamical processes on complex networks, in order to go beyond mean-field models that consider that all minima are connected to each other. We consider several possibilities for the transition rates between minima, and show that in all cases the existence of a glassy phase depends on a delicate interplay between the network's topology and the relationship …
The Thouless, Anderson, Palmer (TAP) approach to thermodynamics of mean field spin-glasses is generalised to dynamics. A method to compute the dynamical TAP equations is developed and applied to the p-spin spherical model. In this context we show to what extent the dynamics can be represented as an evolution in the free energy landscape. In particular the relationship between the long-time dynamics and the local properties of the free energy landscape shows up explicitly within this approach. Conversely, by an instantaneous normal modes analysis we show that the local properties of the energy …
This is a short review on the compatibility between (a) mean-field, mode-coupling theories of the glass transition, where potential energy landscape ideas are natural, and (b) the necessity of describing the slowing down of glassy materials in terms of a growing cooperative length, absent from mean-field descriptions. We summarize some of the outstanding questions that remain before we can say we understand why glasses do not flow.
We endow a system of interacting particles with two distinct, local, Markovian and reversible microscopic dynamics. Using common field-theoretic techniques used to investigate the presence of a glass transition, we find that while the first, standard, dynamical rules lead to glassy behavior, the other one leads to a simple exponential relaxation towards equilibrium. This finding questions the intrinsic link that exists between the underlying, thermodynamical, energy landscape, and the dynamical rules with which this landscape is explored by the system. Our peculiar choice of dynam- ical rules …
We study the distribution of overlaps of glassy minima, taking proper care of residual symmetries of the system. Ensembles of locally stable, low lying glassy states are efficiently generated by rapid cooling from the liquid phase which has been equilibrated at a temperature $T_{run}$. Varying $T_{run}$, we observe a transition from a regime where a broad range of states are sampled to a regime where the system is almost always trapped in a metastable glassy state. We do not observe any structure in the distribution of overlaps of glassy minima, but find only very weak correlations, comparable…
We introduce time correlation functions between Inherent Structures (IS) of a supercooled liquid. We show that these functions are useful to relate the slowing down of the dynamics to the structure of the energy landscape near the glass transition temperature. They show a short time regime during which the system remains in the basin of a particular IS and a long time regime where it explores the neighborhood of an IS. We compare the behavior of these functions in a binary Lennard-Jones supercooled liquid and in a model of traps and show that they behave qualitatively different. This compariso…
The complex dynamics of an increasing number of systems is attributed to the emergence of a rugged energy landscape with an exponential number of metastable states. To develop this picture into a predictive dynamical theory I discuss how to compute the exponentially small probability of a jump from one metastable state to another. This is expressed as a path integral that can be evaluated by saddle-point methods in mean-field models, leading to a boundary value problem. The resulting dynamical equations are solved numerically by means of a Newton-Krylov algorithm in the paradigmatic spherical …
We propose a microscopic translationally invariant glass model which exhibits two level tunneling systems with a broad range of asymmetries and barrier heights in its glassy phase. Their distribution is qualitatively different from what is commonly assumed in phenomenological models, in that symmetric tunneling systems are systematically suppressed. Still, the model exhibits the usual glassy low-temperature anomalies. Universality is due to the collective origin of the glassy potential energy landscape. We obtain a simple explanation also for the mysterious {\em quantitative} universality expr…
We calculate the density of stationary points and minima of a $N\gg 1$ dimensional Gaussian energy landscape. We use it to show that the point of zero-temperature replica symmetry breaking in the equilibrium statistical mechanics of a particle placed in such a landscape in a spherical box of size $L=R\sqrt{N}$ corresponds to the onset of exponential in $N$ growth of the cumulative number of stationary points, but not necessarily the minima. For finite temperatures we construct a simple variational upper bound on the true free energy of the $R=\infty$ version of the problem and show that this a…
The complex physics of glass forming systems is controlled by the structure of the low energy portions of their potential energy landscapes. Here, we report that a modified metadynamics algorithm efficiently explores and samples low energy regions of such high-dimensional landscapes. In the energy landscape for a model foam, our algorithm finds and descends meandering `canyons' in the landscape, which contain dense clusters of energy minima along their floors. Similar canyon structures in the energy landscapes of two model glass formers -- hard sphere fluids and the Kob-Andersen glass -- allow…
The spherical p-spin model is not only a fundamental model in statistical mechanics of disordered system, but has recently gained popularity since many hard problems in machine learning can be mapped on it. Thus the study of the out of equilibrium dynamics in this model is interesting both for the glass physics and for its implications on algorithms solving NP-hard problems. We revisit the long-time limit of the out of equilibrium dynamics of mean-field spherical mixed p-spin models. We consider quenches (gradient descent dynamics) starting from initial conditions thermalized at some temperatu…
Spin glasses are notoriously difficult to study both analytically and numerically due to the presence of frustration and metastability. Their highly non-convex landscapes require collective updates to explore efficiently. Currently, most state-of-the-art algorithms rely on stochastic spin clusters to perform non-local updates, but such "cluster algorithms" lack general efficiency. Here, we introduce a non-equilibrium approach for simulating spin glasses based on classical dynamics with memory. By simulating various classes of 3d spin glasses (Edwards-Anderson, partially-frustrated, and fully-f…
Cooperative events requiring anomalously large fluctuations are a defining characteristic for the onset of glassy relaxation across many materials. The importance of such intermittent events has been noted in systems as diverse as superconductors, metallic glasses, gels, colloids, and granular piles. Here, we show that prohibiting the attainment of new record-high energy fluctuations -- by explicitly imposing a ``lid'' on the fluctuation spectrum -- impedes further relaxation in the glassy phase. This lid allows us to directly measure the impact of record events on the evolving system in exten…
The reorientation of one small paramagnetic molecule (spin probe) in glassy polystyrene (PS) is studied by high-field Electron Spin Resonance spectroscopy at two different Larmor frequencies (190 and 285 GHz). The exponential distribution of the energy-barriers for the rotational motion of the spin probe is unambigously evidenced at both 240K and 270K. The same shape for the distribution of the energy-barriers of PS was evidenced by the master curves provided by previous mechanical and light scattering studies. The breadth of the energy-barriers distribution of the spin probe is in the range o…
We study rough high-dimensional landscapes in which an increasingly stronger preference for a given configuration emerges. Such energy landscapes arise in glass physics and inference. In particular we focus on random Gaussian functions, and on the spiked-tensor model and generalizations. We thoroughly analyze the statistical properties of the corresponding landscapes and characterize the associated geometrical phase transitions. In order to perform our study, we develop a framework based on the Kac-Rice method that allows to compute the complexity of the landscape, i.e. the logarithm of the ty…
We show that a glass transition, signaled by a peak in the specific heat vs. temperature, can occur because a glassy system that shows no signs of aging progresses so slowly through the energy landscape that the time needed to obtain an accurate estimate of the thermodynamic averages exceeds the observation time. We find that below the glass transition temperature of a three dimensional binary mixture of soft spheres, the specific heat increases with measurement time spans orders of magnitude longer than previously recognized equilibration times.
Epithelial cell tissues have a slow relaxation dynamics resembling that of supercooled liquids. Yet, they also have distinguishing features. These include an extended short-time sub-diffusive transient, as observed in some experiments and recent studies of model systems, and a sub-Arrhenius dependence of the relaxation time on temperature, as reported in numerical studies. Here we demonstrate that the anomalous glassy dynamics of epithelial tissues originates from the emergence of a fractal-like energy landscape, particles becoming virtually free to diffuse in specific phase space directions u…
Columbia University(哥伦比亚大学);Université Paris Saclay(巴黎萨克雷大学);CEA(法国原子能和替代能源委员会);CNRS(法国国家科学研究中心);EPFL(洛桑联邦理工学院);New York University(纽约大学);King’s College London(伦敦国王学院);Facebook Inc.(脸书公司);École Normale Supérieure(巴黎高等师范学院);PSL Research University(巴黎文理研究大学);Sorbonne Universités(索邦大学)
We analyze numerically the training dynamics of deep neural networks (DNN) by using methods developed in statistical physics of glassy systems. The two main issues we address are (1) the complexity of the loss landscape and of the dynamics within it, and (2) to what extent DNNs share similarities with glassy systems. Our findings, obtained for different architectures and datasets, suggest that during the training process the dynamics slows down because of an increasingly large number of flat directions. At large times, when the loss is approaching zero, the system diffuses at the bottom of the…
Supercooled liquids undergo complicated structural relaxation processes, which have been a long-standing problem in both experimental and theoretical aspects of condensed matter physics. In particular, past experiments universally observed for many types of molecular liquids that relaxation dynamics separated into two distinct processes at low temperatures. One of the possible interpretations is that this separation originates from the two-scale hierarchical topography of the potential energy landscape; however, it has never been verified. Molecular dynamics simulations are a promising approac…
The topography of the free energy landscape in phase space of a dense hard sphere system characterized by a discretized free energy functional of the Ramakrishnan-Yussouff form is investigated numerically using a ``microcanonical'' Monte Carlo procedure. We locate a considerable number of glassy local minima of the free energy and analyze the distributions of the free energy at a minimum and an appropriately defined phase-space ``distance'' between different minima. We find evidence for the existence of pairs of closely related glassy minima (``two-level systems''). We also investigate the way…
We characterize the low temperature phase of a simple model for RNA secondary structures by determining the typical energy scale E(l) of excitations involving l bases. At zero temperature, we find a scaling law E(l) \sim l^θwith θ\approx 0.23, and this same scaling holds at low enough temperatures. Above a critical temperature, there is a different phase characterized by a relatively flat free energy landscape resembling that of a homopolymer with a scaling exponent θ=1. These results strengthen the evidence in favour of the existence of a glass phase at low temperatures.
Molecular dynamics simulations are used to generate an ensemble of saddles of the potential energy of a Lennard-Jones liquid. Classifying all extrema by their potential energy u and number of unstable directions k, a well defined relation k(u) is revealed. The degree of instability of typical stationary points vanishes at a threshold potential energy, which lies above the energy of the lowest glassy minima of the system. The energies of the inherent states, as obtained by the Stillinger-Weber method, approach the threshold energy at a temperature close to the mode-coupling transition temperatu…
The description of activated relaxation of glassy systems in the multidimensional configurational space is a long-standing open problem. We develop a phenomenological description of the out-of-equilibrium dynamics of a model with a rough potential energy landscape and we analyse it both numerically and analytically. The model provides an example of dynamics where typical relaxation channels go over finite potential energy barriers despite the presence of less-energy-demanding escaping paths in configurational space; we expect this phenomenon to be also relevant in the thermally activated regim…
A method is presented, which allows to sample directly low-temperature configurations of glassy systems, like spin glasses. The basic idea is to generate ground states and low lying excited configurations using a heuristic algorithm. Then, with the help of microcanonical Monte Carlo simulations, more configurations are found, clusters of configurations are determined and entropies evaluated. Finally equilibrium configuration are randomly sampled with proper Gibbs-Boltzmann weights. The method is applied to three-dimensional Ising spin glasses with +- J interactions and temperatures T<=0.5. The…
We numerically study the potential energy landscape of a fragile glassy system and find that the dynamic crossover corresponding to the glass transition is actually the effect of an underlying geometric transition caused by a qualitative change in the topological properties of the landscape. Furthermore, we show that the potential energy barriers connecting local glassy minima increase with decreasing energy of the minima, and we relate this behaviour to the fragility of the system. Finally, we analyze the real space structure of activated processes by studying the distribution of particle dis…
We exploit a relation between the mean number $N_{m}$ of minima of random Gaussian surfaces and extreme eigenvalues of random matrices to understand the critical behaviour of $N_{m}$ in the simplest glass-like transition occuring in a toy model of a single particle in $N$-dimensional random environment, with $N\gg 1$. Varying the control parameter $μ$ through the critical value $μ_c$ we analyse in detail how $N_{m}(μ)$ drops from being exponentially large in the glassy phase to $N_{m}(μ)\sim 1$ on the other side of the transition. We also extract a subleading behaviour of $N_{m}(μ)$ in both gl…
Properties of the free energy landscape in phase space of a dense hard sphere system characterized by a discretized free energy functional of the Ramakrishnan-Yussouff form are investigated numerically. A considerable number of glassy local minima of the free energy are located and the distribution of an appropriately defined ``overlap'' between minima is calculated. The process of transition from the basin of attraction of a minimum to that of another one is studied using a new ``microcanonical'' Monte Carlo procedure, leading to a determination of the effective height of free energy barriers…
We review how the renormalized force correlator Delta(u), the function computed in the functional RG field theory, can be measured directly in numerics and experiments on the dynamics of elastic manifolds in presence of pinning disorder. We show how this function can be computed analytically for a particle dragged through a 1-dimensional random-force landscape. The limit of small velocity allows to access the critical behavior at the depinning transition. For uncorrelated forces one finds three universality classes, corresponding to the three extreme value statistics, Gumbel, Weibull, and Frec…
In this paper we investigate the relationship between glassy and ferromagnetic phases in disordered Ising ferromagnets in the presence of transverse magnetic fields, $Γ$. Iterative mean field simulations probe the free energy landscape and suggest the existence of a glass transition as a function of $Γ$ which is distinct from the Curie temperature. New experimental field-cooled and zero-field-cooled data on LiHo$_x$Y$_{1-x}$F$_4$ provide support for our theoretical picture.
A novel method for glassy landscape exploration is presented which utilizes a time series of energy values collected during an isothermal relaxation after a thermal quench. A sub-series of increasingly rare events, or quakes, which are connected to an irreversible release of energy from the system, is used to identify entry and exit times for landscape valleys. The landscape of three dimensional spin glasses is studied from this angle for a number of lattice sizes and for a range of low temperatures. A simple picture emerges regarding the temperature and size dependence of (1) the energy barri…
Monte Carlo algorithms such as the Wang-Landau algorithm and similar `entropic' methods are able to accurately sample the density of states of model systems and thereby give access to thermal equilibrium properties at any temperature. Thermal equilibrium is however not achievable at low temperatures in glassy systems. Such systems are characterized by a multitude of metastable configurations, pictorially referred to as `valleys' of an energy landscape. Geometrical properties of the landscape, e.g. the local density of states describing the distribution in energy of the states belonging to a si…
The thermally activated creep motion of an elastic interface weakly driven on a disordered landscape is one of the best examples of glassy universal dynamics. Its understanding has evolved over the last 30 years thanks to a fruitful interplay between elegant scaling arguments, sophisticated analytical calculations, efficient optimization algorithms and creative experiments. In this article, starting from the pioneer arguments, we review the main theoretical and experimental results that lead to the current physical picture of the creep regime. In particular, we discuss recent works unveiling t…
Artificial neural networks have been widely adopted as ansatzes to study classical and quantum systems. However, some notably hard systems such as those exhibiting glassiness and frustration have mainly achieved unsatisfactory results despite their representational power and entanglement content, thus, suggesting a potential conservation of computational complexity in the learning process. We explore this possibility by implementing the neural annealing method with autoregressive neural networks on a model that exhibits glassy and fractal dynamics: the two-dimensional Newman-Moore model on a t…
The notion of complex energy landscape underpins the intriguing dynamical behaviors in many complex systems ranging from polymers, to brain activity, to social networks and glass transitions. The spin glass state found in dilute magnetic alloys has been an exceptionally convenient laboratory frame for studying complex dynamics resulting from a hierarchical energy landscape with rugged funnels. Here, we show, by a bulk susceptibility and Monte Carlo simulation study, that densely populated frustrated magnets in a spin jam state exhibit much weaker memory effects than spin glasses, and the chara…
A recent 3-XORSAT challenge required to minimize a very complex and rough energy function, typical of glassy models with a random first order transition and a golf course like energy landscape. We present the ideas beyond the quasi-greedy algorithm and its very efficient implementation on GPUs that are allowing us to rank first in such a competition. We suggest a better protocol to compare algorithmic performances and we also provide analytical predictions about the exponential growth of the times to find the solution in terms of free-energy barriers.
We present a framework for analyzing the rheology of dense driven granular materials, based on a recent proposal of a stress-based ensemble. In this ensemble fluctuations in a granular system near jamming are controlled by a temperature-like parameter, the angoricity, which is conjugate to the stress of the system. In this paper, we develop a model for slowly driven granular materials based on the stress ensemble and the idea of a landscape in stress space. The idea of an activated process driven by the angoricity has been shown by Behringer et al (2008) to describe the logarithmic strengtheni…
The slow relaxation and aging of glassy systems can be modelled as a Markov process on a simplified rough energy landscape: energy minima where the system tends to get trapped are taken as nodes of a random network, and the dynamics are governed by the transition rates among these. In this work we consider the case of purely activated dynamics, where the transition rates only depend on the depth of the departing trap. The random connectivity and the disorder in the trap depths make it impossible to solve the model analytically, so we base our analysis on the spectrum of eigenvalues $λ$ of the …
Glass is a microscopically disordered, solid form of matter that results when a fluid is cooled or compressed in such a fashion that it does not crystallise. Almost all types of materials are capable of glass formation -- polymers, metal alloys, and molten salts, to name a few. Given such diversity, organising principles which systematise data concerning glass formation are invaluable. One such principle is the classification of glass formers according to their fragility\cite{fragility}. Fragility measures the rapidity with which a liquid's properties such as viscosity change as the glassy sta…
We numerically study the zero-temperature relaxation dynamics of several glass-forming models to their inherent structures, following quenches from equilibrium configurations sampled across a wide range of initial temperatures. In a mean-field Mari-Kurchan model, we find that relaxation changes from a power-law to an exponential decay below a well-defined temperature, consistent with recent findings in mean-field $p$-spin models. By contrast, for finite-dimensional systems, the relaxation is always algebraic, with a non-trivial universal exponent at high temperatures crossing over to a harmoni…
We investigate aging in glassy systems based on a simple model, where a point in configuration space performs thermally activated jumps between the minima of a random energy landscape. The model allows us to show explicitly a subaging behavior and multiple scaling regimes for the correlation function. Both the exponents characterizing the scaling of the different relaxation times with the waiting time and those characterizing the asymptotic decay of the scaling functions are obtained analytically by invoking a `partial equilibrium' concept.
We study the effect of an external field on (1+1) and (2+1) dimensional elastic manifolds, at zero temperature and with random bond disorder. Due to the glassy energy landscape the configuration of a manifold changes often in abrupt, ``first order'' -type of large jumps when the field is applied. First the scaling behavior of the energy gap between the global energy minimum and the next lowest minimum of the manifold is considered, by employing exact ground state calculations and an extreme statistics argument. The scaling has a logarithmic prefactor originating from the number of the minima i…
We discuss an analysis of Constraint Satisfaction problems, such as Sphere Packing, K-SAT and Graph Coloring, in terms of an effective energy landscape. Several intriguing geometrical properties of the solution space become in this light familiar in terms of the well-studied ones of rugged (glassy) energy landscapes. A `benchmark' algorithm naturally suggested by this construction finds solutions in polynomial time up to a point beyond the `clustering' and in some cases even the `thermodynamic' transitions. This point has a simple geometric meaning and can be in principle determined with stand…
The low-temperature quasi-universal behavior of amorphous solids has been attributed to the existence of spatially-localized tunneling defects found in the low-energy regions of the potential energy landscape. Computational models of glasses can be studied to elucidate the microscopic nature of these defects. Recent simulation work has demonstrated the means of generating stable glassy configurations for models that mimic metallic glasses using the swap Monte Carlo algorithm. Building on these studies, we present an extensive exploration of the glassy metabasins of the potential energy landsca…
We use record dynamics (RD), a coarse-grained description of the ubiquitous relaxation phenomenology known as "aging", as a diagnostic tool to find universal features that distinguish between the energy landscapes of Ising spin models and the ferromagnet. According to RD, a non-equilibrium system after a quench relies on fluctuations that randomly generate a sequence of irreversible record-sized events (quakes or avalanches) that allow the system to escape ever-higher barriers of meta-stable states within a complex, hierarchical energy landscape. Once these record events allow the system to ov…
A major challenge in the modeling of ionically conducting glasses is to understand how the large variety of possible chemical compositions and specific structural properties influence ionic transport quantities. Here we revisit and extend a theoretical approach for alkali borophosphate glasses, where changes of conductivity activation energies with the borate to phosphate mixing ratio are related to modifications of the ionic site energy landscape. The landscape modifications are caused by varying amounts of different units forming the glassy network, which lead to spatial redistributions of t…
Glasses are amorphous solids whose constituent particles are caged by their neighbors and thus cannot flow. This sluggishness is often ascribed to the free energy landscape containing multiple minima (basins) separated by high barriers. Here we show, using theory and numerical simulation, that the landscape is much rougher than is classically assumed. Deep in the glass, it undergoes a "roughness transition" to fractal basins. This brings about isostaticity at jamming and marginality of glassy states near jamming. Critical exponents for the basin width, the weak force distribution, and the spat…
Glassy behavior is one of the main open problems in condensed matter physics. In this thesis, we approach the problem by studying spin-glasses and colloids, using several complementary strategies. From the point of view of model building, we propose a new model, the hypercube model, which is mean-field but defined in a metric space. We show that, also in Mean Field, the spin-glass non-equilibrium dynamics is a domain-growth process very similar to its three-dimensional counterpart. We also consider spin-glasses in three spatial dimensions, focusing on temperature chaos. Thanks to the low-tempe…