We introduce a class of unconditionally energy stable, high order accurate schemes for gradient flows in a very general setting. The new schemes are a high order analogue of the minimizing movements approach for generating a time discrete approximation to a gradient flow by solving a sequence of optimization problems. In particular, each step entails minimizing the associated energy of the gradient flow plus a movement limiter term that is, in the classical context of steepest descent with respect to an inner product, simply quadratic. A variety of existing unconditionally stable numerical methods can be recognized as (typically just first order accurate in time) minimizing movement schemes for their associated evolution equations, already requiring the optimization of the energy plus a quadratic term at every time step. Therefore, our approach gives a painless way to extend these to high order accurate in time schemes while maintaining their unconditional stability. In this sense, it can be viewed as a variational analogue of Richardson extrapolation.
Numerically solving ordinary differential equations (ODEs) is a naturally serial process and as a result the vast majority of ODE solver software are serial. In this manuscript we developed a set of parallelized ODE solvers using extrapolation methods which exploit "parallelism within the method" so that arbitrary user ODEs can be parallelized. We describe the specific choices made in the implementation of the explicit and implicit extrapolation methods which allow for generating low overhead static schedules to then exploit with optimized multi-threaded implementations. We demonstrate that wh…
Extrapolation-based implicit-explicit general linear methods
Università degli studi di Salerno（萨莱诺大学）；Arizona State University（亚利桑那州立大学）；AGH University of Science and Technology（AGH科技大学）；Virginia Polytechnic Institute & State University（弗吉尼亚理工大学）
This study concerns numerical methods for efficiently solving the Richards equation where different weak formulations and computational techniques are analyzed. The spatial discretizations are based on standard or mixed finite element methods. Different implicit and semi-implicit temporal discretization techniques of second-order accuracy are studied. To obtain a linear system for the semi-implicit schemes, we propose second-order techniques using extrapolation formulas and/or semi-implicit Taylor approximations for the temporal discretization of nonlinear terms. A numerical convergence study …
The optimization problems associated with training generative adversarial neural networks can be largely reduced to certain {\em non-monotone} variational inequality problems (VIPs), whereas existing convergence results are mostly based on monotone or strongly monotone assumptions. In this paper, we propose {\em optimistic dual extrapolation (OptDE)}, a method that only performs {\em one} gradient evaluation per iteration. We show that OptDE is provably convergent to {\em a strong solution} under different coherent non-monotone assumptions. In particular, when a {\em weak solution} exists, the…
We design a variational asymptotic preserving scheme for the Vlasov-Poisson-Fokker-Planck system with the high field scaling, which describes the Brownian motion of a large system of particles in a surrounding bath. Our scheme builds on an implicit-explicit framework, wherein the stiff terms coming from the collision and field effects are solved implicitly while the convection terms are solved explicitly. To treat the implicit part, we propose a variational approach by viewing it as a Wasserstein gradient flow of the relative entropy, and solve it via a proximal quasi-Newton method. In so doin…
The existing discrete variational derivative method is only second-order accurate and fully implicit. In this paper, we propose a framework to construct an arbitrary high-order implicit (original) energy stable scheme and a second-order semi-implicit (modified) energy stable scheme. Combined with the Runge--Kutta process, we can build an arbitrary high-order and unconditionally (original) energy stable scheme based on the discrete variational derivative method. The new energy stable scheme is implicit and leads to a large sparse nonlinear algebraic system at each time step, which can be effici…
Isospectral flows appear in a variety of applications, e.g. the Toda lattice in solid state physics or in discrete models for two-dimensional hydrodynamics, with the isospectral property often corresponding to mathematically or physically important conservation laws. Their most prominent feature, i.e. the conservation of the eigenvalues of the matrix state variable, should therefore be retained when discretizing these systems. Recently, it was shown how isospectral Runge-Kutta methods can, in the Lie-Poisson case also considered in our work, be obtained through Hamiltonian reduction of symplec…
INI-VPINN: A Variational Physics-Informed Neural Network with Implicit Neumann and Interface Handling for Multi-Material Domains with Geometric Singularities
Stochastic evolution equations with compensated Poisson noise are considered in the variational approach with monotone and coercive coefficients. Here the Poisson noise is assumed to be time-homogeneous with $σ$-finite intensity measure on a metric space. By using finite element methods and Galerkin approximations, some explicit and implicit discretizations for this equation are presented and their convergence is proved. Polynomial growth condition and linear growth condition are assumed on the drift operator, respectively for the implicit and explicit schemes.
A New Phase-Field Approach to Variational Implicit Solvation of Charged Molecules with the Coulomb-Field Approximation
the George Washington University（乔治华盛顿大学）；Loyola Marymount University（洛约拉玛丽蒙特大学）；California State University, Long Beach（加州州立大学长滩分校）；University of California, San Diego（加利福尼亚大学圣地亚哥分校）；Columbia University（哥伦比亚大学）
