We provide a rigorous derivation of the Ensemble Kalman-Bucy Filter as well as the Ensemble Transform Kalman-Bucy Filter in case of nonlinear, unbounded model and observation operators. We identify them as the continuous time limit of the discrete-time Ensemble Kalman Filter and the Ensemble Square Root Filters, respectively, together with concrete convergence rates in terms of the discretization step size. Simultaneously, we establish well-posedness as well as accuracy of both the continuous-time and the discrete-time filtering algorithms.
We extend the Kalman-Bucy filter to the case where both the system and observation processes are driven by finite dimensional Lévy processes, but whereas the process driving the system dynamics is square-integrable, that driving the observations is not; however it remains integrable. The key technique used is approximation by processes having bounded jumps.
We analyse various perturbations and projections of Kalman-Bucy semigroups and Riccati equations. For example, covariance inflation-type perturbations and localisation methods (projections) are common in the ensemble Kalman filtering literature. In the limit of these ensemble methods, the regularised sample covariance tends toward a solution of a perturbed/projected Riccati equation. With this motivation, results are given characterising the error between the nominal and regularised Riccati flows and Kalman-Bucy filtering distributions. New projection-type models are also discussed; e.g. Bose-…
In standard treatments of stochastic filtering one first has to estimate the values of the parameters of the model. Simply running the filter without considering the reliability of this estimate does not take into account this additional source of statistical uncertainty. We propose an approach to address this problem when working with the continuous-time Kalman-Bucy filter. We show how our approach may be reformulated as an optimal control problem, and proceed to analyse the corresponding value function in some detail. In particular we present a novel uniqueness result for the associated Hami…
This article is concerned with the exponential stability and the uniform propagation of chaos properties of a class of Extended Ensemble Kalman-Bucy filters with respect to the time horizon. This class of nonlinear filters can be interpreted as the conditional expectations of nonlinear McKean Vlasov type diffusions with respect to the observation process. In contrast with more conventional Langevin nonlinear drift type processes, the mean field interaction is encapsulated in the covariance matrix of the diffusion. The main results discussed in the article are quantitative estimates of the expo…
The exponential stability and the concentration properties of a class of extended Kalman-Bucy filters are analyzed. New estimation concentration inequalities around partially observed signals are derived in terms of the stability properties of the filters. These non asymptotic exponential inequalities allow to design confidence interval type estimates in terms of the filter forgetting properties with respect to erroneous initial conditions. For uniformly stable signals, we also provide explicit non-asymptotic estimates for the exponential forgetting rate of the filters and the associated stoch…
We consider divergence form uniformly parabolic SPDEs with VMO bounded leading coefficients, bounded coefficients in the stochastic part, and possibly growing lower-order coefficients in the deterministic part. We look for solutions which are summable to the $p$th power, $p\geq2$, with respect to the usual Lebesgue measure along with their first-order derivatives with respect to the spatial variable. Our methods allow us to include Zakai's equation for the Kalman-Bucy filter into the general filtering theory.
The Kalman-Bucy filter is the optimal state estimator for an Ornstein-Uhlenbeck diffusion given that the system is partially observed via a linear diffusion-type (noisy) sensor. Under Gaussian assumptions, it provides a finite-dimensional exact implementation of the optimal Bayes filter. It is generally the only such finite-dimensional exact instance of the Bayes filter for continuous state-space models. Consequently, this filter has been studied extensively in the literature since the seminal 1961 paper of Kalman and Bucy. The purpose of this work is to review, re-prove and refine existing re…
In this paper, we study a generalized Kalman-Bucy filtering problem under uncertainty. The drift uncertainty for both signal process and observation process is considered and the attitude to uncertainty is characterized by a convex operator (convex risk measure). The optimal filter or the minimum mean square estimator (MMSE) is calculated by solving the minimum mean square estimation problem under a convex operator. In the first part of this paper, this estimation problem is studied under g-expectation which is a special convex operator. For this case, we prove that there exists a worst-case p…
The Ensemble Kalman filter is a sophisticated and powerful data assimilation method for filtering high dimensional problems arising in fluid mechanics and geophysical sciences. This Monte Carlo method can be interpreted as a mean-field McKean-Vlasov type particle interpretation of the Kalman-Bucy diffusions. In contrast to more conventional particle filters and nonlinear Markov processes these models are designed in terms of a diffusion process with a diffusion matrix that depends on particle covariance matrices. Besides some recent advances on the stability of nonlinear Langevin type diffusio…
We provide a continuous time limit analysis for the class of Ensemble Square Root Filter algorithms with deterministic model perturbations. In the particular linear case, we specify general conditions on the model perturbations implying convergence of the empirical mean and covariance matrix towards their respective counterparts of the Kalman-Bucy Filter. As a second main result we identify additional assumptions for the convergence of the whole ensemble towards solutions of the Ensemble Kalman-Bucy filtering equations introduced in [1]. The latter result can be generalized to nonlinear Lipsch…
This paper revisits the question of duality between minimum variance estimation and optimal control first described for the linear Gaussian case in the celebrated paper of Kalman and Bucy. A duality result is established for nonlinear filtering, mirroring closely the original Kalman-Bucy duality of control and estimation for linear systems. The result for the finite state-space continuous time Markov chain is presented. It's solution is used to derive the classical Wonham filter.
We present recent results on the existence of a continuous time limit for Ensemble Kalman Filter algorithms. In the setting of continuous signal and observation processes, we apply the original Ensemble Kalman Filter algorithm proposed by [1] as well as a recent variant [2] to the respective discretizations and show that in the limit of decreasing stepsize the filter equations converge to an ensemble of interacting (stochastic) differential equations in the ensemble-mean-square sense. Our analysis also allows for the derivation of convergence rates with respect to the stepsize. An application …
Despite the widespread usage of discrete generation Ensemble Kalman particle filtering methodology to solve nonlinear and high dimensional filtering and inverse problems, little is known about their mathematical foundations. As genetic-type particle filters (a.k.a. sequential Monte Carlo), this ensemble-type methodology can also be interpreted as mean-field particle approximations of the Kalman-Bucy filtering equation. In contrast with conventional mean-field type interacting particle methods equipped with a globally Lipschitz interacting drift-type function, Ensemble Kalman filters depend on …
