Feedback particle filter (FPF) is a numerical algorithm to approximate the solution of the nonlinear filtering problem in continuous-time settings. In any numerical implementation of the FPF algorithm, the main challenge is to numerically approximate the so-called gain function. A numerical algorithm for gain function approximation is the subject of this paper. The exact gain function is the solution of a Poisson equation involving a probability-weighted Laplacian $Δ_ρ$. The numerical problem is to approximate this solution using {\em only} finitely many particles sampled from the probability distribution $ρ$. A diffusion map-based algorithm was proposed by the authors in a prior work to solve this problem. The algorithm is named as such because it involves, as an intermediate step, a diffusion map approximation of the exact semigroup $e^{Δ_ρ}$. The original contribution of this paper is to carry out a rigorous error analysis of the diffusion map-based algorithm. The error is shown to include two components: bias and variance. The bias results from the diffusion map approximation of the exact semigroup. The variance arises because of finite sample size. Scalings and upper bounds are derived for bias and variance. These bounds are then illustrated with numerical experiments that serve to emphasize the effects of problem dimension and sample size. The proposed algorithm is applied to two filtering examples and comparisons provided with the sequential importance resampling (SIR) particle filter.
Particle filters have, in recent years, been found to perform well in highly nonlinear problems as well as in estimation of parameters. However, there is still the problem of particle degeneracy in particle filters which has led to the invention of, among others, feedback particle filters. In this paper, we introduce a stochastically perturbed feedback particle filter and show that it is exact. The novelty is in the fact that the innovation process is stochastically perturbed. Resampled sinkhorn particle filter is also introduced. We then compare their performance with that of other filters in…
Feedback particle filter (FPF) is a Monte-Carlo (MC) algorithm to approximate the solution of a stochastic filtering problem. In contrast to conventional particle filters, the Bayesian update step in FPF is implemented via a mean-field type feedback control law. The objective for this paper is to situate the development of FPF and related controlled interacting particle system algorithms within the framework of optimal transportation theory. Starting from the simplest setting of the Bayes' update formula, a coupling viewpoint is introduced to construct particle filters. It is shown that the co…
Probabilistic Data Association-Feedback Particle Filter for Multiple Target Tracking Applications
Coordinated Science Laboratory and the Department of Mechanical Science and Engineering at the University of Illinois at Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校协同科学实验室与机械科学与工程系）
Feedback particle filters (FPFs) are Monte-Carlo approximations of the solution of the filtering problem in continuous time. The samples or particles evolve according to a feedback control law in order to track the posterior distribution. However, it is known that by itself, the requirement to track the posterior does not lead to a unique algorithm. Given a particle filter, another one can be constructed by applying a time-dependent transformation of the particles that keeps the posterior distribution invariant. Here, we characterize this gauge freedom within the class of FPFs for the linear-G…
We derive gain-tuning rules for the positive and negative spatial-feedback loops of a spatially-distributed filter to change the resolution of its spatial band-pass characteristic accordingly to a wavelet zoom, while preserving temporal stability. The filter design is inspired by the canonical spatial feedback structure of the primary visual cortex and is motivated by understanding attentional control of visual resolution. Besides biology, our control-theoretical design strategy is relevant for the development of neuromorphic multiresolution distributed sensors through the feedback interconnec…
In this paper, we relate the feedback capacity of parallel additive colored Gaussian noise (ACGN) channels to a variant of the Kalman filter. By doing so, we obtain lower bounds on the feedback capacity of such channels, as well as the corresponding feedback (recursive) coding schemes, which are essentially power allocation policies with feedback, to achieve the bounds. The results are seen to reduce to existing lower bounds in the case of a single ACGN feedback channel, whereas when it comes to parallel additive white Gaussian noise (AWGN) channels with feedback, the recursive coding scheme r…
This paper presents theory, application, and comparisons of the feedback particle filter (FPF) algorithm for the problem of attitude estimation. The paper builds upon our recent work on the exact FPF solution of the continuous-time nonlinear filtering problem on compact Lie groups. In this paper, the details of the FPF algorithm are presented for the problem of attitude estimation - a nonlinear filtering problem on SO(3). The quaternions are employed for computational purposes. The algorithm requires a numerical solution of the filter gain function, and two methods are applied for this purpose…
In this paper, we relate a feedback channel with any finite-order autoregressive moving-average (ARMA) Gaussian noises to a variant of the Kalman filter. In light of this, we obtain relatively explicit lower bounds on the feedback capacity for such colored Gaussian noises, and the bounds are seen to be consistent with various existing results in the literature. Meanwhile, this variant of the Kalman filter also leads to explicit recursive coding schemes with clear structures to achieve the lower bounds. In general, our results provide an alternative perspective while pointing to potentially tig…
This paper is concerned with the problem of continuous-time nonlinear filtering for stochastic processes on a connected matrix Lie group. The main contribution of this paper is to derive the feedback particle filter (FPF) algorithm for this problem. In its general form, the FPF is shown to provide a coordinate-free description of the filter that automatically satisfies the geometric constraints of the manifold. The particle dynamics are encapsulated in a Stratonovich stochastic differential equation that retains the feedback structure of the original (Euclidean) FPF. The implementation of the …
This paper proposes an efficient approach for tuning L1 feedback filter of adaptive controller for multi-input multi-output (MIMO) systems. The feedback filter provides performance that trades off fast closed loop dynamics, robustness margin, and control signal range. Thus appropriate tuning of the filter's parameters is crucial to achieve optimal performance. For MIMO systems, the parameters tuning is challenging and requires a multi-objective performance indices to avoid instability. This paper proposes a fuzzy-based L1 feedback filter design tuned with multi-objective particle swarm optimiz…
In this survey, we describe controlled interacting particle systems (CIPS) to approximate the solution of the optimal filtering and the optimal control problems. Part I of the survey is focussed on the feedback particle filter (FPF) algorithm, its derivation based on optimal transportation theory, and its relationship to the ensemble Kalman filter (EnKF) and the conventional sequential importance sampling-resampling (SIR) particle filters. The central numerical problem of FPF -- to approximate the solution of the Poisson equation -- is described together with the main solution approaches. An a…
In this paper, we consider stochastic master equations describing the evolutions of quantum systems interacting with electromagnetic fields undergoing continuous-time measurements. In particular, we study feedback control of quantum spin-1/2 systems in the case of unawareness of initial states and in presence of measurement imperfections. We prove that the fidelity between the actual quantum filter and its associated estimated filter converges to one under appropriate assumption on the feedback controller. This shows the asymptotic convergence of such filters. In addition, for spin-J systems, …
This paper is concerned with a duality-based approach to derive the linear feedback particle filter (FPF). The FPF is a controlled interacting particle system where the control law is designed to provide an exact solution for the nonlinear filtering problem. For the linear Gaussian special case, certain simplifications arise whereby the linear FPF is identical to the square-root form of the ensemble Kalman filter. For this and for the more general nonlinear non-Gaussian case, it has been an open problem to derive/interpret the FPF control law as a solution of an optimal control problem. In thi…
Parallel combinations of adaptive filters have been effectively used to improve the performance of adaptive algorithms and address well-known trade-offs, such as convergence rate vs. steady-state error. Nevertheless, typical combinations suffer from a convergence stagnation issue due to the fact that the component filters run independently. Solutions to this issue usually involve conditional transfers of coefficients between filters, which although effective, are hard to generalize to combinations with more filters or when there is no clearly faster adaptive filter. In this work, a more natura…
In this paper, we shall first derive the admissible control input of the multivariate feedback particle filter (FPF) by minimizing the f-divergence of the posterior conditional density function and the empirical conditional density of the controlled particles. On the contrast, in the original derivation \cite{YMM}, a special f-divergence, Kullback-Leibler (K-L) divergence, is used in the 1-dimensional nonlinear filtering problems. We show that the control input is invariant under the f-divergence class. That is, the control input satisfies exactly the same equations as those obtained by minimi…
This paper generalizes the results in [30] concerning feedback stabilization of target states for N-level quantum angular momentum systems undergoing quantum non-demolition measurements (QND) in absence of the knowledge about initial states and parameters. Here we consider multiple measurement operators and study the stabilization toward a chosen target subspace which is a common eigenspace of measurement operators. Under the QND conditions, we show that this analysis provides necessary tools to ensure feedback stabilization based on a simplified filter whose state is a N-dimensional vector. A…
The purpose of this paper is to describe the feedback particle filter algorithm for problems where there are a large number ($M$) of non-interacting agents (targets) with a large number ($M$) of non-agent specific observations (measurements) that originate from these agents. In its basic form, the problem is characterized by data association uncertainty whereby the association between the observations and agents must be deduced in addition to the agent state. In this paper, the large-$M$ limit is interpreted as a problem of collective inference. This viewpoint is used to derive the equation fo…
We propose a new matrix pencil based approach for design of state-feedback and output-feedback stabilizing controllers for a general class of uncertain nonlinear strict-feedback-like systems. While the dynamic controller structure is based on the dual dynamic high-gain scaling based approach, we cast the design procedure within a general matrix pencil structure unlike prior results that utilized conservative algebraic bounds of terms arising in Lyapunov inequalities. The design freedoms in the dynamic controller are extracted in terms of generalized eigenvalues associated with matrix pencils f…
We consider the problem of steering, via output feedback, the state distribution of a discrete-time, linear stochastic system from an initial Gaussian distribution to a terminal Gaussian distribution with prescribed mean and maximum covariance, subject to probabilistic path constraints on the state. The filtered state is obtained via a Kalman filter, and the problem is formulated as a deterministic convex program in terms of the distribution of the filtered state. We observe that, in the presence of constraints on the state covariance, and in contrast to classical Linear Quadratic Gaussian (LQ…
A learning approach for optimal feedback gains for nonlinear continuous time control systems is proposed and analysed. The goal is to establish a rigorous framework for computing approximating optimal feedback gains using neural networks. The approach rests on two main ingredients. First, an optimal control formulation involving an ensemble of trajectories with 'control' variables given by the feedback gain functions. Second, an approximation to the feedback functions via realizations of neural networks. Based on universal approximation properties we prove the existence and convergence of opti…
This paper proposes an integrated design optimization framework for the gain schedules and bending filter for the longitudinal control of a rocket during its ascent flight. Dynamic models representing the pitch/yaw motion of a rocket considering the elements such as the rigid body dynamics, aerodynamics, sloshing, bending, sensor/actuator, and flight computer are introduced. The linear proportional and differential (PD) control law with scheduled (time-varying) gains and bending filter parameters are identified as key decision variables for stabilizing the pitch/yaw motion of the rocket. The i…
In the present work a new controller called Particle Swarm Optimization based state feedback gain controller has been proposed for frequency regulation of a two area system and then its performance is compared with earlier designed controllers such as Linear Quadratic Regulator Proportional Integral controller and Integral controller. The performance comparison has been done for the power system network comprising of two thermal power plants which are tie line connected. For using the optimal control based method such as LQR PI controller and computationally intelligent method such as PSO base…
We combine conditional state density construction with an extension of the Scenario Approach for stochastic Model Predictive Control to nonlinear systems to yield a novel particle-based formulation of stochastic nonlinear output-feedback Model Predictive Control. Conditional densities given noisy measurement data are propagated via the Particle Filter as an approximate implementation of the Bayesian Filter. This enables a particle-based representation of the conditional state density, or information state, which naturally merges with scenario generation from the current system state. This appr…
This paper considers linear discrete-time systems with additive disturbances, and designs a Model Predictive Control (MPC) law incorporating a dynamic feedback gain to minimise a quadratic cost function subject to a single chance constraint. The feedback gain is selected online and we provide two selection methods based on minimising upper bounds on predicted costs. The chance constraint is defined as a discounted sum of violation probabilities on an infinite horizon. By penalising violation probabilities close to the initial time and assigning violation probabilities in the far future with va…
Infinite-dimensional linear systems with unbounded input and output operators are considered. For the purpose of finite-dimensional observer-based state feedback, an observer approximation scheme will be developed which can be directly combined with existing late-lumping controllers and observer output injection gains. It relies on a decomposition of the feedback gain, resp. observer output injection gain, into a bounded and an unbounded part. Based on a perturbation result, the spectrum-determined growth condition is established, for the closed loop.
In this paper, we study the irregular output feedback linear quadratic (LQ) control problem, which is a continuous work of previous works for irregular LQ control [33] where the state is assumed to be exactly known priori. Different from the classic output feedback LQ control problem, the cost function must be modified to guarantee the solvability. In the framework of the modified cost function, it is shown that the separation principle holds and the explicitly optimal controller is given in the feedback form of the Kalman filtering. In particular, the feedback gain is calculated by two Riccat…
This paper analyzes output feedback control of a class of unknown nonlinear systems in the presence of measurement noise using multiple high-gain observers (MHGO). It is well-known that single high-gain observers (HGO) are not able to provide satisfactory performance when the system output is contaminated by noise. More specifically, there is a trade-off between the convergence speed of state estimation and the bound of steady estimation error in HGO when the output measurement is contaminated by noise. In the presented scheme, the output feedback controller utilizes the state estimation obtai…
In this paper we demonstrate how certain structured feedback gains necessarily emerge as the optimal controller gains in two linear optimal control formulations for multi-agent systems. We consider the cases of linear optimal synchronization and linear optimal centroid stabilization. In the former problem, the considered cost functional integrates squared synchronization error and input, and in the latter, the considered cost functional integrates squared sum of the states and input. Our approach is to view the structures in the feedback gains in terms of a static output feedback with suitable…
The minimum-gain eigenvalue assignment/pole placement problem (MGEAP) is a classical problem in LTI systems with static state feedback. In this paper, we study the MGEAP when the state feedback has arbitrary sparsity constraints. We formulate the sparse MGEAP problem as an equality-constrained optimization problem and present an analytical characterization of its locally optimal solution in terms of eigenvector matrices of the closed loop system. This result is used to provide a geometric interpretation of the solution of the non-sparse MGEAP, thereby providing additional insights for this cla…
