This paper studies optimal control and stabilization problems for continuous-time mean-field systems with input delay, which are the fundamental development of control and stabilization problems for mean-field systems. There are two main contributions: 1) To the best of our knowledge, the present paper is first to establish the necessary and sufficient solvability condition for this kind of optimal control problem with delay, and to derive an optimal controller through overcoming the obstacle that separation principle no longer holds for multiplicative-noise systems; 2) For the stabilization problem, under the assumption of exact observability, we strictly prove thatthe system is stabilizable if and only if the algebraic Riccati equation has a unique positive definite solution.
In the past three years, many researchers have proven and/or employed some Wirtinger-type integral inequalities to establish less conservative stability criteria for delayed continu\-ous-time systems. In this present paper, we will investigate weighted orthogonal polynomials-based integral inequalities which is a generalization of the existing Jensen's inequalities and Wirtinger-type integral inequalities.
As a main step in the numerical solution of control problems in continuous time, the controlled process is approximated by sequences of controlled Markov chains, thus discretising time and space. A new feature in this context is to allow for delay in the dynamics. The existence of an optimal strategy with respect to the cost functional can be guaranteed in the class of relaxed controls. Weak convergence of the approximating extended Markov chains to the original process together with convergence of the associated optimal strategies is established.
This paper studies input-to-state stability (ISS) of general nonlinear time-delay systems subject to delay-dependent impulse effects. Sufficient conditions for ISS are constructed by using the method of Lyapunov functionals. It is shown that, when the continuous dynamics are ISS but the discrete dynamics governing the delay-dependent impulses are not, the impulsive system as a whole is ISS provided the destabilizing impulses do not occur too frequently. On the contrary, when the discrete dynamics are ISS but the continuous dynamics are not, the delayed impulses must occur frequently enough to …
We consider the situation in which a continuous-time vector Gauss-Markov process is observed through a vector Gaussian channel (sensor) and estimated by the Kalman-Bucy filter. Unlike in standard filtering problems where a sensor model is given a priori, we are concerned with the optimal sensor design by which (i) the mutual information between the source random process and the reproduction (estimation) process is minimized, and (ii) the minimum mean-square estimation error meets a given distortion constraint. We show that such a sensor design problem is tractable by semidefinite programming. …
In this paper, we study the cooperative output regulation problem for the discrete linear time-delay multi-agent systems by distributed observer approach. In contrast with the same problem for continuous-time linear time-delay multi-agent systems, the problem has two new features. First, in the presence of time-delay, the regulator equations for discrete-time linear systems are different from those for continuous-time linear systems. Second, under the standard assumption on the connectivity of the communication graph, a distributed observer for any continuous-time linear leader system always e…
We establish Pontryagin principles for a Mayer's optimal control problem governed by a functional differential equation. The control functions are piecewise continuous and the state functions are piecewise continuously differentiable. To do that, we follow the method created by Philippe Michel for systems governed by ordinary differential equations, and we use properties of the resolvent of a linear functional differential equation.
This paper is concerned with the decoupling of delayed linear forward-backward stochastic differential equations (D-FBSDEs), which is much more involved than the delay-free case due to the infinite dimension caused by the delay. A new approach of `discretization' is proposed to obtain the explicit solution to the D-FBSDEs. Firstly, we transform the continuous-time D-FBSDEs into the discrete-time form by using discretization. Secondly, we derive the solution of the discrete-time D-FBSDEs by applying backward iterative induction. Finally the explicit solution of the continuous-time D-FBSDEs is o…
Multi-agent systems cooperation to achieve global goals is usually limited by sensing, actuation, and communication issues. At the local level, continuous measurement and actuation is only approximated by the use of digital mechanisms that measure and process information in order to compute and update new control input values at discrete time instants. Interaction with other agents or subsystems takes place, in general, through a digital communication channel with limited bandwidth where transmission of continuous-time signals is not possible. Additionally, communication channels may be subjec…
We consider state-feedback predictor-based control of networked control systems with large time-varying communication delays. We show that even a small controller-to-actuators delay uncertainty may lead to a non-small residual error in a networked control system and reveal how to analyze such systems. Then we design an event-triggered predictor-based controller with sampled measurements and demonstrate that, depending on the delay uncertainty, one should choose various predictor models to reduce the error due to triggering. For the systems with a network only from a controller to actuators, we…
Sampling arises simultaneously with input and output delays in networked control systems. When the delay is left uncompensated, the sampling period is generally required to be sufficiently small, the delay sufficiently short, and, for nonlinear systems, only semiglobal practical stability is generally achieved. For example, global stabilization of strict-feedforward systems under sampled measurements, sampled-data stabilization of the nonholonomic unicycle with arbitrarily sparse sampling, and sampled-data stabilization of LTI systems over networks with long delays, are open problems. In this …
Lagrangian Relaxation for Continuous-Time Optimal Control of Coupled Hydrothermal Power Systems Including Storage Capacity and a Cascade of Hydropower Systems with Time Delays
We study the stability properties of linear time-varying systems in continuous time whose system matrix is Metzler with zero row sums. This class of systems arises naturally in the context of distributed decision problems, coordination and rendezvous tasks and synchronization problems. The equilibrium set contains all states with identical state components. We present sufficient conditions guaranteeing uniform exponential stability of this equilibrium set, implying that all state components converge to a common value as time grows unbounded. Furthermore it is shown that this convergence result…
The paper considers the optimal control problem of inventory of a discrete product in regeneration scheme with a Poisson flow of customer requirements. In the system deferred demand is allowed, the volume of which is limited by a given value. The control parameter is the level of the stock, at which achievement it is necessary to make an order for replenishment. The indicator of management effectiveness is the average specific profit received in one regeneration period. The optimal control problem is solved on the basis of the statement about the extremum of a fractional-linear integral functi…
This article deals with variational optimal-control problems on time scales in the presence of delay in the state variables. The problem is considered on a time scale unifying the discrete, the continuous and the quantum cases. Two examples in the discrete and quantum cases are analyzed to illustrate our results.
We consider the problem of constructing Lyapunov functions for linear differential equations with delays. For such systems it is known that exponential stability implies the existence of a positive Lyapunov function which is quadratic on the space of continuous functions. We give an explicit parametrization of a sequence of finite-dimensional subsets of the cone of positive Lyapunov functions using positive semidefinite matrices. This allows stability analysis of linear time-delay systems to be formulated as a semidefinite program.
Stability of retarded differential equations is closely related to the existence of Lyapunov-Krasovskii functionals. Even if a number of converse results have been reported regarding the existence of such functionals, there is a lack of constructive methods for their selection. For certain classes of time-delay systems for which such constructive methods are lacking, it was shown that Lyapunov-Krasovskii functionals that are also allowed to depend on the time-derivative of the state-trajectory are efficient tools for the study of the stability properties. However, in such an approach the initi…
The paper deals with a Bolza optimal control problem for a dynamical system which motion is described by a delay differential equation under an initial condition defined by a piecewise continuous function. For the value functional in this problem, the Cauchy problem for the Hamilton-Jacobi-Bellman equation with coinvariant derivatives is considered. Minimax and viscosity solutions of this problem are studied. It is proved that both of these solutions exist, are unique and coincide with the value functional.
This paper considers the general problem of transitioning theoretically safe controllers to hardware. Concretely, we explore the application of control barrier functions (CBFs) to sampled-data systems: systems that evolve continuously but whose control actions are computed in discrete time-steps. While this model formulation is less commonly used than its continuous counterpart, it more accurately models the reality of most control systems in practice, making the safety guarantees more impactful. In this context, we prove robust set invariance with respect to zero-order hold controllers as wel…
A non-autonomous evolution semi-linear differential system under non-instantaneous impulses, delays, and perturbed by non-local conditions is studied. Its piece-wise continuous solutions belong to a finite-dimensional Banach space. The existence and uniqueness of solutions on the interval $[-r,τ]$ are obtained by applying Karakostas fixed-point theorem. Further results concerning solution prolongation are developed. An example is presented, and several remarks on the infinite-dimensional case are included.
