In this paper we study a linear pursuit differential game described by an infinite system of first-order differential equations in Hilbert space. The control functions of players are subject to geometric constraints. The pursuer attempts to bring the system from a given initial state to the origin for a finite time and the evader's purpose is opposite. We obtain a guaranteed pursuit time and construct a strategy for pursuer.
We consider a pursuit-evasion differential game with a Hybrid system of dynamics in Hilbert space with integral constraints on the control functions of players. We show that the pursuer has a winning strategy.
We study a pursuit-evasion differential game with finite number of pursuers and one evader in Hilbert space with geometric constraints on the control functions of players. We solve the game by presenting explicit strategies for pursuers which guarantee their pursuit as well as an strategy for the evader which guarantees its evasion.
The extension of a conflict control problem with infinite horizon is constructed. This extension is the projective limit of restricted games. Relations between "sensitivity to target set" and the existence of the optimal control are studied. Special attention is paid to the pursuit-evasion game with "joint control/relaxed control".
Pursuit and evasion conflicts represent challenging problems with important applications in aerospace and robotics. In pursuit-evasion problems, synthesis of intelligent actions must consider the adversary's potential strategies. Differential game theory provides an adequate framework to analyze possible outcomes of the conflict without assuming particular behaviors by the opponent. This article presents an organized introduction of pursuit-evasion differential games with an overview of recent advances in the area. First, a summary of the seminal work is outlined, highlighting important contri…
A qualitative account is given of a differential pursuit/evasion game. A criterion for the existence of an intercept solution is obtained using future cones that contain all attainable trajectories of target or interceptor originating from an initial position. A sufficient and necessary conditon that an opportunity to intercept always exist is that, after some initial time, the future cone of the target be contained within the future cone of the interceptor. The sufficient condition may be regarded as a kind of Nash equillibrium.
A geometric approach to differential game theory is illustrated. The parallel pursuit is considered as a two-player zero-sum differential game. The optimal strategies of each player is designed based on Riemann-Finsler geometry. Our approach incorporates a closed loop optimal control and the presentation is familiar with a Brachistochrone type problem.
In this paper we investigate a differential game in which countably many dynamical objects pursue a single one. All the players perform simple motions. The duration of the game is fixed. The controls of a group of pursuers are subject to geometric constraints and the controls of the other pursuers and the evader are subject to integral constraints. The payoff of the game is the distance between the evader and the closest pursuer when the game is terminated. We construct optimal strategies for players and find the value of the game.
Here we present a decomposition technique for a class of differential games. The technique consists in a decomposition of the target set which produces, for geometrical reasons, a decomposition in the dimensionality of the problem. Using some elements of Hamilton-Jacobi equations theory, we find a relation between the regularity of the solution and the possibility to decompose the problem. We use this technique to solve a pursuit evasion game with multiple agents.
A Numerical Analysis for Pursuit-Evasion Games under the Stackelberg Eqilibrium
Air Systems Research Center, Technical Research and Development Institute, Ministry of Defense, Japan（日本防卫省技术研究开发本部航空系统研究中心）；Acquisition, Technology and Logistics Agency, Ministry of Defense, Japan（日本防卫省装备取得技术统括本部）
This paper investigates obstacle-free simple motion pursuit-evasion problems where the pursuer is faster and game termination is point capture. It is well known that the interior of the Apollonius Circle (AC) is the evader's dominance region, however, it was unclear whether the evader could reach outside the initial AC without being captured. We construct a pursuit strategy that guarantees the capture of an evader within an arbitrarily close neighborhood of the initial AC. The pursuer strategy is derived by reformulating the game into a nonlinear control problem, and the guarantee holds agains…
New strategies for some pursuit-evasion differential games with Gronwall-type constraints
Federal University Gashua（加舒阿联邦大学）；Kwantlen Polytechnics University（昆特兰理工大学）；Federal University of Health Sciences, Azare（阿扎雷联邦健康科学大学）；Bayero University Kano（卡诺拜罗科大学）
In this paper, we address a pursuit-evasion game involving multiple players by utilizing tools and techniques from reinforcement learning and matrix game theory. In particular, we consider the problem of steering an evader to a goal destination while avoiding capture by multiple pursuers, which is a high-dimensional and computationally intractable problem in general. In our proposed approach, we first formulate the multi-agent pursuit-evasion game as a sequence of discrete matrix games. Next, in order to simplify the solution process, we transform the high-dimensional state space into a low-di…
In a pursuit-evasion game, a team of pursuers attempt to capture an evader. The players alternate turns, move with equal speed, and have full information about the state of the game. We consider the most restictive capture condition: a pursuer must become colocated with the evader to win the game. We prove two general results about pursuit-evasion games in topological spaces. First, we show that one pursuer has a winning strategy in any CAT(0) space under this restrictive capture criterion. This complements a result of Alexander, Bishop and Ghrist, who provide a winning strategy for a game wit…
A qualitative criterion for a pursuer to intercept a target in a class of differential games is obtained in terms of \emph{future cones}: Topological cones that contain all attainable trajectories of target or interceptor originating from an initial position. An interception solution exists after some initial time iff the future cone of the target lies within the future cone of the interceptor. The solution may be regarded as a kind of Nash equillibrium. This result is applied to two examples: 1. The game of Two Cars: The future cone condition is shown to be equivalent to conditions for interc…
Two-player pursuit-evasion differential game and time optimal zero control problem in $\ell^2$ are considered. Optimal control for the corresponding zero control problem is found. A strategy for the pursuer that guarantees the solution for the pursuit problem is constructed.
This paper studies a two-person linear-quadratic-Gaussian pursuit-evasion differential game with costly but controlled information. One player can decide when to observe the other player's state. However, one observation of another player's state comes with two costs: the direct cost of observing and the implicit cost of exposing his state. We call games of this type a Pursuit-Evasion-Exposure-Concealment (PEEC) game. The PEEC game constitutes two types of strategies: The control strategies and the observation strategies. We fully characterize the Nash control strategies of the PEEC game using…
This paper studies a planar multiplayer Homicidal Chauffeur reach-avoid differential game, where each pursuer is a Dubins car and each evader has simple motion. The pursuers aim to protect a goal region cooperatively from the evaders. Due to the high-dimensional strategy space among pursuers, we decompose the whole game into multiple one-pursuer-one-evader subgames, each of which is solved in an analytical approach instead of solving Hamilton-Jacobi-Isaacs equations. For each subgame, an evasion region (ER) is introduced, based on which a pursuit strategy guaranteeing the winning of a simple-m…
We study computability-theoretic aspects of differential games. Our focus is on pursuit and evasion games played in Euclidean spaces in the tradition of Rado's "Lion versus Man" game. In some ways, these games can be viewed as continuous versions of reachability games. We prove basic undecidability of differential games, and study natural classes of pursuit-evasion games in Euclidean spaces where the winners can win via computable strategies. The winning strategy for Man found by Besicovitch for the traditional "Lion versus Man" is not computable. We show how to modify it to yield a computable…
We study a simple motion differential game of many pursuers and one evader in the plane. We give a nonempty closed convex set in the plane, and the pursuers and evader move on this set. They cannot leave this set during the game. Control functions of players are subject to coordinate-wise integral constraints. If the state of the evader $y$, coincides with that of a pursuer $x_i$, $i=\{1,...,m\}$, at some time $t_i$ (unspecified), i.e. $x_i(t_i)=y(t_i)$, then we say that pursuit is completed. We obtain some conditions under which pursuit can be completed from any position of the players in the…
The pursuit-evasion game with two persons is considered. Both players are moving in a metric space, have equal maximum speeds and complete information about the location of each other. We study the sufficient conditions for a capture (with a positive capture radius). We assume that Lion wins if he manages the capture independently of the initial positions of the players and the evader's strategy. We prove that the discrete-time simple pursuit strategy is a Lion's winning strategy in a compact geodesic space satisfying the betweenness property. In particular, it means that Lion wins in compact …
We formulate and analyze game-theoretic problems for systems governed by integral equations. For Volterra integral equations, we obtain and prove necessary and sufficient conditions for linear-quadratic problems, and for problems that are linear-quadratic in the control. Also, we obtain necessary conditions for one type of pursuit-evasion Volterra games.
This paper studies a 3D multiplayer reach-avoid differential game with a goal region and a play region. Multiple pursuers defend the goal region by consecutively capturing multiple evaders in the play region. The players have heterogeneous moving speeds and the pursuers have heterogeneous capture radii. Since this game is hard to analyze directly, we decompose the whole game as many subgames which involve multiple pursuers and only one evader. Then, these subgames are used as a building block for the pursuer-evader matching. First, for multiple pursuers and one evader, we introduce an evasion …
In this paper, we investigate a pursuit-evasion game in which a mobile observer tries to track a target in an environment containing obstacles. We formulate the game as an optimal control problem with state inequality constraint in a simple environment. We show that for some initial conditions, there are two different regimes in the optimal strategy of the pursuer depending on whether the state-constraint is activated. We derive the equations that characterize the switching time between the two regimes. The pursuer's optimal tracking strategy in a simple environment is further extended to a ge…
This paper provides a decomposition technique for the purpose of simplifying the solution of certain zero-sum differential games. The games considered terminate when the state reaches a target, which can be expressed as the union of a collection of target subsets; the decomposition consists of replacing the original target by each of the target subsets. The value of the original game is then obtained as the lower envelope of the values of the collection of games resulting from the decomposition, which can be much easier to solve than the original game. Criteria are given for the validity of th…
Motivated by the self-pursuit of controlled objects, we consider the exact controllability of a linear mean-field type game-based control system (MF-GBCS, for short) generated by a linear-quadratic (LQ, for short) Nash game. A Gram-type criterion for the general timevarying coefficients case and a Kalman-type criterion for the special time-invariant coefficients case are obtained. At the same time, the equivalence between the exact controllability of this MF-GBCS and the exact observability of a dual system is established. Moreover, an admissible control that can steer the state from any initi…
This paper considers the blocking or football pursuit-evasion differential game. Two pursuers cooperate and try to capture the ball carrying evader as far as possible from the goal line. The evader wishes to be as close as possible to the goal line at the time of capture and, if possible, reach the line. In this paper the solution of the game of kind is provided: The Barrier surface that partitions the state space into two winning sets, one for the pursuer team and one for the evader, is constructed. Under optimal play, the winning team is determined by evaluating the associated Barrier functi…
The aim of structured optimization is to assemble a solution, using a given set of (possibly uncountably infinite) atoms, to fit a model to data. A two-stage algorithm based on gauge duality and bundle method is proposed. The first stage discovers the optimal atomic support for the primal problem by solving a sequence of approximations of the dual problem using a bundle-type method. The second stage recovers the approximate primal solution using the atoms discovered in the first stage. The overall approach leads to implementable and efficient algorithms for large problems.
A defender-attacker-target problem with non-moving target is considered. This problem is modeled by a pursuit-evasion zero-sum differential game with linear dynamics and quadratic cost functional. In this game the pursuer is the defender, while the evader is the attacker. The objective of the pursuer is to minimize the cost functional, while the evader has two objectives: to maximize the cost functional and to keep a given terminal state inequality constraint. The open-loop saddle point solution of this game is obtained in the case where the transfer functions of the controllers for the defend…
The value of cooperation in pursuit-evasion games is investigated. The considered setting is that of three pursuers chasing one evader in a planar environment. The optimal evader trajectory for a well-known decentralized pursuer strategy is characterized. This result is instrumental to derive upper and lower bounds to the game length, in the case in which the pursuers cooperate in the chasing strategy. It is shown that the cooperation cannot reduce the capture time by more than one half with respect to the decentralized case, and that such bound is tight.
We study a zero-sum stochastic differential switching game in infinite horizon. We prove the existence of the value of the game and characterize it as the unique viscosity solution of the associated system of quasi-variational inequalities with bilateral obstacles. We also obtain a verification theorem which provides an optimal strategy of the game. Finally, some numerical examples with two regimes are given.
A two-person zero-sum infinite dimensional differential game of infinite duration with discounted payoff involving hybrid controls is studied. The minimizing player is allowed to take continuous, switching and impulse controls whereas the maximizing player is allowed to take continuous and switching controls. By taking strategies in the sense of Elliott--Kalton, we prove the existence of value and characterize it as the unique viscosity solution of the associated system of quasi-variational inequalities.
This paper is concerned with a linear quadratic stochastic two-person zero-sum differential game with constant coefficients in an infinite time horizon. Open-loop and closed-loop saddle points are introduced. The existence of closed-loop saddle points is characterized by the solvability of an algebraic Riccati equation with a certain stabilizing condition. A crucial result makes our approach work is the unique solvability of a class of linear backward stochastic differential equations in an infinite horizon.
Cooperative Nonlinear Guidance Strategies for Guaranteed Pursuit-Evasion
Intelligent Systems and Control Lab, Department of Aerospace Engineering, Indian Institute of Technology Bombay（智能系统与控制实验室，航空航天工程系，印度理工学院班加罗尔）；GALACxIS Lab, Department of Aerospace Engineering and Engineering Mechanics, University of Cincinnati（GALACxIS实验室，航空航天工程与工程力学系，辛辛那提大学）
In this paper, we show existence and uniqueness of solutions of the infinite horizon McKean-Vlasov FBSDEs using two different methods, which lead to two different sets of assumptions. We use these results to solve the infinite horizon mean field type control problems and mean field games.
We consider stochastic differential games with $N$ nearly identical players, linear-Gaussian dynamics, and infinite horizon discounted quadratic cost. Admissible controls are feedbacks for which the system is ergodic. We first study the existence of affine Nash equilibria by means of an associated system of $N$ Hamilton-Jacobi-Bellman and $N$ Kolmogorov-Fokker-Planck partial differential equations, proving that for small discount factors quadratic-Gaussian solutions exist and are unique. Then, we prove the convergence of such solutions to the unique quadratic-Gaussian solution of the pair of M…
