The control and guidance of multi-robots (swarm) is a non-trivial problem due to the complexity inherent in the coupled interaction among the group. Whether the swarm is cooperative or non-cooperative, lessons can be learnt from sheepdogs herding sheep. Biomimicry of shepherding offers computational methods for swarm control with the potential to generalize and scale in different environments. However, learning to shepherd is complex due to the large search space that a machine learner is faced with. We present a deep hierarchical reinforcement learning approach for shepherding, whereby an unmanned aerial vehicle (UAV) learns to act as an aerial sheepdog to control and guide a swarm of unmanned ground vehicles (UGVs). The approach extends our previous work on machine education to decompose the search space into a hierarchically organized curriculum. Each lesson in the curriculum is learnt by a deep reinforcement learning model. The hierarchy is formed by fusing the outputs of the model. The approach is demonstrated first in a high-fidelity robotic-operating-system (ROS)-based simulation environment, then with physical UGVs and a UAV in an in-door testing facility. We investigate the ability of the method to generalize as the models move from simulation to the real-world and as the models move from one scale to another.
University of New South Wales（新南威尔士大学）；Defence Science and Technology, Australian Department of Defence（澳大利亚国防部国防科技集团）
Shepherding involves herding a swarm of agents (\emph{sheep}) by another a control agent (\emph{sheepdog}) towards a goal. Multiple approaches have been documented in the literature to model this behaviour. In this paper, we present a modification to a well-known shepherding approach, and show, via simulation, that this modification improves shepherding efficacy. We then argue that given complexity arising from obstacles laden environments, path planning approaches could further enhance this model. To validate this hypothesis, we present a 2-stage evolutionary-based path planning algorithm for…
Heriot-Watt University（赫瑞-瓦特大学）；University of Campinas (UNICAMP)（坎皮纳斯大学（UNICAMP））
This work investigates two approaches for the design of autonomous cooperative flight controllers for airship swarms. The first controller is based on formation flight and the second one is based on swarm intelligence strategies. In both cases, the team of airships needs to perform two different tasks: waypoint path following and ground moving target tracking. The UAV platform considered in this work is the NOAMAY airship developed in Brazil. We use a simulated environment to test the proposed approaches. Results show the inherent flexibility of the swarm intelligence approach on both tasks.
AirSwarm: Enabling Cost-Effective Multi-UAV Research with COTS drones
Centre for Advanced Robotics Technology Innovation (CARTIN)（高级机器人技术创新中心（CARTIN））；School of Electrical and Electronic Engineering, Nanyang Technological University（南洋理工大学电气与电子工程学院）
We demonstrate how efficient autonomous drone swarms can be in detecting and tracking occluded targets in densely forested areas, such as lost people during search and rescue missions. Exploration and optimization of local viewing conditions, such as occlusion density and target view obliqueness, provide much faster and much more reliable results than previous, blind sampling strategies that are based on pre-defined waypoints. An adapted real-time particle swarm optimization and a new objective function are presented that are able to deal with dynamic and highly random through-foliage conditio…
Real-Time Sense and Detect of Drones Using Deep Learning and Airborne LiDAR
Drone Systems Lab, School of Computing, Engineering, and Physical Sciences, University of the West of Scotland（无人机系统实验室，计算、工程与物理科学学院，西方苏格兰大学）；Centre for Robotics & Intelligent Systems, Department of Electronic & Computer Engineering, University of Limerick（机器人与智能系统中心，电子与计算机工程系，利默里克大学）；Hamburg Port Authority（汉堡港口管理局）
Democritus University of Thrace（色雷斯德谟克利特大学）；Information Technologies Institute, The Centre for Research & Technology, Hellas（信息技术研究所，研究与技术中心，希腊）
This paper tackles the problem of positioning a swarm of UAVs inside a completely unknown terrain, having as objective to maximize the overall situational awareness. The situational awareness is expressed by the number and quality of unique objects of interest, inside the UAVs' fields of view. YOLOv3 and a system to identify duplicate objects of interest were employed to assign a single score to each UAVs' configuration. Then, a novel navigation algorithm, capable of optimizing the previously defined score, without taking into consideration the dynamics of either UAVs or environment, is propos…
Polytechnique Montreal（蒙特利尔理工学院）；École de Technologie Supérieure（高等技术学院）
The coordination of robot swarms - large decentralized teams of robots - generally relies on robust and efficient inter-robot communication. Maintaining communication between robots is particularly challenging in field deployments. Unstructured environments, limited computational resources, low bandwidth, and robot failures all contribute to the complexity of connectivity maintenance. In this paper, we propose a novel lightweight algorithm to navigate a group of robots in complex environments while maintaining connectivity by building a chain of robots. The algorithm is robust to single robot …
Human-guided Swarms: Impedance Control-inspired Influence in Virtual Reality Environments
School of Mechanical and Materials Engineering（机械与材料工程学院）；Washington State University（华盛顿州立大学）；Department of Mechanical and Industrial Engineering（机械与工业工程系）；University of Massachusetts（马萨诸塞大学）
Royal Holloway, University of London（伦敦大学皇家霍洛威学院）；Université de Limoges（利摩日大学）；Edinburgh Napier University（爱丁堡纳皮尔大学）；Université de Bordeaux（波尔多大学）
Inter-connected objects, either via public or private networks are the near future of modern societies. Such inter-connected objects are referred to as Internet-of-Things (IoT) and/or Cyber-Physical Systems (CPS). One example of such a system is based on Unmanned Aerial Vehicles (UAVs). The fleet of such vehicles are prophesied to take on multiple roles involving mundane to high-sensitive, such as, prompt pizza or shopping deliveries to your homes to battlefield deployment for reconnaissance and combat missions. Drones, as we refer to UAVs in this paper, either can operate individually (solo m…
Learning to Navigate in Turbulent Flows with Aerial Robot Swarms: A Cooperative Deep Reinforcement Learning Approach
University of Pennsylvania（宾夕法尼亚大学）；Amazon Robotics（亚马逊机器人公司）；Universidad Santo Tomas（圣托马斯大学）；Bethune Cookman University（白求恩-库克曼大学）；Lehigh University（利哈伊大学）
NODA-MMH: Certified Learning-Aided Nonlinear Control for Magnetically-Actuated Swarm Experiment Toward On-Orbit Proof
Graduate Student of Mechanical Engineering, Institute of Science Tokyo（东京科学研究所机械工程研究生）；Researcher and Engineer of Satellite R&D Division, Interstellar Technologies Inc.（Interstellar Technologies Inc.卫星研发部门研究员和工程师）；Senior Associate Professor of Computer Science and Engineering, University of Aizu（宇智大学计算机科学与工程高级副教授）；Professor of Spacecraft Engineering, Institute of Space and Astronautical Science（空间与航天科学研究所航天工程教授）
Recent years have seen an increased interest in using mean-field density based modelling and control strategy for deploying robotic swarms. In this paper, we study how to dynamically deploy the robots subject to their physical constraints to efficiently measure and reconstruct certain unknown spatial field (e.g. the air pollution index over a city). Specifically, the evolution of the robots' density is modelled by mean-field partial differential equations (PDEs) which are uniquely determined by the robots' individual dynamics. Bayesian regression models are used to obtain predictions and retur…
