In order to further expand the flight envelope of quadrotors under actuator failures, we design a nonlinear sensor-based fault-tolerant controller to stabilize a quadrotor with failure of two opposing rotors in the high-speed flight condition (> 8m/s). The incremental nonlinear dynamic inversion (INDI) approach which excels in handling model uncertainties is adopted to compensate for the significant unknown aerodynamic effects. The internal dynamics of such an underactuated system have been analyzed, and subsequently stabilized by re-defining the control output. The proposed method can be generalized to control a quadrotor under single-rotor-failure and nominal conditions. For validation, flight tests have been carried out in a large-scale open jet wind tunnel. The position of a damaged quadrotor can be controlled in the presence of significant wind disturbances. A linear quadratic regulator (LQR) approach from the literature has been compared to demonstrate the advantages of the proposed nonlinear method in the windy and high-speed flight condition.
The mechanical simplicity, hover capabilities, and high agility of quadrotors lead to a fast adaption in the industry for inspection, exploration, and urban aerial mobility. On the other hand, the unstable and underactuated dynamics of quadrotors render them highly susceptible to system faults, especially rotor failures. In this work, we propose a fault-tolerant controller using nonlinear model predictive control (NMPC) to stabilize and control a quadrotor subjected to the complete failure of a single rotor. Differently from existing works, which either rely on linear assumptions or resort to …
Conventional quadrotors received great attention in trajectory design and fault-tolerant control in these years. The direction of each thrust is perpendicular to the body because of the geometrics in mechanical design. Comparing with the conventional quadrotor, a novel quadrotor named quad-tilt-rotor brings better freedom in manipulating the thrust vector. Quad-tilt-rotor augments the additional degrees of freedom in the thrust, providing the possibility of violating the normal direction of the thrust in the conventional quadrotor. This provides the ability of greater agility in control. This …
This study has developed a fault-tolerant controller that is able to recover a quadrotor from arbitrary initial orientations and angular velocities, despite the complete failure of a rotor. This cascaded control method includes a position/altitude controller, an almost-global convergence attitude controller, and a control allocation method based on quadratic programming. As a major novelty, a constraint of undesirable angular velocity is derived and fused into the control allocator, which significantly improves the recovery performance. For validation, we have conducted a set of Monte-Carlo si…
Czech Technical University in Prague（捷克理工大学）；University of Twente（特温特大学）
A perception-aware Nonlinear Model Predictive Control (NMPC) strategy aimed at performing vision-based target tracking and collision avoidance with a multi-rotor aerial vehicle is presented in this paper. The proposed control strategy considers both realistic actuation limits at the torque level and visual perception constraints to enforce the visibility coverage of a target while complying with the mission objectives. Furthermore, the approach allows to safely navigate in a workspace area populated by dynamic obstacles with a ballistic motion. The formulation is meant to be generic and set up…
We present a dynamic path planning algorithm to navigate an amphibious rotor craft through a concave time-invariant obstacle field while attempting to minimize energy usage. We create a nonlinear quaternion state model that represents the rotor craft dynamics above and below the water. The 6 degree of freedom dynamics used within a layered architecture to generate motion paths for the vehicle to follow and the required control inputs. The rotor craft has a 3 dimensional map of its surroundings that is updated via limited range onboard sensor readings within the current medium (air or water). P…
Ability to recover from faults and continue mission is desirable for many quadrotor applications. The quadrotor's rotor may fail while performing a mission and it is essential to develop recovery strategies so that the vehicle is not damaged. In this paper, we develop a model-free deep reinforcement learning approach for a quadrotor to recover from a single rotor failure. The approach is based on Soft-actor-critic that enables the vehicle to hover, land, and perform complex maneuvers. Simulation results are presented to validate the proposed approach using a custom simulator. The results show …
Rotor-Failure-Aware Quadrotors Flight in Unknown Environments
School of Robotics and Automation, Nanjing University（南京大学机器人与自动化学院）；Institute of Cyber-Systems and Control, College of Control Science and Engineering, Zhejiang University（浙江大学控制系统研究所）；Department of Aeronautical and Aviation Engineering, The Hong Kong Polytechnic University（香港理工大学航空工程系）；School of Aeronautic Science and Engineering, Beihang University（北航航空科学与工程学院）
University of Zurich（苏黎世大学）；ETH Zurich（苏黎世联邦理工学院）；LAAS-CNRS（法国国家科学研究中心图卢兹自动化与系统分析实验室）；Université de Toulouse（图卢兹大学）；CNRS（法国国家科学研究中心）
In this paper, we prove that the dynamical model of a quadrotor subject to linear rotor drag effects is differentially flat in its position and heading. We use this property to compute feed-forward control terms directly from a reference trajectory to be tracked. The obtained feed-forward terms are then used in a cascaded, nonlinear feedback control law that enables accurate agile flight with quadrotors. Compared to state-of-the-art control methods, which treat the rotor drag as an unknown disturbance, our method reduces the trajectory tracking error significantly. Finally, we present a method…
University of Zurich（苏黎世大学）；Delft University of Technology（代尔夫特理工大学）
Fault-tolerant control is crucial for safety-critical systems, such as quadrotors. State-of-art flight controllers can stabilize and control a quadrotor even when subjected to the complete loss of a rotor. However, these methods rely on external sensors, such as GPS or motion capture systems, for state estimation. To the best of our knowledge, this has not yet been achieved with only onboard sensors. In this paper, we propose the first algorithm that combines fault-tolerant control and onboard vision-based state estimation to achieve position control of a quadrotor subjected to complete failur…
Roller-Quadrotor: A Novel Hybrid Terrestrial/Aerial Quadrotor with Unicycle-Driven and Rotor-Assisted Turning
Zhejiang University（浙江大学）；School of Mechanical Engineering, Zhejiang University（浙江大学机械工程学院）；Robotics Institute of Zhejiang University（浙江大学机器人研究所）；Robotics Research Center of Yuyao City（余姚市机器人研究中心）；The State Key Laboratory of Industrial Control Technology, Zhejiang University（浙江大学工业控制技术国家重点实验室）；Huzhou Institute of Zhejiang University（浙江大学湖州研究院）
Temasek Laboratories, NUS（新加坡国立大学淡马锡实验室）；Department of Electrical & Computer Engineering, NUS（新加坡国立大学电气与计算机工程系）
Majority of today's fixed-pitch, electric-power quadrotors have short flight endurance ($<$ 1 hour) which greatly limits their applications. This paper presents a design methodology for the construction of a long-endurance quadrotor using variable-pitch rotors and a gasoline-engine. The methodology consists of three aspects. Firstly, the rotor blades and gasoline engine are selected as a pair, so that sufficient lift can be comfortably provided by the engine. Secondly, drivetrain and airframe are designed. Major challenges include airframe vibration minimization and power transmission from one…
Recently, Model Predictive Path Integral (MPPI) control algorithm has been extensively applied to autonomous navigation tasks, where the cost map is mostly assumed to be known and the 2D navigation tasks are only performed. In this paper, we propose a generic MPPI control framework that can be used for 2D or 3D autonomous navigation tasks in either fully or partially observable environments, which are the most prevalent in robotics applications. This framework exploits directly the 3D-voxel grid acquired from an on-board sensing system for performing collision-free navigation. We test the fram…
Center for Research in Optics（光学研究中心）；Universidad Tecnológica de León（莱昂理工大学）
In this paper, we develop a functional Unmanned Aerial Vehicle (UAV), capable of tracking an object using a Machine Learning-like vision system called Haar feature-based cascade classifier. The image processing is made on-board with a high processor single-board computer. Based on the detected object and its position, the quadrotor must track it in order to be in a centered position and in a safe distance to it. The object in question is a human face; the experiments were conducted in a two-step detection, searching first for the upper-body and then searching for the face inside of the human b…
Egypt-Japan University of Science and Technology（埃及-日本科技大学）
This thesis introduces a novel quadrotor manipulation system that consists of 2-link manipulator attached to the bottom of a quadrotor. This new system presents a solution for the drawbacks found in the current quadrotor manipulation system which uses a gripper fixed to a quadrotor. Unlike the current system, the proposed system has a 6-DOF, and it provides enough distance between the quadrotor and the object. System kinematics and dynamics are derived. To study the feasibility of the proposed system, a quadrotor with high enough payload to add the 2-link manipulator is constructed. Its parame…
Centre de Développement des Technologies Avancées（先进技术开发中心）；Ecole Supérieure des Techniques Aéronautiques et de Construction Automobile（航空技术与汽车制造高等学院）
Quadrotor unmanned aerial vehicles have a limited quantity of embedded energy. To preserve and guaranty the success of the UAV mission, we should manage energy consumption during the mission. In this study we introduce an optimization algorithm to minimize the consumed energy in quadrotor mission under windy conditions. The mechanical energy consumed by rotors of the flying vehicle is formulated with an efficiency function. Then, we formulate the energy minimization problem as an optimal control problem. The last problem is solved in order to calculate minimum energy for quadrotor simple missi…
Event cameras are a promising candidate to enable high speed vision-based control due to their low sensor latency and high temporal resolution. However, purely event-based feedback has yet to be used in the control of drones. In this work, a first step towards implementing low-latency high-bandwidth control of quadrotors using event cameras is taken. In particular, this paper addresses the problem of one-dimensional attitude tracking using a dualcopter platform equipped with an event camera. The event-based state estimation consists of a modified Hough transform algorithm combined with a Kalma…
Quadrotor stabilizing controllers often require careful, model-specific tuning for safe operation. We use reinforcement learning to train policies in simulation that transfer remarkably well to multiple different physical quadrotors. Our policies are low-level, i.e., we map the rotorcrafts' state directly to the motor outputs. The trained control policies are very robust to external disturbances and can withstand harsh initial conditions such as throws. We show how different training methodologies (change of the cost function, modeling of noise, use of domain randomization) might affect flight…
Traditional aerial vehicles are usually custom-designed for specific tasks. Although they offer an efficient solution, they are not always able to adapt to changes in the task specification, e.g., increasing the payload. This applies to quadrotors, having a maximum payload and only four controllable degrees of freedom, limiting their adaptability to the task's variations. We propose a versatile modular robotic system that can increase its payload and degrees of freedom by assembling heterogeneous modules; we call it H-ModQuad. It consists of cuboid modules propelled by quadrotors with tilted p…
Quadrotors are highly nonlinear dynamical systems that require carefully tuned controllers to be pushed to their physical limits. Recently, learning-based control policies have been proposed for quadrotors, as they would potentially allow learning direct mappings from high-dimensional raw sensory observations to actions. Due to sample inefficiency, training such learned controllers on the real platform is impractical or even impossible. Training in simulation is attractive but requires to transfer policies between domains, which demands trained policies to be robust to such domain gap. In this…
In this paper, we tackle the problem of flying a quadrotor using time-optimal control policies that can be replanned online when the environment changes or when encountering unknown disturbances. This problem is challenging as the time-optimal trajectories that consider the full quadrotor dynamics are computationally expensive to generate (order of minutes or even hours). We introduce a sampling-based method for efficient generation of time-optimal paths of a point-mass model. These paths are then tracked using a Model Predictive Contouring Control approach that considers the full quadrotor dy…
Among the tilt-rotors (quadrotors) developed in the last decades, Rylls model with eight inputs (four magnitudes of the thrusts and four tilting angles) attracted great attention. Typical feedback linearization maneuvers all the eight inputs with a united control rule to stabilize this tilt-rotor. Instead of assigning the tilting angles by the control rule, the recent research predetermined the tilting angles and left the magnitudes of the thrusts the only control signals. These tilting angles are designed to mimic the cat-trot gait, avoiding the singular decoupling matrix feedback linearizati…
Enabling vertical take-off and landing while providing the ability to fly long ranges opens the door to a wide range of new real-world aircraft applications while improving many existing tasks. Tiltrotor vertical take-off and landing (VTOL) unmanned aerial vehicles (UAVs) are a better choice than fixed-wing and multirotor aircraft for such applications. Prior works on these aircraft have addressed aerodynamic performance, design, modeling, and control. However, a less explored area is the study of their potential fault tolerance due to their inherent redundancy, which allows them to tolerate s…
Fixed-Time Dynamic Landing of Quadrotors using Adaptive Unscented Kalman Filtering and Nonlinear Model Predictive Control
Autonomous Vehicles Laboratory, Department of Aerospace Engineering, Toronto Metropolitan University（自主车辆实验室，航空航天工程系，多伦多 Metropolitan 大学）；University of Toronto Institute for Aerospace Studies, University of Toronto（多伦多大学航空航天研究 institute，多伦多大学）
Egypt-Japan University of Science and Technology（埃及-日本科学技术大学）
This paper presents the inverse kinematic analysis and parameters identification of a novel aerial manipulation system. This system consists of 2-link manipulator attached to the bottom of a quadrotor. This new system presents a solution for the limitations found in the current quadrotor manipulation system. By deriving the inverse kinematics, one can design the controller such that the desired end effector position and orientation can be tracked. To study the feasibility of the proposed system, a quadrotor with high enough payload to add the 2-link manipulator is designed and constructed. Exp…
California Institute of Technology（加州理工学院）；Northeastern University（东北大学）；University of California, Irvine（加州大学欧文分校）
Precise near-ground trajectory control is difficult for multi-rotor drones, due to the complex aerodynamic effects caused by interactions between multi-rotor airflow and the environment. Conventional control methods often fail to properly account for these complex effects and fall short in accomplishing smooth landing. In this paper, we present a novel deep-learning-based robust nonlinear controller (Neural Lander) that improves control performance of a quadrotor during landing. Our approach combines a nominal dynamics model with a Deep Neural Network (DNN) that learns high-order interactions.…
