In this paper, we propose a locomotion training framework where a control policy and a state estimator are trained concurrently. The framework consists of a policy network which outputs the desired joint positions and a state estimation network which outputs estimates of the robot's states such as the base linear velocity, foot height, and contact probability. We exploit a fast simulation environment to train the networks and the trained networks are transferred to the real robot. The trained policy and state estimator are capable of traversing diverse terrains such as a hill, slippery plate, and bumpy road. We also demonstrate that the learned policy can run at up to 3.75 m/s on normal flat ground and 3.54 m/s on a slippery plate with the coefficient of friction of 0.22.
California Institute of Technology（加州理工学院）；Ecole Polytechnique Fédérale de Lausanne（洛桑联邦理工学院）；Northeastern University（东北大学）
There have been several successful implementations of bio-inspired legged robots that can trot, walk, and hop robustly even in the presence of significant unplanned disturbances. Despite all of these accomplishments, practical control and high-level decision-making algorithms in multi-modal legged systems are overlooked. In nature, animals such as birds impressively showcase multiple modes of mobility including legged and aerial locomotion. They are capable of performing robust locomotion over large walls, tight spaces, and can recover from unpredictable situations such as sudden gusts or slip…
Politecnico di Milano（米兰理工大学）；Istituto Italiano di Tecnologia（意大利技术研究院）
Hybrid wheeled-legged locomotion is a navigation paradigm only recently opened up by novel robotic designs,e.g. the centaur-type humanoid CENTAURO [1] or the quadruped ANYmal [2] in its configuration featuring non-steerable wheels. The term Hybrid Locomotion is hereafter used to indicate a particular type of locomotion, achieved with simultaneous and coordinate use of legs and wheels,see Fig. 1. Such choice stems at the intersection between legged locomotion and the simpler wheeled navigation, in order to get the best from both techniques: agility and ability to traverse uneven terrains from t…
ETH Zürich（苏黎世联邦理工学院）；Delft University of Technology（代尔夫特理工大学）；Boston Dynamics（波士顿动力公司）
Wheeled-legged robots have the potential for highly agile and versatile locomotion. The combination of legs and wheels might be a solution for any real-world application requiring rapid, and long-distance mobility skills on challenging terrain. In this paper, we present an online trajectory optimization framework for wheeled quadrupedal robots capable of executing hybrid walking-driving locomotion strategies. By breaking down the optimization problem into a wheel and base trajectory planning, locomotion planning for high dimensional wheeled-legged robots becomes more tractable, can be solved i…
This work tries to contribute to the design of legged robots with capabilities boosted through thruster-assisted locomotion. Our long-term goal is the development of robots capable of negotiating unstructured environments, including land and air, by leveraging legs and thrusters collaboratively. These robots could be used in a broad number of applications including search and rescue operations, space exploration, automated package handling in residential spaces and digital agriculture, to name a few. In all of these examples, the unique capability of thruster-assisted mobility greatly broadens…
California Institute of Technology（加州理工学院）；ETH Zurich（苏黎世联邦理工学院）
Terrain-aware locomotion has become an emerging topic in legged robotics. However, it is hard to generate diverse, challenging, and realistic unstructured terrains in simulation, which limits the way researchers evaluate their locomotion policies. In this paper, we prototype the generation of a terrain dataset via terrain authoring and active learning, and the learned samplers can stably generate diverse high-quality terrains. We expect the generated dataset to make a terrain-robustness benchmark for legged locomotion. The dataset, the code implementation, and some policy evaluations are relea…
Sampling Strategy Design for Model Predictive Path Integral Control on Legged Robot Locomotion
School of Artificial Intelligence Shandong University Jinan, China；Department of Mechatronics；Robotics Xi'an Jiaotong-Liverpool University Suzhou, China；Robotics Xi'an Jiaotong-Liverpool University Suzhou, China University of Liverpool United Kingdom；Robotic Systems Xi'an Jiaotong-Liverpool University Suzhou, China
Robotic Systems Lab, ETH Zurich（苏黎世联邦理工学院机器人系统实验室）；Robotics and Artificial Intelligence Lab, KAIST（韩国科学技术院机器人与人工智能实验室）；Intelligent Systems Lab, Intel（英特尔智能系统实验室）
Some of the most challenging environments on our planet are accessible to quadrupedal animals but remain out of reach for autonomous machines. Legged locomotion can dramatically expand the operational domains of robotics. However, conventional controllers for legged locomotion are based on elaborate state machines that explicitly trigger the execution of motion primitives and reflexes. These designs have escalated in complexity while falling short of the generality and robustness of animal locomotion. Here we present a radically robust controller for legged locomotion in challenging natural en…
As both legged robots and embedded compute have become more capable, researchers have started to focus on field deployment of these robots. Robust autonomy in unstructured environments requires perception of the world around the robot in order to avoid hazards. However, incorporating perception online while maintaining agile motion is more challenging for legged robots than other mobile robots due to the complex planners and controllers required to handle the dynamics of locomotion. This report will compare three recent approaches for perceptive locomotion and discuss the different ways in whi…
Agile asymmetric multi-legged locomotion: contact planning via geometric mechanics and spin model duality
Department of Mechanical Engineering, Pennsylvania State University（宾夕法尼亚州立大学机械工程系）；MIT Improbable AI Lab, Maschusetts Institute of Technology（麻省理工学院Improbable AI实验室）；Department of Physics, Georgia Institute of Technology（佐治亚理工学院物理系）；Department of Physics, Tsinghua University（清华大学物理系）
IMT School for Advanced Studies Lucca（卢卡高等研究院）；Istituto Italiano di Tecnologia（意大利理工学院）；Università di Genova（热那亚大学）
Re-planning in legged locomotion is crucial to track the desired user velocity while adapting to the terrain and rejecting external disturbances. In this work, we propose and test in experiments a real-time Nonlinear Model Predictive Control (NMPC) tailored to a legged robot for achieving dynamic locomotion on a variety of terrains. We introduce a mobility-based criterion to define an NMPC cost that enhances the locomotion of quadruped robots while maximizing leg mobility and improves adaptation to the terrain features. Our NMPC is based on the real-time iteration scheme that allows us to re-p…
Trajectory optimization is becoming increasingly powerful in addressing motion planning problems of underactuated robotic systems. Numerous prior studies solve such a class of large non-convex optimal control problems in a hierarchical fashion. However, numerical accuracy issues are prone to occur when one uses a full-order model to track reference trajectories generated from a reduced-order model. This study investigates an approach of Alternating Direction Method of Multipliers (ADMM) and proposes a new splitting scheme for legged locomotion problems. Rigid body dynamics constraints and othe…
In this paper, we study the regulation of the Ground Contact Forces (GRF) in thruster-assisted legged locomotion. We will employ Reference Governors (RGs) for enforcing GRF constraints in Harpy model which is a bipedal robot that is being developed at Northeastern University. Optimization-based methods and whole body control are widely used for enforcing the no-slip constraints in legged locomotion which can be very computationally expensive. In contrast, RGs can enforce these constraints by manipulating joint reference trajectories using Lyapunov stability arguments which can be computed much…
Deep reinforcement learning produces robust locomotion policies for legged robots over challenging terrains. To date, few studies have leveraged model-based methods to combine these locomotion skills with the precise control of manipulators. Here, we incorporate external dynamics plans into learning-based locomotion policies for mobile manipulation. We train the base policy by applying a random wrench sequence on the robot base in simulation and adding the noisified wrench sequence prediction to the policy observations. The policy then learns to counteract the partially-known future disturbanc…
Locomotion over soft terrain remains a challenging problem for legged robots. Most of the work done on state estimation for legged robots is designed for rigid contacts, and does not take into account the physical parameters of the terrain. That said, this letter answers the following questions: how and why does soft terrain affect state estimation for legged robots? To do so, we utilized a state estimator that fuses IMU measurements with leg odometry that is designed with rigid contact assumptions. We experimentally validated the state estimator with the HyQ robot trotting over both soft and …
Dynamic Quadrupedal Legged and Aerial Locomotion via Structure Repurposing
Department of Electrical and Computer Engineering, Northeastern University（电气与计算机工程系，东北大学）；Department of Aerospace Engineering, California Institute of Technology（航空航天工程系，加州理工学院）
Learning controllers that reproduce legged locomotion in nature has been a long-time goal in robotics and computer graphics. While yielding promising results, recent approaches are not yet flexible enough to be applicable to legged systems of different morphologies. This is partly because they often rely on precise motion capture references or elaborate learning environments that ensure the naturality of the emergent locomotion gaits but prevent generalization. This work proposes a generic approach for ensuring realism in locomotion by guiding the learning process with the spring-loaded invert…
Optimal control is a successful approach to generate motions for complex robots, in particular for legged locomotion. However, these techniques are often too slow to run in real time for model predictive control or one needs to drastically simplify the dynamics model. In this work, we present a method to learn to predict the gradient and hessian of the problem value function, enabling fast resolution of the predictive control problem with a one-step quadratic program. In addition, our method is able to satisfy constraints like friction cones and unilateral constraints, which are important for …
A Foot Resistive Force Model for Legged Locomotion on Muddy Terrains
Department of Mechanical and Aerospace Engineering, Rutgers University（罗格斯大学机械与航空航天工程系）；Department of Electrical and Biomedical Engineering, University of Nevada（内华达大学电气与生物医学工程系）
University of Massachusetts Lowell（马萨诸塞大学洛厄尔分校）；NVIDIA Research（英伟达研究）；Princeton University（普林斯顿大学）；Department of Mechanical Engineering, University of Massachusetts Lowell（马萨诸塞大学洛厄尔分校机械工程系）
Legged robot locomotion on a dynamic rigid surface (i.e., a rigid surface moving in the inertial frame) involves complex full-order dynamics that is high-dimensional, nonlinear, and time-varying. Towards deriving an analytically tractable dynamic model, this study theoretically extends the reduced-order linear inverted pendulum (LIP) model from legged locomotion on a stationary surface to locomotion on a dynamic rigid surface (DRS). The resulting model is herein termed as DRS-LIP. Furthermore, this study introduces an approximate analytical solution of the proposed DRS-LIP that is computationa…
X2-N: A Transformable Wheel-legged Humanoid Robot with Dual-mode Locomotion and Manipulation
Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology（香港理工大学电子与计算机工程系）；X-lab Department, Agibot Innovation Company（阿吉博创新公司X实验室）
We propose in this paper a motion planning method for legged robot locomotion based on Geometric Heat Flow framework. The motion planning task is challenging due to the hybrid nature of dynamics and contact constraints. We encode the hybrid dynamics and constraints into Riemannian inner product, and this inner product is defined so that short curves correspond to admissible motions for the system. We rely on the affine geometric heat flow to deform an arbitrary path connecting the desired initial and final states to this admissible motion. The method is able to automatically find the trajector…
A Survey of Legged Robotics in Non-Inertial Environments: Past, Present, and Future
School of Mechanical Engineering, Purdue University（帕克大学机械工程学院）；Department of Mechanical and Aerospace Engineering, Rutgers University（新泽西罗格斯大学机械与航空航天工程系）；Department of Robotics, University of Michigan（密歇根大学机器人系）
Mixture-of-Experts RL for Fault-Tolerant Legged Locomotion
Dynamic Legged Systems Laboratory, Istituto Italiano di Tecnologia (IIT), Genova, Italy（意大利技术研究院（IIT）动态腿足系统实验室，热那亚，意大利）；Dipartimento di Informatica, Bioingegneria, Robotica e Ingegneria dei Sistemi (DIBRIS), Universita di Genova, Genova, Italy（热那亚大学计算机科学、生物工程、机器人及系统工程系（DIBRIS），热那亚，意大利）
Both legged locomotion and slithering motions typically utilize periodic gaits -- repeating cycles of body shape change that produce a net motion through the world. Legged locomotion can be viewed from the perspective of piece-wise contact constraint formation and removal. Slithering and low Reynolds number swimming operate under continuous constraints of force balance, wherein dissipation removes the ability to accumulate momentum. Here we discuss how to bridge the gap between these domains of motion, thereby, among other benefits, producing models for the space of legged locomotion with slip…
An attached arm can significantly increase the applicability of legged robots to several mobile manipulation tasks that are not possible for the wheeled or tracked counterparts. The standard hierarchical control pipeline for such legged manipulators is to decouple the controller into that of manipulation and locomotion. However, this is ineffective. It requires immense engineering to support coordination between the arm and legs, and error can propagate across modules causing non-smooth unnatural motions. It is also biological implausible given evidence for strong motor synergies across limbs.…
Max Planck Institute for Intelligent Systems（马克斯·普朗克智能系统研究所）
Muscle models and animal observations suggest that physical damping is beneficial for stabilization. Still, only a few implementations of mechanical damping exist in compliant robotic legged locomotion. It remains unclear how physical damping can be exploited for locomotion tasks, while its advantages as sensor-free, adaptive force- and negative work-producing actuators are promising. In a simplified numerical leg model, we studied the energy dissipation from viscous and Coulomb damping during vertical drops with ground-level perturbations. A parallel spring-damper is engaged between touch-dow…
Animals are capable of precise and agile locomotion using vision. Replicating this ability has been a long-standing goal in robotics. The traditional approach has been to decompose this problem into elevation mapping and foothold planning phases. The elevation mapping, however, is susceptible to failure and large noise artifacts, requires specialized hardware, and is biologically implausible. In this paper, we present the first end-to-end locomotion system capable of traversing stairs, curbs, stepping stones, and gaps. We show this result on a medium-sized quadruped robot using a single front-…
Oxford Robotics Institute, University of Oxford（牛津大学牛津机器人研究所）
We present a unified model-based and data-driven approach for quadrupedal planning and control to achieve dynamic locomotion over uneven terrain. We utilize on-board proprioceptive and exteroceptive feedback to map sensory information and desired base velocity commands into footstep plans using a reinforcement learning (RL) policy. This RL policy is trained in simulation over a wide range of procedurally generated terrains. When ran online, the system tracks the generated footstep plans using a model-based motion controller. We evaluate the robustness of our method over a wide variety of compl…
Variable-Impedance Muscle Coordination under Slow-Rate Control Frequencies and Limited Observation Conditions Evaluated through Legged Locomotion
Department of Brain Robot Interface, ATR Computational Neuroscience Laboratories（脑机器人接口系，ATR计算神经科学实验室）；Kyoto University Graduate school of informatics（京都大学信息学研究生院）
Istituto Italiano di Tecnologia（意大利理工学院）；University of Notre Dame（圣母大学）
We present a novel control strategy for dynamic legged locomotion in complex scenarios, that considers information about the morphology of the terrain in contexts when only on-board mapping and computation are available. The strategy is built on top of two main elements: first a contact sequence task that provides safe foothold locations based on a convolutional neural network to perform fast and continuous evaluation of the terrain in search of safe foothold locations; then a model predictive controller that considers the foothold locations given by the contact sequence task to optimize targe…
Virginia Tech（弗吉尼亚理工大学）；California Institute of Technology（加州理工学院）
The aim of this work is to define a planner that enables robust legged locomotion for complex multi-agent systems consisting of several holonomically constrained quadrupeds. To this end, we employ a methodology based on behavioral systems theory to model the sophisticated and high-dimensional structure induced by the holonomic constraints. The resulting model is then used in tandem with distributed control techniques such that the computational burden is shared across agents while the coupling between agents is preserved. Finally, this distributed model is framed in the context of a predictive…
Adaptive Legged Locomotion via Online Learning for Model Predictive Control
Department of Aerospace Engineering, University of Michigan（密歇根大学航空航天工程系）；Institute for Robotics and Intelligent Machines, Georgia Institute of Technology（佐治亚理工学院机器人与智能机器研究所）
University of Massachusetts Lowell（马萨诸塞大学洛厄尔分校）；Purdue University（普渡大学）；University of Rhode Island（罗德岛大学）
State estimation for legged locomotion over a dynamic rigid surface (DRS), which is a rigid surface moving in the world frame (e.g., ships, aircraft, and trains), remains an under-explored problem. This paper introduces an invariant extended Kalman filter that estimates the robot's pose and velocity during DRS locomotion by using common sensors of legged robots (e.g., inertial measurement units (IMU), joint encoders, and RDB-D camera). A key feature of the filter lies in that it explicitly addresses the nonstationary surface-foot contact point and the hybrid robot behaviors. Another key featur…
