This work aims to combine machine learning and control approaches for legged robots, and developed a hybrid framework to achieve new capabilities of balancing against external perturbations. The framework embeds a kernel which is a fully parametric closed-loop gait generator based on analytical control. On top of that, a neural network with symmetric partial data augmentation learns to automatically adjust the parameters for the gait kernel and to generate compensatory actions for all joints as the residual dynamics, thus significantly augmenting the stability under unexpected perturbations. The performance of the proposed framework was evaluated across a set of challenging simulated scenarios. The results showed considerable improvements compared to the baseline in recovering from large external forces. Moreover, the produced behaviours are more natural, human-like and robust against noisy sensing.
Optimizing gait stability for legged robots is a difficult problem. Even on level surfaces, effectively traversing across different textures (e.g., carpet) rests on dynamically tuning parameters in multidimensional space. Inspired by biology, evolutionary algorithms (EA) remain an attractive solution for feasibly implementing robotic locomotion with both energetic economy and rapid parameter convergence. Here, we leveraged this class of algorithms to evolve a stable hexapod gait controller capable of traversing uneven terrain and obstacles. Gait parameters were evolved in a rigid body dynamics…
Legged locomotion is commonly studied and expressed as a discrete set of gait patterns, like walk, trot, gallop, which are usually treated as given and pre-programmed in legged robots for efficient locomotion at different speeds. However, fixing a set of pre-programmed gaits limits the generality of locomotion. Recent animal motor studies show that these conventional gaits are only prevalent in ideal flat terrain conditions while real-world locomotion is unstructured and more like bouts of intermittent steps. What principles could lead to both structured and unstructured patterns across mammal…
Interlimb neural connection is not required for gait transition in quadruped locomotion
Institute of Mathematics for Industry, Kyushu University（工业数学研究所，九州大学）；Research Institute for Electronics Science, Hokkaido University（电子科学研究所，北海道大学）；Research Institute of Electrical Communication, Tohoku University（电气通信研究所，东北大学）；Japan Science and Technology Agency CREST（日本科学技术 Agency CREST）
The semantics of the environment, such as the terrain type and property, reveals important information for legged robots to adjust their behaviors. In this work, we present a framework that learns semantics-aware locomotion skills from perception for quadrupedal robots, such that the robot can traverse through complex offroad terrains with appropriate speeds and gaits using perception information. Due to the lack of high-fidelity outdoor simulation, our framework needs to be trained directly in the real world, which brings unique challenges in data efficiency and safety. To ensure sample effic…
Georgia Institute of Technology（佐治亚理工学院）；Emory University（埃默里大学）；National University of Singapore（新加坡国立大学）；Carnegie Mellon University（卡内基梅隆大学）；Morehouse College（莫尔豪斯学院）；Pennsylvania State University（宾夕法尼亚州立大学）；Rancho Research Institute（兰乔研究所）；Royal Veterinary College（皇家兽医学院）；University of Oviedo（奥维耶多大学）
Serially connected robots are promising candidates for performing tasks in confined spaces such as search-and-rescue in large-scale disasters. Such robots are typically limbless, and we hypothesize that the addition of limbs could improve mobility. However, a challenge in designing and controlling such devices lies in the coordination of high-dimensional redundant modules in a way that improves mobility. Here we develop a general framework to control serially connected multi-legged robots. Specifically, we combine two approaches to build a general shape control scheme which can provide baselin…
Among small-scale mobile robots, multi-modal locomotion can help compensate for limited actuator capabilities. However, supporting multiple locomotion modes or gaits in small terrestrial robots typically requires complex designs with low locomotion efficiency. In this work, legged and rolling gaits are achieved by a 10~cm robot having just two degrees of freedom (DoF). This is acheived by leg shaping that facilitates whole body rolling and event-driven control that maintains motion using simple inertial sensor measurements. Speeds of approximately 0.4 and 2.2 body lengths per second are achiev…
Effect of Gait Design on Proprioceptive Sensing of Terrain Properties in a Quadrupedal Robot
Department of Mechanical Engineering, Massachusetts Institute of Technology（机械工程系，麻省理工学院）；Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California（Ming Hsieh 电子与计算机工程系，南加州大学）；Department of Earth and Environmental Science, University of Pennsylvania（地球与环境科学系，宾夕法尼亚大学）
本文对比四足机器人的Crawl N' Sense与Trot-Walk步态，证明慢速爬行步态能更稳定、准确地感知可变形地形强度及表面结壳破裂。
Robert Bosch Centre for Cyber-Physical Systems, IISc（印度科学研究所罗伯特·博世网络物理系统中心）
Humans and animals are believed to use a very minimal set of trajectories to perform a wide variety of tasks including walking. Our main objective in this paper is two fold 1) Obtain an effective tool to realize these basic motion patterns for quadrupedal walking, called the kinematic motion primitives (kMPs), via trajectories learned from deep reinforcement learning (D-RL) and 2) Realize a set of behaviors, namely trot, walk, gallop and bound from these kinematic motion primitives in our custom four legged robot, called the `Stoch'. D-RL is a data driven approach, which has been shown to be v…
Hefei University of Technology（合肥工业大学）；Changzhou Inst of Tech（常州工学院）
To construct a robot that can walk as efficiently and steadily as humans or other legged animals, we develop an enhanced elitist-mutated ant colony optimization~(EACO) algorithm with genetic and crossover operators in real-time applications to humanoid robotics or other legged robots. This work presents promoting global search capability and convergence rate of the EACO applied to humanoid robots in real-time by estimating the expected convergence rate using Markov chain. Furthermore, we put a special focus on the EACO algorithm on a wide range of problems, from ACO, real-coded GAs, GAs with n…
Despite many accomplishments by legged robot designers, state-of-the-art bipedal robots are prone to falling over, cannot negotiate extremely rough terrains and cannot directly regulate unilateral contact forces. Our objective is to integrate merits of legged and aerial robots in a single platform. We will show that the thrusters in a bipedal legged robot called Harpy can be leveraged to stabilize the robot's frontal dynamics and permit jumping over large obstacles which is an unusual capability not reported before. In addition, we will capitalize on the thrusters action in Harpy and will show…
Southern University of Science and Technology（南方科技大学）；National University of Singapore（新加坡国立大学）
Gait phase-based control is a trending research topic for walking-aid robots, especially robotic lower-limb prostheses. Gait phase estimation is a challenge for gait phase-based control. Previous researches used the integration or the differential of the human's thigh angle to estimate the gait phase, but accumulative measurement errors and noises can affect the estimation results. In this paper, a more robust gait phase estimation method is proposed using a unified form of piecewise monotonic gait phase-thigh angle models for various locomotion modes. The gait phase is estimated from only the…
Institute for Infocomm Research, A*STAR（新加坡科技研究局资讯通信研究院）；University College London（伦敦大学学院）
This work developed a learning framework for perceptive legged locomotion that combines visual feedback, proprioceptive information, and active gait regulation of foot-ground contacts. The perception requires only one forward-facing camera to obtain the heightmap, and the active regulation of gait paces and traveling velocity are realized through our formulation of CPG-based high-level imitation of foot-ground contacts. Through this framework, an end-user has the ability to command task-level inputs to control different walking speeds and gait frequencies according to the traversal of differen…
DePaul University（德保罗大学）；University of Arkansas（阿肯色大学）
Snakes are a remarkable evolutionary success story. Many snake-inspired robots have been proposed over the years. Soft robotic snakes (SRS) with their continuous and smooth bending capability better mimic their biological counterparts' unique characteristics. Prior SRSs are limited to planar operation with a limited number of planar gaits. We propose a novel SRS with spatial bending and investigate snake locomotion gaits beyond the capabilities of the state-of-the-art systems. We derive a complete floating-base kinematic model of the robot and use the model to derive jointspace trajectories fo…
Beijing Research Institute of UBTECH Robotics（优必选机器人北京研究院）；Tsinghua University（清华大学）
The planning of whole-body motion and step time for bipedal locomotion is constructed as a model predictive control (MPC) problem, in which a sequence of optimization problems needs to be solved online. While directly solving these problems is extremely time-consuming, we propose a predictive gait synthesizer to offer immediate solutions. Based on the full-dimensional model, a library of gaits with different speeds and periods is first constructed offline. Then the proposed gait synthesizer generates real-time gaits at 1kHz by synthesizing the gait library based on the online prediction of cen…
University of Zurich（苏黎世大学）；Ghent University（根特大学）；Fondazione Santa Lucia（圣卢西亚基金会）
Bipedal locomotion is a phenomenon that still eludes a fundamental and concise mathematical understanding. Conceptual models that capture some relevant aspects of the process exist but their full explanatory power is not yet exhausted. In the current study, we introduce the robustness criterion which defines the conditions for stable locomotion when steps are taken with imprecise angle of attack. Intuitively, the necessity of a higher precision indicates the difficulty to continue moving with a given gait. We show that the spring-loaded inverted pendulum model, under the robustness criterion, …
ETH Zürich（苏黎世联邦理工学院）；California Institute of Technology（加州理工学院）
The ability to generate dynamic walking in real-time for bipedal robots with input constraints and underactuation has the potential to enable locomotion in dynamic, complex and unstructured environments. Yet, the high-dimensional nature of bipedal robots has limited the use of full-order rigid body dynamics to gaits which are synthesized offline and then tracked online. In this work we develop an online nonlinear model predictive control approach that leverages the full-order dynamics to realize diverse walking behaviors. Additionally, this approach can be coupled with gaits synthesized offlin…
The ability to generate robust walking gaits on bipedal robots is key to their successful realization on hardware. To this end, this work extends the method of Hybrid Zero Dynamics (HZD) -- which traditionally only accounts for locomotive stability via periodicity constraints under perfect impact events -- through the inclusion of the saltation matrix with a view toward synthesizing robust walking gaits. By jointly minimizing the norm of the extended saltation matrix and the torque of the robot directly in the gait generation process, we demonstrate that the synthesized gaits are more robust t…
This work presents Neural Gaits, a method for learning dynamic walking gaits through the enforcement of set invariance that can be refined episodically using experimental data from the robot. We frame walking as a set invariance problem enforceable via control barrier functions (CBFs) defined on the reduced-order dynamics quantifying the underactuated component of the robot: the zero dynamics. Our approach contains two learning modules: one for learning a policy that satisfies the CBF condition, and another for learning a residual dynamics model to refine imperfections of the nominal model. Im…
Georgia Institute of Technology（佐治亚理工学院）；Carnegie Mellon University（卡内基梅隆大学）
Limbless robots have the potential to maneuver through cluttered environments that conventional robots cannot traverse. As illustrated in their biological counterparts such as snakes and nematodes, limbless locomotors can benefit from interactions with obstacles, yet such obstacle-aided locomotion (OAL) requires properly coordinated high-level self-deformation patterns (gait templates) as well as low-level body adaptation to environments. Most prior work on OAL utilized stereotyped traveling-wave gait templates and relied on local body deformations (e.g., passive body mechanics or decentralize…
DePaul University（德保罗大学）；Texas A&M University（得克萨斯农工大学）；Georgia Institute of Technology（佐治亚理工学院）；Louisiana S. University（路易斯安那州立大学）
Soft robotic snakes made of compliant materials can continuously deform their bodies and, therefore, mimic the biological snakes' flexible and agile locomotion gaits better than their rigid-bodied counterparts. Without wheel support, to date, soft robotic snakes are limited to emulating planar locomotion gaits, which are derived via kinematic modeling and tested on robotic prototypes. Given that the snake locomotion results from the reaction forces due to the distributed contact between their skin and the ground, it is essential to investigate the locomotion gaits through efficient dynamic mod…
We present a sim-to-real framework that uses dynamics and domain randomized offline reinforcement learning to enhance open-loop gaits for legged robots, allowing them to traverse uneven terrain without sensing foot impacts. Our approach, D$^2$-Randomized Gait Modulation with Bezier Curves (D$^2$-GMBC), uses augmented random search with randomized dynamics and terrain to train, in simulation, a policy that modifies the parameters and output of an open-loop Bezier curve gait generator for quadrupedal robots. The policy, using only inertial measurements, enables the robot to traverse unknown roug…
DePaul University（德保罗大学）；Texas A&M University（德克萨斯农工大学）；Georgia Institute of Technology（佐治亚理工学院）
Soft robotic snakes (SRSs) have a unique combination of continuous and compliant properties that allow them to imitate the complex movements of biological snakes. Despite the previous attempts to develop SRSs, many have been limited to planar movements or use wheels to achieve locomotion, which restricts their ability to imitate the full range of biological snake movements. We propose a new design for the SRSs that is wheelless and powered by pneumatics, relying solely on spatial bending to achieve its movements. We derive a kinematic model of the proposed SRS and utilize it to achieve two sna…
Locomotion of an Elastic Snake Robot via Natural Dynamics
German Aerospace Center (DLR), Robotics and Mechatronics Center (RMC)（德国航空航天中心（DLR）机器人与机电中心）；Technical University of Munich (TUM), Department of Computer Engineering（慕尼黑技术大学（TUM）计算机工程系）
DePaul University（德保罗大学）；Ohio State University（俄亥俄州立大学）；Imperial College London（帝国理工学院）；Georgia Institute of Technology（佐治亚理工学院）；Louisiana State University（路易斯安那州立大学）；Texas A&M University（得克萨斯农工大学）
Synthesizing Robust Walking Gaits via Discrete-Time Barrier Functions with Application to Multi-Contact Exoskeleton Locomotion
Georgia Institute of Technology（佐治亚理工学院）；School of Electrical and Computer Engineering（电气与计算机工程学院）；Woodruff School of Mechanical Engineering（伍德拉夫机械工程学院）；California Institute of Technology（加州理工学院）；Department of Computation and Neural Systems（计算与神经系统系）；Department of Mechanical and Civil Engineering（机械与土木工程系）；Department of Control and Dynamical Systems（控制与动力学系）
University of Washington（华盛顿大学）；Robotics at Google（Google机器人部门）
We focus on the problem of developing energy efficient controllers for quadrupedal robots. Animals can actively switch gaits at different speeds to lower their energy consumption. In this paper, we devise a hierarchical learning framework, in which distinctive locomotion gaits and natural gait transitions emerge automatically with a simple reward of energy minimization. We use evolutionary strategies (ES) to train a high-level gait policy that specifies gait patterns of each foot, while the low-level convex MPC controller optimizes the motor commands so that the robot can walk at a desired vel…
Biomechanical Comparisons Reveal Divergence of Human and Humanoid Gaits
Zhejiang University（浙江大学）；School of Engineering, Westlake University（西湖大学工程学院）；Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences（中国科学院宁波材料技术与工程研究所）
Gait-Adaptive Perceptive Humanoid Locomotion with Real-Time Under-Base Terrain Reconstruction
Department of Electronic Engineering and Information Science (EEIS), University of Science and Technology of China（电子工程与信息科学系，中国科学技术大学）；LimX Dynamics（LimX动力学）；Hong Kong University of Science and Technology（香港科技大学）；School of Mechanics Engineering, Harbin Institute of Technology (HIT)（机械工程学院，哈尔滨工业大学）；Department of Computing, The Hong Kong Polytechnic University（计算学院，香港理工大学）；Zhejiang University-University of Illinois Urbana-Champaign Institute (ZJUI)（浙江大学-伊利诺伊大学厄巴纳-香槟分校联合研究所）
Generating stable walking gaits that yield natural locomotion when executed on robotic-assistive devices is a challenging task that often requires hand-tuning by domain experts. This paper presents an alternative methodology, where we propose the addition of musculoskeletal models directly into the gait generation process to intuitively shape the resulting behavior. In particular, we construct a multi-domain hybrid system model that combines the system dynamics with muscle models to represent natural multicontact walking. Provably stable walking gaits can then be generated for this model via t…
