Real-time motion tracking of kinematic chains is a key prerequisite in the control of, e.g., robotic actuators and autonomous vehicles and also has numerous biomechanical applications. In recent years, it has been shown that, by placing inertial sensors on segments that are connected by rotational joints, the motion of that kinematic chain can be tracked accurately. These methods specifically avoid using magnetometer measurements, which are known to be unreliable since the magnetic field at the different sensor locations is typically different. They rely on the assumption that the motion of the kinematic chain is sufficiently rich to assure observability of the relative pose. However, a formal investigation of this crucial requirement has not yet been presented, and no specific conditions for observability have so far been given. In this work, we present an observability analysis and show that the relative pose of the body segments is indeed observable under a very mild condition on the motion. We support our results by simulation studies, in which we employ a state estimator that neither uses magnetometer measurements nor additional sensors and does not impose assumptions on the accelerometer to measure only the direction of gravity, nor on the range of motion or degrees of freedom of the joints. We investigate the effect of the amount of excitation and of stationary periods in the data on the accuracy of the estimates. We then use experimental data from two mechanical joints as well as from a human gait experiment to validate the observability criterion in practice and to show that small excitation levels are sufficient for obtaining accurate estimates even in the presence of time periods during which the motion is not observable.
Zhejiang University（浙江大学）；Alibaba-Zhejiang University Joint Institute of Frontier Technologies（阿里巴巴-浙江大学前沿技术联合研究院）
While visual localization or SLAM has witnessed great progress in past decades, when deploying it on a mobile robot in practice, few works have explicitly considered the kinematic (or dynamic) constraints of the real robotic system when designing state estimators. To promote the practical deployment of current state-of-the-art visual-inertial localization algorithms, in this work we propose a low-cost kinematics-constrained localization system particularly for a skid-steering mobile robot. In particular, we derive in a principle way the robot's kinematic constraints based on the instantaneous …
We present an open-source Visual-Inertial-Leg Odometry (VILO) state estimation solution, Cerberus, for legged robots that estimates position precisely on various terrains in real time using a set of standard sensors, including stereo cameras, IMU, joint encoders, and contact sensors. In addition to estimating robot states, we also perform online kinematic parameter calibration and contact outlier rejection to substantially reduce position drift. Hardware experiments in various indoor and outdoor environments validate that calibrating kinematic parameters within the Cerberus can reduce estimati…
Zhejiang University（浙江大学）；University of Technology Sydney（悉尼科技大学）
Drift-free localization is essential for autonomous vehicles. In this paper, we address the problem by proposing a filter-based framework, which integrates the visual-inertial odometry and the measurements of the features in the pre-built map. In this framework, the transformation between the odometry frame and the map frame is augmented into the state and estimated on the fly. Besides, we maintain only the keyframe poses in the map and employ Schmidt extended Kalman filter to update the state partially, so that the uncertainty of the map information can be consistently considered with low com…
TANGO-VIO: Triangulation-Aware Navigation with Guaranteed Feature-Observability for Visual-Inertial Odometry
Istanbul Technical University（伊斯坦布尔理工大学）；Aviation Institute, Istanbul Technical University（伊斯坦布尔理工大学航空学院）；Aerospace Research Center, Istanbul Technical University（伊斯坦布尔理工大学航空航天研究中心）
Inertial measurement units are commonly used in a growing number of application fields to track or capture motions of kinematic chains, such as human limbs, exoskeletons or robotic actuators. A major challenge is the presence of magnetic disturbances that result in unreliable magnetometer readings. Recent research revealed that this problem can be overcome by exploitation of kinematic constraints. While typically each segment of the kinematic chain is equipped with an IMU, a novel approach called sparse inertial motion tracking aims at infering the complete motion states from measurements of a…
Aerospace Information Research Institute, Chinese Academy of Sciences（中国科学院空天信息创新研究院）；School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences（中国科学院大学电子电气与通信工程学院）
This paper addresses the long-standing open problem of observability of mass and inertia plant parameters in the adaptive identification (AID) of second-order nonlinear models of 6 degree-of-freedom rigid-body dynamical systems subject to externally applied forces and moments. Although stable methods for AID of plant parameters for this class of systems, as well numerous approaches to stable model-based direct adaptive trajectory-tracking control of such systems, have been reported, these studies have been unable to prove analytically that the adaptive parameter estimates converge to the true …
Georgia Institute of Technology（佐治亚理工学院）；Florida Institute for Human & Machine Cognition（佛罗里达人机认知研究所）；University of West Florida（西佛罗里达大学）
Legged robot locomotion is a challenging task due to a myriad of sub-problems, such as the hybrid dynamics of foot contact and the effects of the desired gait on the terrain. Accurate and efficient state estimation of the floating base and the feet joints can help alleviate much of these issues by providing feedback information to robot controllers. Current state estimation methods are highly reliant on a conjunction of visual and inertial measurements to provide real-time estimates, thus being handicapped in perceptually poor environments. In this work, we show that by leveraging the kinemati…
Wuhan University（武汉大学）；ETH Zurich（苏黎世联邦理工学院）；Washington University, St. Louis（圣路易斯华盛顿大学）
State estimation problems without absolute position measurements routinely arise in navigation of unmanned aerial vehicles, autonomous ground vehicles, etc., whose proper operation relies on accurate state estimates and reliable covariances. Unaware of absolute positions, these problems have immanent unobservable directions. Traditional causal estimators, however, usually gain spurious information on the unobservable directions, leading to over-confident covariance inconsistent with actual estimator errors. The consistency problem of fixed-lag smoothers (FLSs) has only been attacked by the fir…
This paper introduces a novel proprioceptive state estimator for legged robots based on a learned displacement measurement from IMU data. Recent research in pedestrian tracking has shown that motion can be inferred from inertial data using convolutional neural networks. A learned inertial displacement measurement can improve state estimation in challenging scenarios where leg odometry is unreliable, such as slipping and compressible terrains. Our work learns to estimate a displacement measurement from IMU data which is then fused with traditional leg odometry. Our approach greatly reduces the …
MinJointTracker: Real-time inertial kinematic chain tracking with joint position estimation and minimal state size
German Research Center for Artificial Intelligence (DFKI)（德国人工智能研究中心）；Rheinland-Pfälzische Technische Universität Kaiserslautern-Landau (RPTU)（莱茵-瓦尔兹技术大学凯泽斯劳滕-兰道）；IT & Engineering, IU Internationale Hochschule Erfurt（IT与工程，国际高等学院埃弗特）
This paper presents an algorithm that makes novel use of distance measurements alongside a constrained Kalman filter to accurately estimate pelvis, thigh, and shank kinematics for both legs during walking and other body movements using only three wearable inertial measurement units (IMUs). The distance measurement formulation also assumes hinge knee joint and constant body segment length, helping produce estimates that are near or in the constraint space for better estimator stability. Simulated experiments shown that inter-IMU distance measurement is indeed a promising new source of informati…
Strapdown inertial navigation research involves the parameterization and computation of the attitude, velocity and position of a rigid body in a chosen reference frame. The community has long devoted to finding the most concise and efficient representation for the strapdown inertial navigation system (INS). The current work is motivated by simplifying the existing dual quaternion representation of the kinematic model. This paper proposes a compact and elegant representation of the body's attitude, velocity and position, with the aid of a devised trident quaternion tool in which the position is…
Instituto de Ciencias Matemáticas (CSIC-UAM-UCM-UC3M)（数学科学研究所（CSIC-UAM-UCM-UC3M））；University of Southern Denmark（南丹麦大学）；Universidad Politécnica de Madrid（马德里理工大学）
We consider the localization problem between agents while they run a formation control algorithm. These algorithms typically demand from the agents the information about their relative positions with respect to their neighbors. We assume that this information is not available. Therefore, the agents need to solve the observability problem of reconstructing their relative positions based on other measurements between them. We first model the relative kinematics between the agents as a left-invariant control system so that we can exploit its appealing properties to solve the observability problem…
Inertial Line-Of-Sight Stabilization Using a 3-DOF Spherical Parallel Manipulator with Coaxial Input Shafts
Safran Electronics & Defense（赛峰电子与防务公司）；Sorbonne Université（索邦大学）；Université de Paris Cité（巴黎西岱大学）；Inria Paris（法国国家信息与自动化研究所巴黎分部）；Nantes Université（南特大学）；École Centrale Nantes（南特中央理工学院）；CNRS（法国国家科学研究中心）
本文研究使用3-RRR Spherical Parallel Manipulator 实现惯性 Line Of Sight 稳定，通过运动学分析确保奇异轨迹远离工作空间，并基于 MATLAB Simulink 与 SimMechanics 模型实施控制策略以稳定视线。
UNSW Sydney（悉尼新南威尔士大学）；University College Dublin（都柏林大学）
This paper presents an algorithm that makes novel use of a Lie group representation of position and orientation alongside a constrained extended Kalman filter (CEKF) to accurately estimate pelvis, thigh, and shank kinematics during walking using only three wearable inertial sensors. The algorithm iterates through the prediction update (kinematic equation), measurement update (pelvis height, zero velocity update, flat-floor assumption, and covariance limiter), and constraint update (formulation of hinged knee joints and ball-and-socket hip joints). The paper also describes a novel Lie group for…
This paper deals with the problem of full state estimation for vehicles navigating in a three dimensional space. We assume that the vehicle is equipped with an Inertial Measurement Unit (IMU) providing body-frame measurements of the angular velocity, the specific force, and the Earth's magnetic field. Moreover, we consider available sensors that provide partial or full information about the position of the vehicle. Examples of such sensors are those which provide full position measurements (e.g., GPS), range measurements (e.g., Ultra-Wide Band (UWB) sensors), inertial-frame bearing measurement…
