首页/论文/2103.04131

arXiv 2103.041312022-09-11cs.RO

Omni-swarm: A Decentralized Omnidirectional Visual-Inertial-UWB State Estimation System for Aerial Swarms

Hong Kong University of Science and Technology（香港科技大学）

Hao Xu, Yichen Zhang, Boyu Zhou, Luqi Wang, Xinjie Yao, Guotao Meng, Shaojie Shen

备注：: The paper is accepted by IEEE Transactions on Robotics (T-RO, 2022)
DOI：: 10.1109/TRO.2022.3182503

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

英文摘要相关论文

英文摘要：

Decentralized state estimation is one of the most fundamental components of autonomous aerial swarm systems in GPS-denied areas yet it still remains a highly challenging research topic. Omni-swarm, a decentralized omnidirectional visual-inertial-UWB state estimation system for aerial swarms, is proposed in this paper to address this research niche. To solve the issues of observability, complicated initialization, insufficient accuracy, and lack of global consistency, we introduce an omnidirectional perception front-end in Omni-swarm. It consists of stereo wide-FoV cameras and ultra-wideband sensors, visual-inertial odometry, multi-drone map-based localization, and visual drone tracking algorithms. The measurements from the front-end are fused with graph-based optimization in the back-end. The proposed method achieves centimeter-level relative state estimation accuracy while guaranteeing global consistency in the aerial swarm, as evidenced by the experimental results. Moreover, supported by Omni-swarm, inter-drone collision avoidance can be accomplished without any external devices, demonstrating the potential of Omni-swarm as the foundation of autonomous aerial swarms.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

Towards Efficient Full Pose Omnidirectionality with Overactuated MAVs

Autonomous Systems Lab, ETH Z\" u rich, Switzerland

Omnidirectional MAVs are a growing field, with demonstrated advantages for aerial interaction and uninhibited observation. While systems with complete pose omnidirectionality and high hover efficiency have been developed independently, a robust system that combines the two has not been demonstrated to date. This paper presents VoliroX: a novel omnidirectional vehicle that can exert a wrench in any orientation while maintaining efficient flight configurations. The system design is presented, and a 6 DOF geometric control that is robust to singularities. Flight experiments further demonstrate an…

2020-04-06cs.RO

全向差速驱动：轮式机器人同时重构与全向移动

Omni Differential Drive for Simultaneous Reconfiguration and Omnidirectional Mobility of Wheeled Robots

Southern University of Science and Technology（南方科技大学）；The Chinese University of Hong Kong（香港中文大学）；University of Alberta（阿尔伯塔大学）

本文提出全向差速驱动模型，利用横向差速调整轮距，使轮式机器人同时实现重构与全向移动，并通过原型和实验验证其可行性与控制有效性。

2024-12-14cs.RO

Design and optimal control of a tiltrotor micro aerial vehicle for efficient omnidirectional flight

ETH Zürich（苏黎世联邦理工学院）

Omnidirectional micro aerial vehicles are a growing field of research, with demonstrated advantages for aerial interaction and uninhibited observation. While systems with complete pose omnidirectionality and high hover efficiency have been developed independently, a robust system that combines the two has not been demonstrated to date. This paper presents the design and optimal control of a novel omnidirectional vehicle that can exert a wrench in any orientation while maintaining efficient flight configurations. The system design is motivated by the result of a morphology design optimization. …

2020-03-20cs.RO

OmniNxt：一款具备全向视觉感知能力的完全开源紧凑型空中机器人

OmniNxt: A Fully Open-source and Compact Aerial Robot with Omnidirectional Visual Perception

The Hong Kong University of Science and Technology（香港科技大学）

针对全向视场相机增加空中机器人系统复杂性的问题，本文提出完全开源的 OmniNxt 平台，通过 NxtPX4 飞行控制器、多鱼眼相机组及配套软件实现低资源占用的精确定位与实时稠密建图，并经过真实实验验证。

2024-03-29cs.RO

Search-based Kinodynamic Motion Planning for Omnidirectional Quadruped Robots

Zhejiang University（浙江大学）

Autonomous navigation has played an increasingly significant role in quadruped robot system. However, most existing works on quadruped robots navigation using traditional search-based or sample-based methods do not consider the kinodynamic characteristics of quadruped robots, generating kinodynamically infeasible parts, that are difficult to track. In this paper, we introduce a complete navigation system considering the omnidirectional abilities of quadruped robots. First, we use kinodynamic path finding method to obtain smooth, dynamically feasible, time-optimal initial paths and add collisio…

2021-03-11cs.RO

Towards 6DoF Bilateral Teleoperation of an Omnidirectional Aerial Vehicle for Aerial Physical Interaction

ETH Zürich（苏黎世联邦理工学院）

Bilateral teleoperation offers an intriguing solution towards shared autonomy with aerial vehicles in contact-based inspection and manipulation tasks. Omnidirectional aerial robots allow for full pose operations, making them particularly attractive in such tasks. Naturally, the question arises whether standard bilateral teleoperation methodologies are suitable for use with these vehicles. In this work, a fully decoupled 6DoF bilateral teleoperation framework for aerial physical interaction is designed and tested for the first time. The method is based on the well established rate control, rece…

2022-03-07cs.RO

更多相关论文收起更多论文

CObRaSO: Compliant Omni-Direction Bendable Hybrid Rigid and Soft OmniCrawler Module

Robotics Research Center, IIIT-Hyderabad（IIIT-海得拉巴机器人研究中心）

This paper presents a novel design of an Omnidirectional bendable Omnicrawler module- CObRaSO. Along with the longitudinal crawling and sideways rolling motion, the performance of the OmniCrawler is further enhanced by the introduction of Omnidirectional bending within the module, which is the key contribution of this paper. The Omnidirectional bending is achieved by an arrangement of two independent 1-DOF joints aligned at 90? w.r.t each other. The unique characteristic of this module is its ability to crawl in Omnidirectionally bent configuration which is achieved by a novel design of a 2-DO…

2018-03-12cs.RO

MPC with Learned Residual Dynamics with Application on Omnidirectional MAVs

ETH Zurich（苏黎世联邦理工学院）

The growing field of aerial manipulation often relies on fully actuated or omnidirectional micro aerial vehicles (OMAVs) which can apply arbitrary forces and torques while in contact with the environment. Control methods are usually based on model-free approaches, separating a high-level wrench controller from an actuator allocation. If necessary, disturbances are rejected by online disturbance observers. However, while being general, this approach often produces sub-optimal control commands and cannot incorporate constraints given by the platform design. We present two model-based approaches …

2022-07-04cs.RO

An Omnidirectional Aerial Manipulation Platform for Contact-Based Inspection

ETH Zürich（苏黎世联邦理工学院）

This paper presents an omnidirectional aerial manipulation platform for robust and responsive interaction with unstructured environments, toward the goal of contact-based inspection. The fully actuated tilt-rotor aerial system is equipped with a rigidly mounted end-effector, and is able to exert a 6 degree of freedom force and torque, decoupling the system's translational and rotational dynamics, and enabling precise interaction with the environment while maintaining stability. An impedance controller with selective apparent inertia is formulated to permit compliance in certain degrees of free…

2019-07-10cs.RO

GelSphere：一种基于全方位滚动视觉的触觉传感器，用于在线3D重建和法向力估计

GelSphere: An Omnidirectional Rolling Vision-Based Tactile Sensor for Online 3D Reconstruction and Normal Force Estimation

本文提出GelSphere，一种基于视觉的触觉传感器，用于实时连续表面扫描。通过内部钢球形成轴承层，实现全方位滚动，提升3D重建和法向力估计的精度。

2026-03-14cs.RO

Reduced egomotion estimation drift using omnidirectional views

Estimation of camera motion from a given image sequence becomes degraded as the length of the sequence increases. In this letter, this phenomenon is demonstrated and an approach to increase the estimation accuracy is proposed. The proposed method uses an omnidirectional camera in addition to the perspective one and takes advantage of its enlarged view by exploiting the correspondences between the omnidirectional and perspective images. Simulated and real image experiments show that the proposed approach improves the estimation accuracy.

2013-12-01cs.CVcs.RO

利用预训练深度基础模型提升全向立体匹配性能

Boosting Omnidirectional Stereo Matching with a Pre-trained Depth Foundation Model

École Polytechnique Fédérale de Lausanne (EPFL)（瑞士联邦理工学院）；Technical University of Darmstadt, Department of Computer Science（德累斯顿技术大学计算机科学系）

针对现有全向立体匹配方法因真实数据稀缺导致精度有限的问题，提出DFI-OmniStereo方法，结合预训练单目深度基础模型与两阶段训练策略，在Helvipad数据集上实现SOTA，视差MAE较此前最优方法降低约16%。

2025-10-28cs.AIcs.CVcs.LG

Helvipad：用于全方位立体深度估计的真实世界数据集

Helvipad: A Real-World Dataset for Omnidirectional Stereo Depth Estimation

EPFL（洛桑联邦理工学院）；TU Darmstadt（达姆施塔特工业大学）

针对全方位立体深度估计数据匮乏问题，构建含4万帧真实世界视频的Helvipad数据集，通过相机与LiDAR提供深度标签，并改进立体模型以提升全方位深度估计精度。

2025-03-25cs.AIcs.CVcs.RO

基于圆柱体素的全向深度辅助占用预测用于自动驾驶

Omnidirectional Depth-Aided Occupancy Prediction based on Cylindrical Voxel for Autonomous Driving

针对自动驾驶3D感知的几何模糊问题，提出基于圆柱体素和全向深度估计的Sketch-Coloring框架OmniDepth-Occ，并构建大规模鱼眼相机数据集，显著提升了3D感知性能。

2025-03-26cs.CVcs.RO

ODD：用于轮式机器人同时重构与全向移动的全向差速驱动

ODD: Omni Differential Drive for Simultaneous Reconfiguration and Omnidirectional Mobility of Wheeled Robots

Southern University of Science and Technology（南方科技大学）；The Chinese University of Hong Kong（香港中文大学）；University of Alberta（阿尔伯塔大学）

针对传统轮式机器人难以兼顾稳定性、通过性与灵活性的问题，提出受人类运动启发的全向差速驱动（ODD）模型，通过横向差速调整轮距实现重构与全向移动，并经原型和实验验证其可行性与控制有效性。

2024-07-14cs.ROcs.SYeess.SY

Capturing Omni-Range Context for Omnidirectional Segmentation

Karlsruhe Institute of Technology（卡尔斯鲁厄理工学院）；ZEISS（蔡司公司）；Huawei Technologies（华为技术有限公司）

Convolutional Networks (ConvNets) excel at semantic segmentation and have become a vital component for perception in autonomous driving. Enabling an all-encompassing view of street-scenes, omnidirectional cameras present themselves as a perfect fit in such systems. Most segmentation models for parsing urban environments operate on common, narrow Field of View (FoV) images. Transferring these models from the domain they were designed for to 360-degree perception, their performance drops dramatically, e.g., by an absolute 30.0% (mIoU) on established test-beds. To bridge the gap in terms of FoV a…

2021-03-09cs.CVcs.ROeess.IV