为了在人类工作者旁边安全高效地运行,协作机器人(cobots)需要具备快速理解被操作物体动力学特性的能力。然而,用于估计完整惯性参数集的传统方法依赖于必然快速且不安全的运动(以获得足够的信噪比)。在本工作中,我们采用了一种替代方法:通过结合视觉和力-力矩测量,我们开发了一种仅需要缓慢或“走-停”式运动的惯性参数辨识算法,因此非常适合在人类周围使用。我们的技术称为同质部件分割(Homogeneous Part Segmentation,HPS),其利用了人造物体通常由不同且同质的部件组成这一观察。我们将基于表面的点聚类方法与基于体积的形状分割算法相结合,以快速生成被操作物体的部件级分割;随后,HPS利用该分割表示来准确估计物体的惯性参数。为了对我们的算法进行基准测试,我们创建并利用了一个新颖的数据集,该数据集包含20种常见车间工具的真实网格、分割点云和惯性参数。最后,我们通过使用低成本协作机械臂自主在线执行复杂的“锤子平衡动作”,展示了HPS在真实世界中的性能和准确性。我们的代码和数据集是开源的,可免费获取。
英文摘要:
To operate safely and efficiently alongside human workers, collaborative robots (cobots) require the ability to quickly understand the dynamics of manipulated objects. However, traditional methods for estimating the full set of inertial parameters rely on motions that are necessarily fast and unsafe (to achieve a sufficient signal-to-noise ratio). In this work, we take an alternative approach: by combining visual and force-torque measurements, we develop an inertial parameter identification algorithm that requires slow or 'stop-and-go' motions only, and hence is ideally tailored for use around humans. Our technique, called Homogeneous Part Segmentation (HPS), leverages the observation that man-made objects are often composed of distinct, homogeneous parts. We combine a surface-based point clustering method with a volumetric shape segmentation algorithm to quickly produce a part-level segmentation of a manipulated object; the segmented representation is then used by HPS to accurately estimate the object's inertial parameters. To benchmark our algorithm, we create and utilize a novel dataset consisting of realistic meshes, segmented point clouds, and inertial parameters for 20 common workshop tools. Finally, we demonstrate the real-world performance and accuracy of HPS by performing an intricate 'hammer balancing act' autonomously and online with a low-cost collaborative robotic arm. Our code and dataset are open source and freely available.
EVIMO2: An Event Camera Dataset for Motion Segmentation, Optical Flow, Structure from Motion, and Visual Inertial Odometry in Indoor Scenes with Monocular or Stereo Algorithms
University of Maryland Institute for Advanced Computer Studies(马里兰大学高级计算机研究所);University of Maryland, College Park(马里兰大学帕克分校)
ManiVid: Unified and Explainable Forensic Analysis of Manipulated Videos
Shanghai Jiao Tong University(上海交通大学);Beijing University of Posts and Telecommunications(北京邮电大学);Fudan University(复旦大学);The Chinese University of Hong Kong(香港中文大学);Shanghai AI Laboratory(上海人工智能实验室);Tsinghua University(清华大学)
GAITEX: Human motion dataset of impaired gait and rehabilitation exercises using inertial and optical sensors
AI for Sensor Data Analytics Research Group(人工智能传感器数据解析研究组);Ulm University of Applied Sciences(乌尔姆应用科学大学);Biomechatronic Research Group(生物机械研究组);Institute of Computer Science(计算机科学研究所)
RGB-D-Inertial SLAM in Indoor Dynamic Environments with Long-term Large Occlusion
University of Edinburgh(爱丁堡大学);Bosch Center for Artificial Intelligence(博世人工智能中心);Shenzhen Institute of Artificial Intelligence and Robotics for Society(深圳人工智能与机器人研究院);Touchlab Limited(触觉实验室有限公司);the Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
3D Modeling and Automated Measurement of Concrete Cracks via Segment Anything Refinement and Visual Inertial LiDAR Fusion
School of Civil Engineering(土木工程学院);Central South University(中南大学);Hunan Provincial Key Laboratory for Disaster Prevention and Mitigation of Rail Transit Engineering Structures(湖南省铁路工程结构灾害预防与 mitigation 工程结构重点实验室);Nvidia;School of Computing(计算学院);Newcastle University(新castle大学)
Stereo obstacle detection for unmanned surface vehicles by IMU-assisted semantic segmentation
University of Ljubljana, Faculty of Computer and Information Science(卢布尔雅那大学计算机与信息科学学院);University of Ljubljana, Faculty of Electrical Engineering(卢布尔雅那大学电气工程学院)
M-SEVIQ: A Multi-band Stereo Event Visual-Inertial Quadruped-based Dataset for Perception under Rapid Motion and Challenging Illumination
Shanghai Key Laboratory of Navigation & Location Based Services, Shanghai Jiao Tong University(上海导航与基于位置的服务关键实验室,上海交通大学);Beijing Aerospace Microsystem and Information Technology Research Institute(北京航天微系统与信息技术研究所)
LiDAR-Inertial Odometry in Dynamic Driving Scenarios using Label Consistency Detection
Institute of Artificial Intelligence, Huazhong University of Science and Technology(华中科技大学人工智能研究院);Electronic Information and Communications, Huazhong University of Science and Technology(华中科技大学电子信息与通信学院)