In this work we study the problem of exploring surfaces and building compact 3D representations of the environment surrounding a robot through active perception. We propose an online probabilistic framework that merges visual and tactile measurements using Gaussian Random Field and Gaussian Process Implicit Surfaces. The system investigates incomplete point clouds in order to find a small set of regions of interest which are then physically explored with a robotic arm equipped with tactile sensors. We show experimental results obtained using a PrimeSense camera, a Kinova Jaco2 robotic arm and Optoforce sensors on different scenarios. We then demonstrate how to use the online framework for object detection and terrain classification.
Contact SLAM: An Active Tactile Exploration Policy Based on Physical Reasoning Utilized in Robotic Fine Blind Manipulation Tasks
Research Center for Intelligent Robotics(智能机器人研究中心);National Key Laboratory of Aerospace Flight Dynamics(航空飞行动力学国家重点实验室);Shaanxi Province Innovation Team of Intelligent Robotic Technology(陕西省智能机器人技术创新团队);School of Astronautics, Northwestern Polytechnical University(航空学院,西北工业大学)
All Roads Lead to Rome: Flow-driven Multi-Anchor Exploration for Open-Environment Active 3D Mapping
School of Artificial Intelligence, Tianjin University(天津大学人工智能学院);School of Computer Science and Information Engineering, Hefei University of Technology(合肥工业大学计算机与信息工程学院)
Institute for AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院(AIR));School of Intelligence Science and Technology, Peking University(北京大学智能科学与技术学院)
Max Planck Institute for Human Cognitive and Brain Sciences(马克斯·普朗克人类认知与脑科学研究所);Center for Scalable Data Analytics and Artificial Intelligence (ScaDS.AI)(可扩展数据分析与人工智能中心);Multiscale Biology(多尺度生物学研究所);Georg-August-Universität Göttingen(哥廷根大学)
SEA: Semantic Map Prediction for Active Exploration of Uncertain Areas
School of Computer Science, Nanjing University(南京大学计算机科学学院);School of Intelligence Science and Technology, Nanjing University(南京大学智能科学与技术学院);Cardiff University(卡地夫大学)
IMPACT: An Implicit Active-Set Augmented Lagrangian for Fast Contact-Implicit Trajectory Optimization
PEARL Lab, Dept. of Computer Science, TU Darmstadt, Germany(图腾实验室,计算机科学系,图恩大学,德国);Hessian.AI, Darmstadt, Germany(海森AI,图恩,德国);Robotics Institute Germany (RIG)(德国机器人研究所(RIG))
IR2: Implicit Rendezvous for Robotic Exploration Teams under Sparse Intermittent Connectivity
Department of Mechanical Engineering, College of Design and Engineering, National University of Singapore(机械工程系,设计与工程学院,新加坡国立大学);Singapore Technologies Engineering Ltd(新加坡科技工程有限公司)
Active Inference in Contextual Multi-Armed Bandits for Autonomous Robotic Exploration
Smead Aerospace Engineering Sciences Department, University of Colorado Boulder(科罗拉多大学博尔德分校航空航天工程科学系);Jet Propulsion Laboratory, California Institute of Technology(加州理工学院喷气推进实验室);Astrophysical & Planetary Sciences Department, University of Colorado Boulder(科罗拉多大学博尔德分校天体物理与行星科学系)
Laboratoire des Sciences du Numérique de Nantes (LS2N), CNRS(劳伦斯数字科学南特实验室(LS2N),CNRS);Ecole Centrale de Nantes (ECN)(南特中央理工学院(ECN));University of Genoa(热那亚大学)
STAIR: Semantic-Targeted Active Implicit Reconstruction
Institute of Geodesy and Geoinformation, University of Bonn(波恩大学大地测量与地理信息研究所);Lamarr Institute for Machine Learning and Artificial Intelligence(拉马尔机器学习与人工智能研究所)
MATT-Diff: Multimodal Active Target Tracking by Diffusion Policy
Department of Computer Science and Systems Engineering, Kobe University(神户大学计算机科学与系统工程系);Department of Electrical and Computer Engineering, University of California San Diego(加州大学圣地亚哥分校电子与计算机工程系)
Quadrupeds for Planetary Exploration: Field Testing Control Algorithms on an Active Volcano
Robotics Innovation Center, DFKI GmbH(机器人创新中心,DFKI GmbH);German Aerospace Center, Institute of Space Systems(德国航空航天中心,空间系统研究所);University of Bremen(不莱梅大学)
Active Implicit Object Reconstruction using Uncertainty-guided Next-Best-View Optimization
School of Mechanical Engineering and Automation, Harbin Institute of Technology Shenzhen(哈尔滨工业大学(深圳)机械工程与自动化学院);Shenzhen University General Hospital(深圳大学总医院)
Learning Soft Robotic Dynamics with Active Exploration
Soft Robotics Lab, D-MAVT, ETH Zurich(软机器人实验室,ETH Zurich);Learning & Adaptive Systems Group, D-INFK, ETH Zurich(学习与自适应系统组,ETH Zurich);ETH AI Center, ETH Zurich(ETH人工智能中心,ETH Zurich)