Exploring and modeling heterogeneous elastic surfaces requires multiple interactions with the environment and a complex selection of physical material parameters. The most common approaches model deformable properties from sets of offline observations using computationally expensive force-based simulators. In this work we present an online probabilistic framework for autonomous estimation of a deformability distribution map of heterogeneous elastic surfaces from few physical interactions. The method takes advantage of Gaussian Processes for constructing a model of the environment geometry surrounding a robot. A fast Position-based Dynamics simulator uses focused environmental observations in order to model the elastic behavior of portions of the environment. Gaussian Process Regression maps the local deformability on the whole environment in order to generate a deformability distribution map. We show experimental results using a PrimeSense camera, a Kinova Jaco2 robotic arm and an Optoforce sensor on different deformable surfaces.
TAIL: A Terrain-Aware Multi-Modal SLAM Dataset for Robot Locomotion in Deformable Granular Environments
Southern University of Science and Technology (SUSTech)(南方科技大学);Shenzhen Key Laboratory of Biomimetic Robotics and Intelligent Systems(深圳市仿生机器人与智能系统重点实验室);Guangdong Provincial Key Laboratory of Human-Augmentation and Rehabilitation Robotics in Universities(广东省高校人机增强与康复机器人重点实验室)
FLAP: FOV-Constrained Active Perception Planning for Prior-Map-Free 3D Navigation
The State Key Laboratory of Industrial Control Technology, College of Control Science and Engineering, Zhejiang University(浙江大学控制科学与工程学院工业控制技术国家重点实验室);Huzhou Institute, Zhejiang University(浙江大学湖州研究院);Huzhou Key Laboratory of Autonomous System(湖州市自动驾驶系统重点实验室);Shanghai Institute of Special Equipment Inspection and Technical Research Co., Ltd(上海市特种设备监督检验技术研究院有限公司)
MAAP: Multi-Agent Active Perception for Collaborative Manipulation
Carnegie Mellon University(卡内基梅隆大学);Shanghai Jiao Tong University(上海交通大学);University of Science and Technology of China(中国科学技术大学);The University of Hong Kong(香港大学);Sun Yat-sen University(中山大学);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
APREBot: Active Perception System for Reflexive Evasion Robot
School of Computing, National University of Singapore(计算学院,新加坡国立大学);Department of Electrical and Computer Engineering, National University of Singapore(电气与计算机工程系,新加坡国立大学);School of Automation, Beijing Institute of Technology(自动化学院,北京理工大学);School of Computer Science and Engineering, Sun Yat-Sen University(计算机科学与工程学院,中山大学)
Apple: Toward General Active Perception via Reinforcement Learning
Department of Computer Science, TU Darmstadt, Germany(德国图林根大学计算机科学系);LIRIS, CNRS UMR5205, École Centrale de Lyon, France(法国里里萨大学LIRIS实验室);LASR Lab & CeTI, TU Dresden, Germany(德国德累斯顿技术大学LASR实验室);DFKI, Hessian.AI, RIG, and Centre for Cognitive Science, TU Darmstadt, Germany(德国图林根大学DFKI、海德堡人工智能、RIG及认知科学中心)
Active Cross-Modal Visuo-Tactile Perception of Deformable Linear Objects
Dipartimento di Ingegneria, Università degli Studi della Campania Luigi Vanvitelli(工程学院,坎帕尼亚路易吉·范维蒂利大学);Dipartimento di Ingegneria dell’Informazione, Università degli Studi di Padova(信息工程学院,帕多瓦大学)
ROMA: LLM System for Real-World Object-Centric Multi-Sensory Active Perception
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);Beijing Key Laboratory of Research on Large Models and Intelligent Governance(北京大模型与智能治理重点实验室);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Beijing Jiaotong University(北京交通大学);State Key Laboratory of Multimedia Information Processing, Peking University(北京大学多媒体信息处理国家重点实验室);AresoX
Multi-Robot Assembly of Deformable Linear Objects Using Multi-Modal Perception
Chair of Robotics, Artificial Intelligence and Real-time Systems, School of Computation, Information and Technology(机器人学、人工智能与实时系统教授会,计算、信息与技术学院);Institute for Machine Tools and Industrial Management, School of Engineering and Design(机械加工与工业管理研究所,工程与设计学院)
Active Visuo-Tactile Interactive Robotic Perception for Accurate Object Pose Estimation in Dense Clutter
BMW Group(宝马集团);University of Glasgow(格拉斯哥大学);The Imperial College of Science, Technology and Medicine(帝国理工学院);Donders Institute for Brain and Cognition, Radboud University(拉德堡德大学唐德斯脑认知研究所)
CLEVER: Stream-based Active Learning for Robust Semantic Perception from Human Instructions
Institute of Robotics and Mechatronics, German Aerospace Center (DLR)(机器人与机电研究所,德国航空航天中心);Institute for Anthropomatics and Robotics, Karlsruhe Institute of Technology(人机学与机器人研究所,卡尔斯鲁厄技术大学)
A General One-Shot Multimodal Active Perception Framework for Robotic Manipulation: Learning to Predict Optimal Viewpoint
Institute of Robotics and Automatic Information Systems, College of Artificial Intelligence, Nankai University(机器人与自动信息系统研究所,人工智能学院,南开大学);Tianjin Key Laboratory of Intelligent Robotics, Nankai University(智能机器人重点实验室,南开大学);College of Artificial Intelligence, Nankai University(人工智能学院,南开大学);Department of Computing, The Hong Kong Polytechnic University(computing 部门,香港理工大学)
ROBOCYCLE: Autonomous Dual-Arm Robotic Manipulation and Coordination for Recycling Applications
Tecnologico de Monterrey, School of Engineering and Sciences, Department of Computer Science(墨西哥蒙特雷理工大学工程学院与科学学院计算机科学系);National Institute of Advanced Industrial Science and Technology (AIST)(国家先进工业科学与技术研究院)