In robotics, ergodic control extends the tracking principle by specifying a probability distribution over an area to cover instead of a trajectory to track. The original problem is formulated as a spectral multiscale coverage problem, typically requiring the spatial distribution to be decomposed as Fourier series. This approach does not scale well to control problems requiring exploration in search space of more than 2 dimensions. To address this issue, we propose the use of tensor trains, a recent low-rank tensor decomposition technique from the field of multilinear algebra. The proposed solution is efficient, both computationally and storage-wise, hence making it suitable for its online implementation in robotic systems. The approach is applied to a peg-in-hole insertion task requiring full 6D end-effector poses, implemented with a 7-axis Franka Emika Panda robot. In this experiment, ergodic exploration allows the task to be achieved without requiring the use of force/torque sensors.
Autonomous Robotic Tissue Palpation and Abnormalities Characterisation via Ergodic Exploration
Department of Information Engineering and Computer Science, University of Trento(信息工程与计算机科学系,特伦托大学);Department of Industrial Engineering, University of Trento(工业工程系,特伦托大学)
Rapidly Converging Time-Discounted Ergodicity on Graphs for Active Inspection of Confined Spaces
Department of Mechanical Engineering, University of Washington(机械工程系,华盛顿大学);Department of Electrical & Computer Engineering, University of Washington(电气与计算机工程系,华盛顿大学);Naval Undersea Warfare Center(海军水下作战中心);Department of Industrial & Systems Engineering and the Department of Mechanical Engineering, University of Washington(工业与系统工程系和机械工程系,华盛顿大学)
针对连续空间遍历轨迹难跟踪的问题,提出图上时间折扣遍历性度量与凸规划马尔可夫链,并结合 SLAM 贝叶斯检验用于受限空间异常检测。
One Demonstration Is Enough for Real-World Robotic Reinforcement Learning
National Key Laboratory of Cognition and Decision Intelligence for Complex Systems, Institution of Automation, Chinese Academy of Sciences(中国科学院自动化研究所复杂系统认知与决策智能国家重点实验室);Beijing Academy of Artificial Intelligence(北京智源人工智能研究院);PKU-PsiBot Joint Lab(北大-鹏城实验室联合实验室);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Institute for Artificial Intelligence, Peking University(北京大学人工智能研究院)
Vision-Language-Action Jump-Starting for Reinforcement Learning Robotic Agents
University of Applied Science and Arts of Southern Switzerland, Department of Innovative Technologies(瑞士南方应用科学与艺术大学创新技术系);Università della Svizzera Italiana, Faculty of Informatics, Lugano, Switzerland(瑞士意大利大学信息学院,卢加诺,瑞士)