The robotic shape control of deformable linear objects has garnered increasing interest within the robotics community. Despite recent progress, the majority of shape control approaches can be classified into two main groups: open-loop control, which relies on physically realistic models to represent the object, and closed-loop control, which employs less precise models alongside visual data to compute commands. In this work, we present a novel 3D shape control approach that includes the physically realistic Cosserat model into a closed-loop control framework, using vision feedback to rectify errors in real-time. This approach capitalizes on the advantages of both groups: the realism and precision provided by physics-based models, and the rapid computation, therefore enabling real-time correction of model errors, and robustness to elastic parameter estimation inherent in vision-based approaches. This is achieved by computing a deformation Jacobian derived from both the Cosserat model and visual data. To demonstrate the effectiveness of the method, we conduct a series of shape control experiments where robots are tasked with deforming linear objects towards a desired shape.
DeformX: A Versatile Co-Simulation Framework for Deformable Linear Objects
The Robotics Institute, Carnegie Mellon University(卡内基梅隆大学机器人研究所);Department of Mechanical Engineering, Carnegie Mellon University(卡内基梅隆大学机械工程系);School of Ocean and Civil Engineering, Shanghai Jiao Tong University(上海交通大学海洋与土木工程学院);Zhiyuan College, Shanghai Jiao Tong University(上海交通大学致远学院);John A. Paulson School of Engineering and Applied Sciences, Harvard University(哈佛大学约翰·A·保尔森工程与应用科学学院)
提出DeformX框架,集成Cosserat杆物理引擎与NVIDIA Isaac Sim,实现可变形线性物体的物理精确与视觉真实仿真,支持机器人学习,在真实线缆分割和绳索摆动任务中验证了仿真到现实的迁移能力。
Coordinated Manipulation of Hybrid Deformable-Rigid Objects in Constrained Environments
Department of Mechanical and Nuclear Engineering, Khalifa University(卡利法大学机械与核工程系);Khalifa University Center for Autonomous Robotic Systems (KUCARS)(卡利法大学自主机器人系统中心);Department of Computer Science, Khalifa University(卡利法大学计算机科学系)
Phase-Conditioned Imitation Learning with Autonomous Failure Recovery for Robust Deformable Object Manipulation
Department of Robotics, Tohoku University(东大理学院机器人系);JC STEM Lab of Robotics for Soft Materials, the Department of Electrical and Computer Engineering, Faculty of Engineering, The University of Hong Kong(香港大学工程学院电气与计算机工程系软材料机器人实验室)
Controlling Deformable Objects with Non-negligible Dynamics: a Shape-Regulation Approach to End-Point Positioning
Department of Cognitive Robotics, Delft University of Technology(认知机器人系,代尔夫特理工大学);Institute of Robotics and Mechatronics, German Aerospace Center (DLR)(机器人与机电系统研究所,德国航空航天中心(DLR))
Contact-Stable Deformable Tissue Simulation Using Implicit Integration and Live-Pose Grasp Constraints for Laparoscopic Surgery Robot Policy Evaluation
Seoul National University Hospital(首尔大学医院);Rosota Inc.(Rosota公司);Seoul National University College of Medicine(首尔大学医学院);Seoul National University(首尔大学);Institute of Convergence Medicine with Innovative Technology, Seoul National University Hospital(首尔大学医院创新技术融合医学研究所);Eulji University College of Medicine(乙支大学医学院);Chungang University(中央大学)
UPETrack: Unidirectional Position Estimation for Tracking Occluded Deformable Linear Objects
Huazhong University of Science and Technology(华中科技大学);Foshan Institute of Intelligent Equipment Technology(佛山智能装备技术研究所);School of Artificial Intelligence and Robotics(人工智能与机器人学院)
SoftVTBench: A Deformation-Aware Visuo-Tactile Dataset and Benchmark for Deformable-Object Manipulation
Tuojing Intelligence(拓境智能);Tsinghua University(清华大学);Southeast University(东南大学);Stevens Institute of Technology(斯蒂文斯理工学院);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));University of Manchester(曼彻斯特大学);Simple AI;Imperial College London(帝国理工学院);Carnegie Mellon University(卡内基梅隆大学);Zhejiang University(浙江大学);Beihang University(北京航空航天大学);The University of Hong Kong(香港大学)
Prescribed Performance Control of Deformable Object Manipulation in Spatial Latent Space
Department of Mechanical Engineering, The Hong Kong Polytechnic University(机械工程系,香港理工大学);T Stone Robotics Institute, Department of Mechanical and Automation Eng., The Chinese University of Hong Kong(T Stone机器人研究所,机械与自动化工程系,香港中文大学)
Planning-Query-Guided Model Generation for Model-Based Deformable Object Manipulation
Department of Computer Science, Stevens Institute of Technology(斯蒂文斯理工学院计算机科学系);Department of Robotics, University of Michigan(密歇根大学机器人学系);Robotics Institute, Carnegie Mellon University(卡内基梅隆大学机器人研究所)
Miniaturized Circuitry for Capacitive Self-sensing and Closed-loop Control of Soft Electrostatic Transducers
University of Colorado(科罗拉多大学);Materials Science and Engineering Program, University of Colorado(科罗拉多大学材料科学与工程项目);Department of Electrical Engineering, University of Colorado(科罗拉多大学电气工程系);Department of Computer Science, University of Colorado(科罗拉多大学计算机科学系)