Due to the complex physical properties of granular materials, research on robot learning for manipulating such materials predominantly either disregards the consideration of their physical characteristics or uses surrogate models to approximate their physical properties. Learning to manipulate granular materials based on physical information obtained through precise modelling remains an unsolved problem. In this paper, we propose to address this challenge by constructing a differentiable physics-based simulator for granular materials using the Taichi programming language and developing a learning framework accelerated by demonstrations generated through gradient-based optimisation on non-granular materials within our simulator, eliminating the costly data collection and model training of prior methods. Experimental results show that our method, with its flexible design, trains robust policies that are capable of executing the task of transporting granular materials in both simulated and real-world environments, beyond the capabilities of standard reinforcement learning, imitation learning, and prior task-specific granular manipulation methods.
Physics-informed Imitative Reinforcement Learning for Real-world Driving
Robotics and Autonomous Systems Thrust, Systems Hub, The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州)机器人与自主系统 thrust、系统枢纽);Department of Computer Science and Engineering, School of Engineering, The Hong Kong University of Science and Technology(香港科技大学计算机科学与工程系、工程学院)
Tongji University(同济大学);Shanghai Research Institute for Intelligent Autonomous Systems(上海自主智能无人系统研究院);Purdue University(普渡大学);Nanyang Technological University, Singapore(新加坡南洋理工大学)
FoLD: Force-Informed Learning for Dexterous Articulated Object Manipulation
University of Science and Technology of China(中国科学技术大学);Institute of AI for Industries, Chinese Academy of Sciences(中国科学院人工智能产业研究院);Shenzhen University(深圳大学)
KineDex: Learning Tactile-Informed Visuomotor Policies via Kinesthetic Teaching for Dexterous Manipulation
Tongji University(同济大学);Tsinghua University(清华大学);Shanghai Jiao Tong University(上海交通大学);University of Hong Kong(香港大学);Shanghai Qi Zhi Institute(上海启智研究院);Shanghai AI Lab(上海人工智能实验室)
A physics-informed, vision-based method to reconstruct all deformation modes in slender bodies
School of Electrical and Computer Engineering(电气与计算机工程学院);Georgia Institute of Technology(佐治亚理工学院);Twentieth Century Fox(二十世纪福克斯);Starfleet Academy(星际舰队学院);Tyrell Inc.(泰勒尔公司)
Physics-Informed Reinforcement Learning of Spatial Density Velocity Potentials for Map-Free Racing
Autonomous Robots and Vehicles Laboratory, College of Engineering, Virginia Commonwealth University(弗吉尼亚联邦大学工程学院自主机器人与车辆实验室);Department of Mechanical Engineering, Virginia Tech(弗吉尼亚理工学院机械工程系);Robotics Department, University of Michigan(密歇根大学机器人系)