We present Simitate --- a hybrid benchmarking suite targeting the evaluation of approaches for imitation learning. A dataset containing 1938 sequences where humans perform daily activities in a realistic environment is presented. The dataset is strongly coupled with an integration into a simulator. RGB and depth streams with a resolution of 960$\mathbb{\times}$540 at 30Hz and accurate ground truth poses for the demonstrator's hand, as well as the object in 6 DOF at 120Hz are provided. Along with our dataset we provide the 3D model of the used environment, labeled object images and pre-trained models. A benchmarking suite that aims at fostering comparability and reproducibility supports the development of imitation learning approaches. Further, we propose and integrate evaluation metrics on assessing the quality of effect and trajectory of the imitation performed in simulation. Simitate is available on our project website: \url{https://agas.uni-koblenz.de/data/simitate/}.
KOI: Accelerating Online Imitation Learning via Hybrid Key-state Guidance
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Northwestern Polytechnical University(西北工业大学);Institute of Artificial Intelligence, China Telecom Corp Ltd(中国电信股份有限公司人工智能研究院)
Mastering Contact-rich Tasks by Combining Soft and Rigid Robotics with Imitation Learning
Cognitive Robotics, Delft University of Technology(德鲁特理工大学认知机器人学);Bioinspired Soft Robotics Lab, Istituto Italiano di Tecnologia(意大利技术研究院仿生软机器人实验室);Technology Innovation Institute (TII)(技术创新研究所);Institute of Robotics and Mechatronics, German Aerospace Center (DLR)(德国航空航天中心机器人与机电研究所)
Prompting Multi-Modal Tokens to Enhance End-to-End Autonomous Driving Imitation Learning with LLMs
University of Technology Sydney(悉尼科技大学);Australia Artificial Intelligence Institute(澳大利亚人工智能研究院);School of Computer Science(计算机学院);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))
iCOIL: Scenario Aware Autonomous Parking Via Integrated Constrained Optimization and Imitation Learning
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学);University of Hong Kong(香港大学);University of Macau(澳门大学)
Memorized action chunking with Transformers: Imitation learning for vision-based tissue surface scanning
Imperial College London(帝国理工学院);Hamlyn Centre for Robotic Surgery(哈姆林机器人外科中心);Institute of Global Health Innovation(全球健康创新研究所);Department of Surgery and Cancer(外科与癌症系)
Phase-Conditioned Imitation Learning with Autonomous Failure Recovery for Robust Deformable Object Manipulation
Department of Robotics, Tohoku University(东大理学院机器人系);JC STEM Lab of Robotics for Soft Materials, the Department of Electrical and Computer Engineering, Faculty of Engineering, The University of Hong Kong(香港大学工程学院电气与计算机工程系软材料机器人实验室)
PRIMAL: Pathfinding via Reinforcement and Imitation Multi-Agent Learning
Carnegie Mellon University(卡内基梅隆大学);Commonwealth Scientific and Industrial Research Organisation (CSIRO)(联邦科学与工业研究组织(CSIRO));University of Southern California(南加州大学)
Simulation of Adaptive Running with Flexible Sports Prosthesis using Reinforcement Learning of Hybrid-link System
Department of Biological Sciences, The University of Tokyo(东京大学生物科学系);Institute of Systems and Information Engineering, University of Tsukuba(茨城大学系统与信息工程研究所)
HTNav: A Hybrid Navigation Framework with Tiered Structure for Urban Aerial Vision-and-Language Navigation
Nanjing University of Aeronautics and Astronautics(南京航空航天大学);Key Laboratory of Brain-Machine Intelligence Technology, Ministry of Education(教育部脑机智能技术重点实验室)
CAFE-AD: Cross-Scenario Adaptive Feature Enhancement for Trajectory Planning in Autonomous Driving
Institute of Advanced Technology, University of Science and Technology of China (USTC)(中国科学技术大学先进技术研究院);Institute of Artificial Intelligence, Hefei Comprehensive National Science Center(合肥综合性国家科学中心人工智能研究院);School of Artificial Intelligence and Data Science, USTC(中国科学技术大学人工智能与数据科学学院);School of Computer Science and Technology, USTC(中国科学技术大学计算机科学与技术学院)
GSDrive: Reinforcing Driving Policies by Multi-mode Future Trajectory Probing with 3D Gaussian Splatting Environment
Intelligent Space Robotics Laboratory, Skolkovo Institute of Science and Technology(斯克尔科维科学与技术研究院智能空间机器人实验室);Research Center for Intelligent Computing Systems, SKLP, Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所智能计算系统研究中心,SKLP);Department of Electrical and Electronic Engineering, The University of Hong Kong, China(香港大学电子与电气工程系);SuZhou Automotive Research Institute, Tsinghua University(清华大学苏州汽车研究院);School of Vehicle and Mobility, Tsinghua University(清华大学车辆与移动系统学院)