Digital Twins Meet the Koopman Operator: Data-Driven Learning for Robust Autonomy
Automation, Robotics and Mechatronics Lab (ARMLab), Department of Automotive Engineering, Clemson University International Center for Automotive Research (CU-ICAR)(自动化、机器人与机电实验室(ARMLab),汽车工程系,克莱姆森大学国际汽车研究中心(CU-ICAR));Dynamics and Control for Autonomy and Intelligence Lab (DyCo AI Lab), Department of Mechanical Engineering, Clemson University(自主与智能控制实验室(DyCo AI Lab),机械工程系,克莱姆森大学)
Chinmay Vilas Samak, Tanmay Vilas Samak, Ajinkya Joglekar, Umesh Vaidya, Venkat Krovi
备注:
Accepted at IEEE International Conference on Robotics & Automation (ICRA) 2025
Contrary to on-road autonomous navigation, off-road autonomy is complicated by various factors ranging from sensing challenges to terrain variability. In such a milieu, data-driven approaches have been commonly employed to capture intricate vehicle-environment interactions effectively. However, the success of data-driven methods depends crucially on the quality and quantity of data, which can be compromised by large variability in off-road environments. To address these concerns, we present a novel methodology to recreate the exact vehicle and its target operating conditions digitally for domain-specific data generation. This enables us to effectively model off-road vehicle dynamics from simulation data using the Koopman operator theory, and employ the obtained models for local motion planning and optimal vehicle control. The capabilities of the proposed methodology are demonstrated through an autonomous navigation problem of a 1:5 scale vehicle, where a terrain-informed planner is employed for global mission planning. Results indicate a substantial improvement in off-road navigation performance with the proposed algorithm (5.84x) and underscore the efficacy of digital twinning in terms of improving the sample efficiency (3.2x) and reducing the sim2real gap (5.2%).
Autonomy Oriented Digital Twins for Real2Sim2Real Autoware Deployment
Clemson University(克莱姆森大学);Clemson University International Center for Automotive Research (CU-ICAR)(克莱姆森大学国际汽车研究中心);Department of Automotive Engineering, CU-ICAR(克莱姆森大学国际汽车研究中心汽车工程系)
MCTR: Midpoint Corrected Triangulation for Autonomous Racing via Digital Twin Simulation in CARLA
Department of Control Science and Engineering, Zhejiang University, Hangzhou, China(浙江大学控制科学与工程学院);Ningbo Innovation Center, Zhejiang University, Ningbo, China(浙江大学宁波创新中心);Center for Project-Based Learning, D-ITET, ETH Zurich(苏黎世联邦理工学院项目导向学习中心);Technische Universität Wien, Vienna, Austria(维也纳技术大学)
本文提出 MCTR 算法,通过曲率校正移动平均改进轨迹平滑性,并在 CARLA 数字孪生中验证 3D LiDAR 感知下的自主赛车性能。
An Open-source Hardware/Software Architecture and Supporting Simulation Environment to Perform Human FPV Flight Demonstrations for Unmanned Aerial Vehicle Autonomy
A Koopman Operator-based NMPC Framework for Mobile Robot Navigation under Uncertainty
Department of Electrical and Computer Engineering, University of California, Riverside(加州大学河滨分校电气与计算机工程系);Polytechnic School of Tunisia(突尼斯多技术学院);Institute of AI Industry Research, Tsinghua University(清华大学人工智能产业研究院)
NemeSys: Toward Online Underwater Exploration with Remote Operator-in-the-loop Adaptive Autonomy
Department of ECE University of Florida Gainesville, FL, USA(电子工程系佛罗里达大学盖恩斯维尔分校);Department of MAE University of Florida Gainesville, FL, USA(机械与航空航天工程系佛罗里达大学盖恩斯维尔分校)
Benchmarking Autonomy in Scientific Experiments: A Hierarchical Taxonomy for Autonomous Large-Scale Facilities
University of Greenwich, Old Royal Naval College, Park Row, London, SE10 9LS, United Kingdom(格林威治大学,皇家海军学院,伦敦公园行,SE10 9LS,英国);ISIS Neutron & Muon Source, Rutherford Appleton Laboratory, Didcot, OX11 0QX, United Kingdom(ISIS中子与穆子源,拉瑟福德-苹果顿实验室,迪茨,OX11 0QX,英国);The Faraday Institution, Harwell Science and Innovation Campus, Didcot, OX11 0RA, United Kingdom(法拉第机构,哈威尔科学与创新校园,迪茨,OX11 0RA,英国)
Digital Twins in the Cloud: A Modular, Scalable and Interoperable Framework for Accelerating Verification and Validation of Autonomous Driving Solutions
Clemson University International Center for Automotive Research (CU-ICAR)(克莱姆森大学国际汽车研究中心(CU-ICAR))
CFTel: A Practical Architecture for Robust and Scalable Telerobotics with Cloud-Fog Automation
Deakin University(德金大学);RMIT University(皇家墨尔本理工大学);Zhejiang University(浙江大学);Swinburne University of Technology(斯威本科技大学);University of Tasmania(塔斯马尼亚大学)
Aeolus Ocean -- A simulation environment for the autonomous COLREG-compliant navigation of Unmanned Surface Vehicles using Deep Reinforcement Learning and Maritime Object Detection
Institute of Informatics & Telecommunications, National Center for Scientific Research “Demokritos”(德谟克利特国家科学研究所信息与通信研究所)