Despite the increasing adoption of Deep Reinforcement Learning (DRL) for Autonomous Surface Vehicles (ASVs), there still remain challenges limiting real-world deployment. In this paper, we first integrate buoyancy and hydrodynamics models into a modern Reinforcement Learning framework to reduce training time. Next, we show how system identification coupled with domain randomization improves the RL agent performance and narrows the sim-to-real gap. Real-world experiments for the task of capturing floating waste show that our approach lowers energy consumption by 13.1\% while reducing task completion time by 7.4\%. These findings, supported by sharing our open-source implementation, hold the potential to impact the efficiency and versatility of ASVs, contributing to environmental conservation efforts.
Field Testing of a Stochastic Planner for ASV Navigation Using Satellite Images
University of Toronto(多伦多大学);Robotics Institute(机器人研究所);Carnegie Mellon University(卡内基梅隆大学);Division of Engineering Science(工程科学学院);Department of Computer Science(计算机科学系);Institute for Aerospace Studies(航空航天研究所)
BIND-USBL: Bounding IMU Navigation Drift using USBL in Heterogeneous ASV-AUV Teams
Dept of Computer and Information Science, University of Konstanz, Germany(计算机与信息科学系,康斯坦茨大学,德国);Centre for the Advanced Study of Collective Behaviour, University of Konstanz, Germany(集体行为高级研究中心,康斯坦茨大学,德国);Dept of Aerospace Engineering, Indian Institute of Science, Bangalore, India(航空航天工程系,印度科学研究院,班加罗尔,印度)
SeePerSea: Multi-modal Perception Dataset of In-water Objects for Autonomous Surface Vehicles
Department of Computer Science, Dartmouth College(达特茅斯学院计算机科学系);IQT Labs(IQT实验室);Department of Computer Science, Columbia University(哥伦比亚大学计算机科学系);Department of Computer Science, University of Maryland College Park(马里兰大学计算机科学系);The Institute for Human and Machine Cognition and The University of West Florida(人机认知研究所与西佛罗里达大学);School of Computing, Binghamton University(宾夕法尼亚州立大学计算学院)
WaterVideoQA: ASV-Centric Perception and Rule-Compliant Reasoning via Multi-Modal Agents
Thrust of Artificial Intelligence, The Hong Kong University of Science and Technology (Guangzhou)(香港理工大学(广州)人工智能研究所);Hubei Key Laboratory of Inland Shipping Technology (Wuhan University of Technology)(湖北内河航运技术重点实验室(武汉理工大学));School of Navigation, Wuhan University of Technology(武汉理工大学航海学院);School of Advanced Technology, Xi’an Jiaotong-Liverpool University(西安交通大学利物浦大学先进科技学院);School of Artificial Intelligence, Nanjing University(南京大学人工智能学院);School of Information Engineering, Yancheng Institute of Technology(盐城职业技术学院信息工程学院);School of Engineering, Stanford University(斯坦福大学工程学院);Centre for AI and Data Science Innovation and the School of Science and Engineering, James Cook University(詹姆斯库克大学人工智能与数据科学创新中心及科学与工程学院)
Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodology
Institute of Artificial Intelligence, Beihang University(北京航空航天大学人工智能学院);MMLab, CUHK(香港中文大学MMLab);Centre for Perceptual and Interactive Intelligence(感知与交互智能中心)
Robust Subpixel Localization of Diagonal Markers in Large-Scale Navigation via Multi-Layer Screening and Adaptive Matching
College of Aerospace Science and Engineering(航空航天科学与工程学院);National University of Defense Technology(国防科技大学);Hunan Provincial Key Laboratory of Image Measurement and Vision Navigation(湖南省图像测量与视觉导航重点实验室)
Offline Deep Model Predictive Control (MPC) for Visual Navigation
International Artificial Intelligence Center of Morocco(摩洛哥国际人工智能中心);Mohammed VI Polytechnic University(穆罕默德六世理工大学);ENSAM(高等艺术与制造学院);Moulay Ismail University(穆莱·伊斯梅尔大学)
Object-Oriented Semantic Mapping for Reliable UAVs Navigation
University of Engineering and Technology, Vietnam National University Hanoi(越南国立大学河内工程技术大学);Japan Advanced Institute of Science and Technology(日本北陆先端科学技术大学院大学)
Autonomous navigation of catheters and guidewires in mechanical thrombectomy using inverse reinforcement learning
School of Biomedical Engineering & Imaging Sciences(生物医学工程与影像科学学院);Kings College London(伦敦国王学院);AIBE;Friedrich-Alexander University Erlangen-Nürnberg(埃尔朗根-纽伦堡弗里德里希-亚历山大大学)