Robust maritime obstacle detection is essential for fully autonomous unmanned surface vehicles (USVs). The currently widely adopted segmentation-based obstacle detection methods are prone to misclassification of object reflections and sun glitter as obstacles, producing many false positive detections, effectively rendering the methods impractical for USV navigation. However, water-turbulence-induced temporal appearance changes on object reflections are very distinctive from the appearance dynamics of true objects. We harness this property to design WaSR-T, a novel maritime obstacle detection network, that extracts the temporal context from a sequence of recent frames to reduce ambiguity. By learning the local temporal characteristics of object reflection on the water surface, WaSR-T substantially improves obstacle detection accuracy in the presence of reflections and glitter. Compared with existing single-frame methods, WaSR-T reduces the number of false positive detections by 41% overall and by over 53% within the danger zone of the boat, while preserving a high recall, and achieving new state-of-the-art performance on the challenging MODS maritime obstacle detection benchmark. The code, pretrained models and extended datasets are available at https://github.com/lojzezust/WaSR-T
MODS -- A USV-oriented object detection and obstacle segmentation benchmark
University of Ljubljana, Faculty of Computer and Information Science(卢布尔雅那大学计算机与信息科学学院);University of Ljubljana, Faculty of Electrical Engineering(卢布尔雅那大学电气工程学院);MPRI;Sirio d.o.o.(Sirio有限责任公司)
University of Massachusetts, Lowell(马萨诸塞大学洛厄尔分校);MIT Sea Grant(麻省理工学院海洋基金办公室);Massachusetts Institute of Technology Laboratory for Autonomous Marine Sensing Systems(麻省理工学院自主海洋传感系统实验室);Sunrise Setting Ltd(日出设定有限公司);SAGE Publications Ltd(SAGE出版有限公司)
1st Workshop on Maritime Computer Vision (MaCVi) 2023: Challenge Results
University of Tuebingen(图宾根大学);University of Ljubljana(卢布尔雅那大学);Fondazione Bruno Kessler(布鲁诺·凯塞勒基金会);University of South-Eastern Norway(东南挪威大学);University of Lisbon(里斯本大学);Kitware(Kitware公司);University of Jyväskylä(于韦斯屈莱大学);The University of Sydney(悉尼大学);JD Explore Academy(京东探索研究院);Fraunhofer IOSB(弗劳恩霍夫光学、信息技术与电子学研究所);Beijing University of Posts and Telecommunications(北京邮电大学);Helmut Schmidt University(赫尔穆特·施密特大学);University of Seoul(首尔大学);University of Cagliari(卡利亚里大学);Granular AI(Granular AI公司);TU Kaiserslautern(凯泽斯劳滕工业大学)
Politecnico di Torino(都灵理工大学);University of Tübingen(图宾根大学);Technical University of Munich(慕尼黑技术大学);Helmholtz Munich(海德堡-慕尼黑 Helmholtz 中心);Munich Center for Machine Learning(慕尼黑机器学习中心);Munich Data Science Institute(慕尼黑数据科学研究所)
Computer Vision-Based Early Detection of Container Loss at Sea
Centre of Excellence in Maritime Safety(海运安全卓越中心);Singapore Polytechnic(新加坡理工学院);Quality, Safety, Security and Environment(质量、安全、安保与环境);Pacific International Lines (Pvt) Ltd(太平洋国际航运有限公司)
FeedbackSTS-Det: Sparse Frames-Based Spatio-Temporal Semantic Feedback Network for Moving Infrared Small Target Detection
School of Information and Communication Engineering and the Laboratory of Imaging Detection and Intelligent Perception, University of Electronic Science and Technology of China(电子科技大学信息与通信工程学院及成像探测与智能感知实验室);School of Television and Audiovisual Arts, Communication University of Zhejiang(浙江传媒学院电视与视听艺术学院)