With the recent advancements in deep learning and computer vision, the AI-powered construction machine such as autonomous excavator has made significant progress. Safety is the most important section in modern construction, where construction machines are more and more automated. In this paper, we propose a vision-based excavator perception, activity analysis, and safety monitoring system. Our perception system could detect multi-class construction machines and humans in real-time while estimating the poses and actions of the excavator. Then, we present a novel safety monitoring and excavator activity analysis system based on the perception result. To evaluate the performance of our method, we collect a dataset using the Autonomous Excavator System (AES) including multi-class of objects in different lighting conditions with human annotations. We also evaluate our method on a benchmark construction dataset. The results showed our YOLO v5 multi-class objects detection model improved inference speed by 8 times (YOLO v5 x-large) to 34 times (YOLO v5 small) compared with Faster R-CNN/ YOLO v3 model. Furthermore, the accuracy of YOLO v5 models is improved by 2.7% (YOLO v5 x-large) while model size is reduced by 63.9% (YOLO v5 x-large) to 93.9% (YOLO v5 small). The experimental results show that the proposed action recognition approach outperforms the state-of-the-art approaches on top-1 accuracy by about 5.18%. The proposed real-time safety monitoring system is not only designed for our Autonomous Excavator System (AES) in solid waste scenes, it can also be applied to general construction scenarios.
Toward Autonomous Laboratory Safety Monitoring with Vision Language Models: Learning to See Hazards Through Scene Structure
Electrical and Computer Engineering, University of California, Riverside, USA(加州大学河滨分校电气与计算机工程系);Computer Science and Engineering, University of California, Riverside, USA(加州大学河滨分校计算机科学与工程系);Lawrence Livermore National Laboratory(劳伦斯利弗莫尔国家实验室)
Video-to-Text Pedestrian Monitoring (VTPM): Leveraging Computer Vision and Large Language Models for Privacy-Preserve Pedestrian Activity Monitoring at Intersections
Integrity Monitoring of 3D Object Detection in Automated Driving Systems using Raw Activation Patterns and Spatial Filtering
WMG, University of Warwick(华威大学WMG学院);School of Electronics, Electrical Engineering and Computer Science (EEECS), Queen’s University of Belfast(贝尔法斯特女王大学电子、电气工程与计算机科学学院)
Utilizing Computer Vision for Continuous Monitoring of Vaccine Side Effects in Experimental Mice
Purdue University(普渡大学);China Agricultural University(中国农业大学);The Ohio State University(俄亥俄州立大学);The University of Sydney(悉尼大学);Kunsan National University(群山国立大学)
Edge-Aware and Content-Adaptive Infrared Gas Leak Detection for Industrial Safety Monitoring
School of Mechatronic Engineering, Xi’an Technological University(机械电子工程学院,西安理工大学);School of Electronic Information Engineering, Xi’an Technological University(电子信息工程学院,西安理工大学);Shaanxi Shanhua Coal Chemical Co., Ltd.(陕西神华化工有限公司)