在建筑领域,确保工人安全至关重要。本研究提出了一种基于深度学习的技术,用于识别建筑工人佩戴的安全装备,如头盔、护目镜、夹克、手套和鞋类。该方法采用YOLO v7(You Only Look Once)目标检测算法来精确定位这些安全物品。本研究使用的数据集由带标签的图像组成,分为训练集、测试集和验证集。每张图像都有边界框标签,指示安全装备在图像中的位置。通过迭代训练方法,模型被训练为基于带标签的数据集识别和分类安全装备。我们使用自定义数据集来训练该模型。我们训练的模型表现优异,在安全装备识别方面具有良好的精确率、召回率和F1分数。此外,模型的评估产生了令人鼓舞的结果,mAP@0.5得分为87.7%。该模型性能有效,能够快速识别建筑工地上的安全装备违规行为。对结果的全面评估揭示了模型的优势,并指出了未来发展的潜在领域。通过提供一种自动且可靠的安全装备检测方法,本研究为计算机视觉和工作场所安全领域做出了贡献。所提出的基于深度学习的方法将提高安全合规性,并降低建筑行业的事故风险。
英文摘要:
In the construction sector, ensuring worker safety is of the utmost significance. In this study, a deep learning-based technique is presented for identifying safety gear worn by construction workers, such as helmets, goggles, jackets, gloves, and footwears. The recommended approach uses the YOLO v7 (You Only Look Once) object detection algorithm to precisely locate these safety items. The dataset utilized in this work consists of labeled images split into training, testing and validation sets. Each image has bounding box labels that indicate where the safety equipment is located within the image. The model is trained to identify and categorize the safety equipment based on the labeled dataset through an iterative training approach. We used custom dataset to train this model. Our trained model performed admirably well, with good precision, recall, and F1-score for safety equipment recognition. Also, the model's evaluation produced encouraging results, with a mAP@0.5 score of 87.7\%. The model performs effectively, making it possible to quickly identify safety equipment violations on building sites. A thorough evaluation of the outcomes reveals the model's advantages and points up potential areas for development. By offering an automatic and trustworthy method for safety equipment detection, this research makes a contribution to the fields of computer vision and workplace safety. The proposed deep learning-based approach will increase safety compliance and reduce the risk of accidents in the construction industry
DEEVA: A Deep Learning and IoT Based Computer Vision System to Address Safety and Security of Production Sites in Energy Industry
当涉及到解决不同生产/施工现场的安全/安保相关需求时,准确检测工人、车辆、设备的存在非常重要,并构成了基于计算机视觉的监控系统(CVSS)的组成部分。传统的CVSS系统集中于使用不同的计算机视觉和模式识别算法,过度依赖于手动提取特征和小数据集,由于准确性低、需要专家知识和高计算成本而限制了它们的使用。本文的主要目标是为现场决策者提供实用而全面的基于深度学习和物联网的解决方案,以解决各种计算机视觉相关问题,如场景分类,场景中的目标检测,语义分割,我们的首要目标是解决这个网站正在发生什么以及它在哪里发生的中心问题,以自动化的方式最小化需要专门用于监视的人力资源。我们开发了Deep ExxonMobil Eye for Video Analysis(DEEVA)软件包,以分层方式处理场景分类、目标检测、语义分割和场景字幕。结果表明,使用RetinaNet对象检测器的迁移学习能够以高准确度(90%以上)检测工人、不同类型的车辆/施工设备、安全相关对象的存在。借助深度学习自动提取特征和物联网技术自动捕获,传输和处理大量实时图像,该框架是智能监控系统开发的重要一步,旨在解决安全/安全监控,生产力评估和未来决策领域的无数开放式问题。
TrajGATFormer: A Graph-Based Transformer Approach for Worker and Obstacle Trajectory Prediction in Off-site Construction Environments
organization= Department of Civil \& Environmental Engineering, University of Alberta , addressline= , city= Edmonton , postcode= T6G 2R3 , state= AB , country= Canada;organization= Department of Mechanical Engineering, University of Alberta , addressline= , city= Edmonton , postcode= T6G 2R3 , state= AB , country= Canada
Dynamic Attention and Bi-directional Fusion for Safety Helmet Wearing Detection
School of Astronautics Northwestern Polytechnical University Xi'an, China;School of Software Northwestern Polytechnical University Xi'an, China;minipage Unmanned System Research Institute Northwestern Polytechnical University Xi'an, China minipage
Integration of Object Detection and Small VLMs for Construction Safety Hazard Identification
Infrastructure Human Tech (IHT) Lab, Department of Civil and Environmental Engineering, University of Alberta, Edmonton, Alberta, Canada(基础设施人类技术(IHT)实验室,土木与环境工程系,阿尔伯塔大学,埃德蒙顿,阿尔伯塔,加拿大)
Towards Edge-Cloud Architectures for Personal Protective Equipment Detection
Orange Innovation, Orange Polska S.A.(Orange创新中心,波兰Orange股份公司);Systems Research Institute Polish Academy of Sciences(波兰科学院系统研究所);Warsaw Univesity of Technology(华沙理工大学)
Anomalous Frame Detection by Grouping Frame Similarities between Two Videos Computed by Vision-Language Model to Extract Expert Workers' Unique Actions
Vision-Based Human Awareness Estimation for Enhanced Safety and Efficiency of AMRs in Industrial Warehouses
Fraunhofer Austria Research GmbH(弗劳恩霍夫奥地利研究有限公司);Computer Vision Lab(计算机视觉实验室);Digital Factory Vorarlberg GmbH(数字工厂沃尔夫斯堡有限公司);Institute of Computer Technology(计算机技术研究所)
Vision Language Model for Interpretable and Fine-grained Detection of Safety Compliance in Diverse Workplaces
School of Mechanical, Aerospace, and Manufacturing Engineering(机械、航空航天与制造工程学院);University of Connecticut(康涅狄格大学);Department of Computer Science(计算机科学系);University of California Irvine(加州大学欧文分校)
MonitorVLM:A Vision Language Framework for Safety Violation Detection in Mining Operations
School of Mechanical Engineering, University of Science and Technology Beijing(北京科技大学机械工程学院);Laboratory for Computational Sensing and Robotics, Johns Hopkins University(约翰霍普金斯大学计算感知与机器人实验室)
IEC3D-AD: A 3D Dataset of Industrial Equipment Components for Unsupervised Point Cloud Anomaly Detection
Software College, Northeastern University(东北大学软件学院);Shenzhen Audencia Financial Technology Institute, Shenzhen University(深圳Audencia金融技术研究院);National Engineering Laboratory for Big Data System Computing Technology, Shenzhen University(深圳大学大数据系统计算技术国家工程实验室)
Better YOLO with Attention-Augmented Network and Enhanced Generalization Performance for Safety Helmet Detection
School Of Automation And Electeical Engineering, University of Science and Technology Beijing(北京科技大学自动化与电气工程学院);Intelligent Transportation Thrust, Systems Hub, the Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州)智能交通枢纽系统中心)
Large, Complex, and Realistic Safety Clothing and Helmet Detection: Dataset and Method
School of Artificial Intelligence and Automation, Huazhong University of Science and Technology(华中科技大学人工智能与自动化学院);Institute of Artificial Intelligence, Huazhong University of Science and Technology(华中科技大学人工智能研究院);Hubei Key Laboratory of Brain-Inspired Intelligent Systems, Huazhong University of Science and Technology(华中科技大学湖北省脑启发智能系统重点实验室);Key Laboratory of Image Processing and Intelligent Control (Huazhong University of Science and Technology), Ministry of Education(华中科技大学图像信息处理与智能控制教育部重点实验室)