An important component of computer vision research is object detection. In recent years, there has been tremendous progress in the study of construction site images. However, there are obvious problems in construction object detection, including complex backgrounds, varying-sized objects, and poor imaging quality. In the state-of-the-art approaches, elaborate attention mechanisms are developed to handle space-time features, but rarely address the importance of channel-wise feature adjustments. We propose a lightweight Optimized Positioning (OP) module to improve channel relation based on global feature affinity association, which can be used to determine the Optimized weights adaptively for each channel. OP first computes the intermediate optimized position by comparing each channel with the remaining channels for a given set of feature maps. A weighted aggregation of all the channels will then be used to represent each channel. The OP-Net module is a general deep neural network module that can be plugged into any deep neural network. Algorithms that utilize deep learning have demonstrated their ability to identify a wide range of objects from images nearly in real time. Machine intelligence can potentially benefit the construction industry by automatically analyzing productivity and monitoring safety using algorithms that are linked to construction images. The benefits of on-site automatic monitoring are immense when it comes to hazard prevention. Construction monitoring tasks can also be automated once construction objects have been correctly recognized. Object detection task in construction site images is experimented with extensively to demonstrate its efficacy and effectiveness. A benchmark test using SODA demonstrated that our OP-Net was capable of achieving new state-of-the-art performance in accuracy while maintaining a reasonable computational overhead.
DEEVA: A Deep Learning and IoT Based Computer Vision System to Address Safety and Security of Production Sites in Energy Industry
当涉及到解决不同生产/施工现场的安全/安保相关需求时,准确检测工人、车辆、设备的存在非常重要,并构成了基于计算机视觉的监控系统(CVSS)的组成部分。传统的CVSS系统集中于使用不同的计算机视觉和模式识别算法,过度依赖于手动提取特征和小数据集,由于准确性低、需要专家知识和高计算成本而限制了它们的使用。本文的主要目标是为现场决策者提供实用而全面的基于深度学习和物联网的解决方案,以解决各种计算机视觉相关问题,如场景分类,场景中的目标检测,语义分割,我们的首要目标是解决这个网站正在发生什么以及它在哪里发生的中心问题,以自动化的方式最小化需要专门用于监视的人力资源。我们开发了Deep ExxonMobil Eye for Video Analysis(DEEVA)软件包,以分层方式处理场景分类、目标检测、语义分割和场景字幕。结果表明,使用RetinaNet对象检测器的迁移学习能够以高准确度(90%以上)检测工人、不同类型的车辆/施工设备、安全相关对象的存在。借助深度学习自动提取特征和物联网技术自动捕获,传输和处理大量实时图像,该框架是智能监控系统开发的重要一步,旨在解决安全/安全监控,生产力评估和未来决策领域的无数开放式问题。
Anomalous Frame Detection by Grouping Frame Similarities between Two Videos Computed by Vision-Language Model to Extract Expert Workers' Unique Actions
Toward Autonomous Laboratory Safety Monitoring with Vision Language Models: Learning to See Hazards Through Scene Structure
Electrical and Computer Engineering, University of California, Riverside, USA(加州大学河滨分校电气与计算机工程系);Computer Science and Engineering, University of California, Riverside, USA(加州大学河滨分校计算机科学与工程系);Lawrence Livermore National Laboratory(劳伦斯利弗莫尔国家实验室)
Vision-Based Human Awareness Estimation for Enhanced Safety and Efficiency of AMRs in Industrial Warehouses
Fraunhofer Austria Research GmbH(弗劳恩霍夫奥地利研究有限公司);Computer Vision Lab(计算机视觉实验室);Digital Factory Vorarlberg GmbH(数字工厂沃尔夫斯堡有限公司);Institute of Computer Technology(计算机技术研究所)
Video-to-Text Pedestrian Monitoring (VTPM): Leveraging Computer Vision and Large Language Models for Privacy-Preserve Pedestrian Activity Monitoring at Intersections
MonitorVLM:A Vision Language Framework for Safety Violation Detection in Mining Operations
School of Mechanical Engineering, University of Science and Technology Beijing(北京科技大学机械工程学院);Laboratory for Computational Sensing and Robotics, Johns Hopkins University(约翰霍普金斯大学计算感知与机器人实验室)