SODA: Site Object Detection dAtaset for Deep Learning in Construction
School of Civil Engineering and Transportation, South China University of Technology(华南理工大学土木与交通学院);University of Southern California(南加利福尼亚大学);Tsinghua University(清华大学)
Rui Duan, Hui Deng, Mao Tian, Yichuan Deng, Jiarui Lin
Computer vision-based deep learning object detection algorithms have been developed sufficiently powerful to support the ability to recognize various objects. Although there are currently general datasets for object detection, there is still a lack of large-scale, open-source dataset for the construction industry, which limits the developments of object detection algorithms as they tend to be data-hungry. Therefore, this paper develops a new large-scale image dataset specifically collected and annotated for the construction site, called Site Object Detection dAtaset (SODA), which contains 15 kinds of object classes categorized by workers, materials, machines, and layout. Firstly, more than 20,000 images were collected from multiple construction sites in different site conditions, weather conditions, and construction phases, which covered different angles and perspectives. After careful screening and processing, 19,846 images including 286,201 objects were then obtained and annotated with labels in accordance with predefined categories. Statistical analysis shows that the developed dataset is advantageous in terms of diversity and volume. Further evaluation with two widely-adopted object detection algorithms based on deep learning (YOLO v3/ YOLO v4) also illustrates the feasibility of the dataset for typical construction scenarios, achieving a maximum mAP of 81.47%. In this manner, this research contributes a large-scale image dataset for the development of deep learning-based object detection methods in the construction industry and sets up a performance benchmark for further evaluation of corresponding algorithms in this area.
SODAR: Segmenting Objects by DynamicallyAggregating Neighboring Mask Representations
National University of Singapore(新加坡国立大学);Institute of Data Science, National University of Singapore(新加坡国立大学数据科学研究所);NUS Graduate School of Integrative Sciences and Engineering(新加坡国立大学综合科学与工程研究生院);YITU Technology(依图科技)
DEEVA: A Deep Learning and IoT Based Computer Vision System to Address Safety and Security of Production Sites in Energy Industry
当涉及到解决不同生产/施工现场的安全/安保相关需求时,准确检测工人、车辆、设备的存在非常重要,并构成了基于计算机视觉的监控系统(CVSS)的组成部分。传统的CVSS系统集中于使用不同的计算机视觉和模式识别算法,过度依赖于手动提取特征和小数据集,由于准确性低、需要专家知识和高计算成本而限制了它们的使用。本文的主要目标是为现场决策者提供实用而全面的基于深度学习和物联网的解决方案,以解决各种计算机视觉相关问题,如场景分类,场景中的目标检测,语义分割,我们的首要目标是解决这个网站正在发生什么以及它在哪里发生的中心问题,以自动化的方式最小化需要专门用于监视的人力资源。我们开发了Deep ExxonMobil Eye for Video Analysis(DEEVA)软件包,以分层方式处理场景分类、目标检测、语义分割和场景字幕。结果表明,使用RetinaNet对象检测器的迁移学习能够以高准确度(90%以上)检测工人、不同类型的车辆/施工设备、安全相关对象的存在。借助深度学习自动提取特征和物联网技术自动捕获,传输和处理大量实时图像,该框架是智能监控系统开发的重要一步,旨在解决安全/安全监控,生产力评估和未来决策领域的无数开放式问题。
SODA: Out-of-Distribution Detection in Domain-Shifted Point Clouds via Neighborhood Propagation
Institute for Infocomm Research, Agency for Science, Technology and Research (A*STAR), Singapore(信息通信研究所,科技研究局(A*STAR),新加坡);School of Computing, National University of Singapore, Singapore(计算学院,新加坡国立大学,新加坡)
MAFE R-CNN: Selecting More Samples to Learn Category-aware Features for Small Object Detection
School of Computer Science and Technology, Beijing Institute of Technology(计算机科学与技术学院,北京理工大学);School of Computer and Communication Engineering, University of Science and Technology Beijing(计算机与通信工程学院,北京科技大学);School of Computer Science and Technology, University of Hong Kong(计算机科学与技术学院,香港大学);Beijing Institute of Space Mechanics and Electricity(北京航天机械电子研究所);School of information and electronics, Beijing Institute of Technology(信息电子学院,北京理工大学)
Monocular 2D Camera-based Proximity Monitoring for Human-Machine Collision Warning on Construction Sites
City University of Hong Kong(香港城市大学);Architecture and Civil Engineering Research Center, Shenzhen Research Institute of City University of Hong Kong(香港城市大学深圳研究院建筑与土木工程研究中心)