Fraunhofer ITWM（弗劳恩霍夫信息技术与通信技术研究所）；Technische Universität Kaiserslautern（凯泽斯劳滕工业大学）
Tin Barisin, Christian Jung, Anna Nowacka, Claudia Redenbach, Katja Schladitz
备注：
This is a preprint of the chapter: T. Barisin, C. Jung, A. Nowacka, C. Redenbach, K. Schladitz: Cracks in concrete, published in Statistical Machine Learning for Engineering with Applications (LNCS), edited by J. Franke, A. Schöbel, reproduced with permission of Springer Nature Switzerland AG 2024. The final authenticated version is available online at: https://doi.org/10.1007/978-3-031-66253-9
发表信息：
Statistical Machine Learning for Engineering with Applications (Lecture Notes in Statistics), edited by Jürgen Franke, Anita Schöbel, 2024, Springer Cham
Finding and properly segmenting cracks in images of concrete is a challenging task. Cracks are thin and rough and being air filled do yield a very weak contrast in 3D images obtained by computed tomography. Enhancing and segmenting dark lower-dimensional structures is already demanding. The heterogeneous concrete matrix and the size of the images further increase the complexity. ML methods have proven to solve difficult segmentation problems when trained on enough and well annotated data. However, so far, there is not much 3D image data of cracks available at all, let alone annotated. Interactive annotation is error-prone as humans can easily tell cats from dogs or roads without from roads with cars but have a hard time deciding whether a thin and dark structure seen in a 2D slice continues in the next one. Training networks by synthetic, simulated images is an elegant way out, bears however its own challenges. In this contribution, we describe how to generate semi-synthetic image data to train CNN like the well known 3D U-Net or random forests for segmenting cracks in 3D images of concrete. The thickness of real cracks varies widely, both, within one crack as well as from crack to crack in the same sample. The segmentation method should therefore be invariant with respect to scale changes. We introduce the so-called RieszNet, designed for exactly this purpose. Finally, we discuss how to generalize the ML crack segmentation methods to other concrete types.
Fraunhofer Institut für Techno- und Wirtschaftsmathematik（弗劳恩霍夫工业数学研究所）；Technische Universität Kaiserslautern（凯泽斯劳滕工业大学）
Concrete is the standard construction material for buildings, bridges, and roads. As safety plays a central role in the design, monitoring, and maintenance of such constructions, it is important to understand the cracking behavior of concrete. Computed tomography captures the microstructure of building materials and allows to study crack initiation and propagation. Manual segmentation of crack surfaces in large 3d images is not feasible. In this paper, automatic crack segmentation methods for 3d images are reviewed and compared. Classical image processing methods (edge detection filters, templ…
National Institute of Technology Durgapur（杜尔加普尔国家理工学院）
Due to cyclic loading and fatigue stress cracks are generated, which affect the safety of any civil infrastructure. Nowadays machine vision is being used to assist us for appropriate maintenance, monitoring and inspection of concrete structures by partial replacement of human-conducted onsite inspections. The current study proposes a crack detection method based on deep convolutional neural network (CNN) for detection of concrete cracks without explicitly calculating the defect features. In the course of the study, a database of 3200 labelled images with concrete cracks has been created, where…
Crack detection plays a key role in automated pavement inspection. Although a large number of algorithms have been developed in recent years to further boost performance, there are still remaining challenges in practice, due to the complexity of pavement images. To further accelerate the development and identify the remaining challenges, this paper conducts a comparison study to evaluate the performance of the state of the art crack detection algorithms quantitatively and objectively. A more comprehensive annotated pavement crack dataset (NHA12D) that contains images with different viewpoints …
Illinois Center for Transportation, University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校交通中心）
This article proposes a deep neural network, namely CrackPropNet, to measure crack propagation on asphalt concrete (AC) specimens. It offers an accurate, flexible, efficient, and low-cost solution for crack propagation measurement using images collected during cracking tests. CrackPropNet significantly differs from traditional deep learning networks, as it involves learning to locate displacement field discontinuities by matching features at various locations in the reference and deformed images. An image library representing the diversified cracking behavior of AC was developed for supervised…
Application of Segment Anything Model for Civil Infrastructure Defect Assessment
Florida Atlantic University（佛罗里达大西洋大学）；Missouri University of Science and Technology（密苏里科技大学）；University of Tehran（德黑兰大学）；University of Texas at Arlington（德克萨斯大学阿灵顿分校）；Boston University（波士顿大学）；University of Delaware（特拉华大学）；Florida International University（佛罗里达国际大学）
Prefectural University of Hiroshima（广岛县立大学）；Mitsui Consultants Co. Ltd.（三井咨询有限公司）
We have developed an adaptive structural Deep Belief Network (Adaptive DBN) that finds an optimal network structure in a self-organizing manner during learning. The Adaptive DBN is the hierarchical architecture where each layer employs Adaptive Restricted Boltzmann Machine (Adaptive RBM). The Adaptive RBM can find the appropriate number of hidden neurons during learning. The proposed method was applied to a concrete image benchmark data set SDNET2018 for crack detection. The dataset contains about 56,000 crack images for three types of concrete structures: bridge decks, walls, and paved roads.…
3D Modeling and Automated Measurement of Concrete Cracks via Segment Anything Refinement and Visual Inertial LiDAR Fusion
School of Civil Engineering（土木工程学院）；Central South University（中南大学）；Hunan Provincial Key Laboratory for Disaster Prevention and Mitigation of Rail Transit Engineering Structures（湖南省铁路工程结构灾害预防与 mitigation 工程结构重点实验室）；Nvidia；School of Computing（计算学院）；Newcastle University（新castle大学）
Crack detection is of great significance for monitoring the integrity and well-being of the infrastructure such as bridges and underground pipelines, which are harsh environments for people to access. In recent years, computer vision techniques have been applied in detecting cracks in concrete structures. However, they suffer from variances in light conditions and shadows, lacking robustness and resulting in many false positives. To address the uncertainty in vision, human inspectors actively touch the surface of the structures, guided by vision, which has not been explored in autonomous crack…
Friedrich-Alexander University Erlangen-Nuremberg（弗里德里希-亚历山大-埃尔兰根-纽伦堡大学）
Photovoltaic is one of the most important renewable energy sources for dealing with world-wide steadily increasing energy consumption. This raises the demand for fast and scalable automatic quality management during production and operation. However, the detection and segmentation of cracks on electroluminescence (EL) images of mono- or polycrystalline solar modules is a challenging task. In this work, we propose a weakly supervised learning strategy that only uses image-level annotations to obtain a method that is capable of segmenting cracks on EL images of solar cells. We use a modified Res…
Segmenting Low-Contrast XCTs of Concrete: An Unsupervised Approach
Department of Mechanics, Faculty of Civil Engineering, Czech Technical University in Prague（机械系，土木工程学院，布拉格捷克技术大学）；Structural Composites Unit, Luxembourg Institute of Science and Technology (LIST)（结构复合材料单元，卢森堡科学与技术研究所（LIST））
Benefiting from Quantum? A Comparative Study of Q-Seg, Quantum-Inspired Techniques, and U-Net for Crack Segmentation
Fraunhofer Institute for Industrial Mathematics (ITWM)（弗劳恩霍夫工业数学研究所）；RPTU Kaiserslautern-Landau（凯撒斯劳滕-兰道莱茵-普法尔茨理工大学）；German Research Center for Artificial Intelligence (DFKI)（德国人工智能研究中心）
Staircase Cascaded Fusion of Lightweight Local Pattern Recognition and Long-Range Dependencies for Structural Crack Segmentation
Engineering Research Center of Learning-Based Intelligent System (Ministry of Education)（基于学习的智能系统工程研究中心（教育部））；Key Laboratory of Computer Vision（计算机视觉重点实验室）；Tianjin Key Laboratory of Civil Structure Protection（天津建筑物结构保护重点实验室）；Tianjin Chengjian University（天津城建大学）
Jiangsu JARI Technology Group Shanghai Branch（江苏杰瑞科技集团上海分公司）
Compared to NDT and health monitoring method for cracks in engineering structures, surface crack detection or identification based on visible light images is non-contact, with the advantages of fast speed, low cost and high precision. Firstly, typical pavement (concrete also) crack public data sets were collected, and the characteristics of sample images as well as the random variable factors, including environmental, noise and interference etc., were summarized. Subsequently, the advantages and disadvantages of three main crack identification methods (i.e., hand-crafted feature engineering, m…
StructDamage:A Large Scale Unified Crack and Surface Defect Dataset for Robust Structural Damage Detection
Rhineland-Palatinate Technical University of Kaiserslautern-Landau（凯撒斯劳滕-兰道技术大学）；German Research Center for Artificial Intelligence（德国人工智能研究中心）；Intelligentx GmbH；BiogentX；Department of Core Informatics, Graduate School of Informatics ,Osaka Metropolitan University（大阪 Metropolitan 大学信息学研究生院核心信息学系）
Graduate School of Information Sciences, Tohoku University（东北大学信息科学研究生院）；RIKEN Center for AIP（理化学研究所人工智能中心）
In this study, we consider the problem of detecting cracks from the image of a concrete surface for automated inspection of infrastructure, such as bridges. Its overall accuracy is determined by how accurately thin cracks with sub-pixel widths can be detected. Our interest is in making it possible to detect cracks close to the limit of thinness if it can be defined. Toward this end, we first propose a method for training a CNN to make it detect cracks more accurately than humans while training them on human-annotated labels. To achieve this seemingly impossible goal, we intentionally lower the…
The Chinese University of Hong Kong（香港中文大学）；Minjiang University（闽江学院）
Automatic crack detection and segmentation play a significant role in the whole system of unmanned aerial vehicle inspections. In this paper, we have implemented a deep learning framework for crack detection based on classical network architectures including Alexnet, VGG, and Resnet. Moreover, inspired by the feature pyramid network architecture, a hierarchical convolutional neural network (CNN) deep learning framework which is efficient in crack segmentation is also proposed, and its performance of it is compared with other state-of-the-art network architecture. We have summarized the existin…
Deep learning has been a successful model which can effectively represent several features of input space and remarkably improve image recognition performance on the deep architectures. In our research, an adaptive structural learning method of Restricted Boltzmann Machine (Adaptive RBM) and Deep Belief Network (Adaptive DBN) have been developed as a deep learning model. The models have a self-organize function which can discover an optimal number of hidden neurons for given input data in a RBM by neuron generation-annihilation algorithm, and can obtain an appropriate number of RBM as hidden l…
We introduce one-shot texture segmentation: the task of segmenting an input image containing multiple textures given a patch of a reference texture. This task is designed to turn the problem of texture-based perceptual grouping into an objective benchmark. We show that it is straight-forward to generate large synthetic data sets for this task from a relatively small number of natural textures. In particular, this task can be cast as a self-supervised problem thereby alleviating the need for massive amounts of manually annotated data necessary for traditional segmentation tasks. In this paper w…
Harmonizing output imbalance for defect segmentation on extremely-imbalanced photovoltaic module cells images
Shenzhen University（深圳大学）；Guangdong Artificial Intelligence and Digital Economy Laboratory (Shenzhen)（广东人工智能与数字经济实验室（深圳））；Shenzhen Institute of Technology（深圳技术学院）
Skeleton Recall Loss for Connectivity Conserving and Resource Efficient Segmentation of Thin Tubular Structures
German Cancer Research Center (DKFZ)（德国癌症研究中心）；Heidelberg University（海德堡大学）；Helmholtz Information and Data Science School for Health（亥姆霍兹健康信息与数据科学学院）；Helmholtz Imaging（亥姆霍兹成像中心）
Dual Cross-image Semantic Consistency with Self-aware Pseudo Labeling for Semi-supervised Medical Image Segmentation
School of Biomedical Engineering & State Key Laboratory of Advanced Medical Materials and Devices, ShanghaiTech University（生物医学工程学院及先进医疗材料与器件国家重点实验室，上海科技大学）；Lingang Laboratory（临港实验室）；Department of Radiology, Stanford University（放射科，斯坦福大学）
One fundamental challenge in building an instance segmentation model for a large number of classes in complex scenes is the lack of training examples, especially for rare objects. In this paper, we explore the possibility to increase the training examples without laborious data collection and annotation. We find that an abundance of instance segments can potentially be obtained freely from object-centric images, according to two insights: (i) an object-centric image usually contains one salient object in a simple background; (ii) objects from the same class often share similar appearances or s…
Institute of Information Engineering, Chinese Academy of Sciences（中国科学院信息工程研究所）；School of Cyber Security, University of Chinese Academy of Sciences（中国科学院大学网络空间安全学院）；School of Computer Science and Engineering, Beihang University（北京航空航天大学计算机学院）；Sun Yat-sen University（中山大学）；University of Technology Sydney（悉尼科技大学）；AI Institute（360人工智能研究院）
Referring image segmentation aims at segmenting the foreground masks of the entities that can well match the description given in the natural language expression. Previous approaches tackle this problem using implicit feature interaction and fusion between visual and linguistic modalities, but usually fail to explore informative words of the expression to well align features from the two modalities for accurately identifying the referred entity. In this paper, we propose a Cross-Modal Progressive Comprehension (CMPC) module and a Text-Guided Feature Exchange (TGFE) module to effectively addres…
