Region-Based CNN Method with Deformable Modules for Visually Classifying Concrete Cracks

Cracks are often the most intuitive indicators for assessing the condition of in-service structures. Intelligent detection methods based on regular convolutional neural networks (CNNs) have been widely applied to the field of crack detection in recently years; however, these methods exhibit unsatisfying performance on the detection of out-of-plane cracks. To overcome this drawback, a new type of region-based CNN (R-CNN) crack detector with deformable modules is proposed in the present study. The core idea of the method is to replace the traditional regular convolution and pooling operation with a deformable convolution operation and a deformable pooling operation. The idea is implemented on three different regular detectors, namely the Faster R-CNN, region-based fully convolutional networks (R-FCN), and feature pyramid network (FPN)-based Faster R-CNN. To examine the advantages of the proposed method, the results obtained from the proposed detector and corresponding regular detectors are compared. The results show that the addition of deformable modules improves the mean average precisions (mAPs) achieved by the Faster R-CNN, R-FCN, and FPN-based Faster R-CNN for crack detection. More importantly, adding deformable modules enables these detectors to detect the out-of-plane cracks that are difficult for regular detectors to detect.

Download Full-text

Fully convolutional networks semantic segmentation based on conditional random field optimization

Journal of Computational Methods in Sciences and Engineering ◽

10.3233/jcm-214867 ◽

2021 ◽

pp. 1-11

Author(s):

Qian Wu ◽

Jinan Gu ◽

Chen Wu ◽

Jin Li

Keyword(s):

Conditional Random Field ◽

Semantic Segmentation ◽

Target Object ◽

High Order ◽

Target Area ◽

Original Image ◽

Convolutional Networks ◽

Fully Convolutional Networks ◽

Algorithm Comparison ◽

Feature Pyramid

Each pixel can be classified in the image by the semantic segmentation. The segmentation detection results of pixel level can be got which are similar to the contour of the target object. However, the results of semantic segmentation trained by Fully convolutional networks often lead to loss of detail information. This paper proposes a CRF-FCN model based on CRF optimization. Firstly, the original image is detected based on feature pyramid networks, and the target area information is extracted, which is used to train the high-order potential function of CRF. Then, the high-order CRF is used as the back-end of the complete convolution network to optimize the semantic image segmentation. The algorithm comparison experiment shows that our algorithm makes the target details more obvious, and improves the accuracy and efficiency of semantic segmentation.

Download Full-text

Fully Convolutional Networks with Multiscale 3D Filters and Transfer Learning for Change Detection in High Spatial Resolution Satellite Images

Remote Sensing ◽

10.3390/rs12050799 ◽

2020 ◽

Vol 12 (5) ◽

pp. 799 ◽

Cited By ~ 1

Author(s):

Ahram Song ◽

Jaewan Choi

Keyword(s):

Change Detection ◽

Transfer Learning ◽

Spatial Resolution ◽

High Spatial Resolution ◽

Semantic Segmentation ◽

Detection Methods ◽

Detection Accuracy ◽

Optimal Size ◽

Convolutional Networks ◽

Fully Convolutional Networks

Remote sensing images having high spatial resolution are acquired, and large amounts of data are extracted from their region of interest. For processing these images, objects of various sizes, from very small neighborhoods to large regions composed of thousands of pixels, should be considered. To this end, this study proposes change detection method using transfer learning and recurrent fully convolutional networks with multiscale three-dimensional (3D) filters. The initial convolutional layer of the change detection network with multiscale 3D filters was designed to extract spatial and spectral features of materials having different sizes; the layer exploits pre-trained weights and biases of semantic segmentation network trained on an open benchmark dataset. The 3D filter sizes were defined in a specialized way to extract spatial and spectral information, and the optimal size of the filter was determined using highly accurate semantic segmentation results. To demonstrate the effectiveness of the proposed method, binary change detection was performed on images obtained from multi-temporal Korea multipurpose satellite-3A. Results revealed that the proposed method outperformed the traditional deep learning-based change detection methods and the change detection accuracy improved using multiscale 3D filters and transfer learning.

Download Full-text

Image-based concrete crack detection in tunnels using deep fully convolutional networks

Construction and Building Materials ◽

10.1016/j.conbuildmat.2019.117367 ◽

2020 ◽

Vol 234 ◽

pp. 117367 ◽

Cited By ~ 15

Author(s):

Yupeng Ren ◽

Jisheng Huang ◽

Zhiyou Hong ◽

Wei Lu ◽

Jun Yin ◽

...

Keyword(s):

Crack Detection ◽

Convolutional Networks ◽

Fully Convolutional Networks ◽

Concrete Crack

Download Full-text

Computer vision-based concrete crack detection using U-net fully convolutional networks

Automation in Construction ◽

10.1016/j.autcon.2019.04.005 ◽

2019 ◽

Vol 104 ◽

pp. 129-139 ◽

Cited By ~ 47

Author(s):

Zhenqing Liu ◽

Yiwen Cao ◽

Yize Wang ◽

Wei Wang

Keyword(s):

Computer Vision ◽

Crack Detection ◽

Convolutional Networks ◽

Fully Convolutional Networks ◽

Concrete Crack

Download Full-text

Deep RetinaNet for Dynamic Left Ventricle Detection in Multiview Echocardiography Classification

Scientific Programming ◽

10.1155/2020/7025403 ◽

2020 ◽

Vol 2020 ◽

pp. 1-6 ◽

Cited By ~ 1

Author(s):

Meijun Yang ◽

Xiaoyan Xiao ◽

Zhi Liu ◽

Longkun Sun ◽

Wei Guo ◽

...

Keyword(s):

Left Ventricle ◽

Three Dimensional ◽

Detection Algorithm ◽

Convolutional Networks ◽

Fully Convolutional Networks ◽

Dimensional Reconstruction ◽

Feature Pyramid ◽

The Mean ◽

Accuracy Rates

Background. Currently, echocardiography has become an essential technology for the diagnosis of cardiovascular diseases. Accurate classification of apical two-chamber (A2C), apical three-chamber (A3C), and apical four-chamber (A4C) views and the precise detection of the left ventricle can significantly reduce the workload of clinicians and improve the reproducibility of left ventricle segmentation. In addition, left ventricle detection is significant for the three-dimensional reconstruction of the heart chambers. Method. RetinaNet is a one-stage object detection algorithm that can achieve high accuracy and efficiency at the same time. RetinaNet is mainly composed of the residual network (ResNet), the feature pyramid network (FPN), and two fully convolutional networks (FCNs); one FCN is for the classification task, and the other is for the border regression task. Results. In this paper, we use the classification subnetwork to classify A2C, A3C, and A4C images and use the regression subnetworks to detect the left ventricle simultaneously. We display not only the position of the left ventricle on the test image but also the view category on the image, which will facilitate the diagnosis. We used the mean intersection-over-union (mIOU) as an index to measure the performance of left ventricle detection and the accuracy as an index to measure the effect of the classification of the three different views. Our study shows that both classification and detection effects are noteworthy. The classification accuracy rates of A2C, A3C, and A4C are 1.000, 0.935, and 0.989, respectively. The mIOU values of A2C, A3C, and A4C are 0.858, 0.794, and 0.838, respectively.

Download Full-text

Structural Crack Detection from Benchmark Data Sets Using Pruned Fully Convolutional Networks

Journal of Structural Engineering ◽

10.1061/(asce)st.1943-541x.0003140 ◽

2021 ◽

Vol 147 (11) ◽

pp. 04721008

Author(s):

X. W. Ye ◽

T. Jin ◽

Z. X. Li ◽

S. Y. Ma ◽

Y. Ding ◽

...

Keyword(s):

Crack Detection ◽

Data Sets ◽

Convolutional Networks ◽

Benchmark Data ◽

Fully Convolutional Networks

Download Full-text

BUILDING SEGMENTATION FROM AIRBORNE VHR IMAGES USING MASK R-CNN

ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences ◽

10.5194/isprs-archives-xlii-2-w13-155-2019 ◽

2019 ◽

Vol XLII-2/W13 ◽

pp. 155-161 ◽

Cited By ~ 1

Author(s):

K. Zhou ◽

Y. Chen ◽

I. Smal ◽

R. Lindenbergh

Keyword(s):

Model Building ◽

Critical Factor ◽

Semantic Segmentation ◽

Convolutional Networks ◽

Fully Convolutional Networks ◽

Building Models ◽

Single Feature ◽

Complex Scenes ◽

Feature Pyramid

<p><strong>Abstract.</strong> Up-to-date 3D building models are important for many applications. Airborne very high resolution (VHR) images often acquired annually give an opportunity to create an up-to-date 3D model. Building segmentation is often the first and utmost step. Convolutional neural networks (CNNs) draw lots of attention in interpreting VHR images as they can learn very effective features for very complex scenes. This paper employs Mask R-CNN to address two problems in building segmentation: detecting different scales of building and segmenting buildings to have accurately segmented edges. Mask R-CNN starts from feature pyramid network (FPN) to create different scales of semantically rich features. FPN is integrated with region proposal network (RPN) to generate objects with various scales with the corresponding optimal scale of features. The features with high and low levels of information are further used for better object classification of small objects and for mask prediction of edges. The method is tested on ISPRS benchmark dataset by comparing results with the fully convolutional networks (FCN), which merge high and low level features by a skip-layer to create a single feature for semantic segmentation. The results show that Mask R-CNN outperforms FCN with around 15% in detecting objects, especially in detecting small objects. Moreover, Mask R-CNN has much better results in edge region than FCN. The results also show that choosing the range of anchor scales in Mask R-CNN is a critical factor in segmenting different scale of objects. This paper provides an insight into how a good anchor scale for different dataset should be chosen.</p>

Download Full-text

THE LAND COVER CLASSIFICATION USING A FEATURE PYRAMID NETWORKS ARCHITECTURE FROM SATELLITE IMAGERY

ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences ◽

10.5194/isprs-archives-xliii-b3-2020-241-2020 ◽

2020 ◽

Vol XLIII-B3-2020 ◽

pp. 241-246

Author(s):

Q. Zhang ◽

Y. Zhang ◽

P. Yang ◽

Y. Meng ◽

S. Zhuo ◽

...

Keyword(s):

Land Cover ◽

Transfer Learning ◽

Satellite Imagery ◽

Loss Function ◽

Land Cover Classification ◽

Deep Convolutional Neural Networks ◽

Convolutional Networks ◽

Fully Convolutional Networks ◽

Sensing Applications ◽

Feature Pyramid

Abstract. Extracting land cover information from satellite imagery is of great importance for the task of automated monitoring in various remote sensing applications. Deep convolutional neural networks make this task more feasible, but they are limited by the small dataset of annotated images. In this paper, we present a fully convolutional networks architecture, FPN-VGG, that combines Feature Pyramid Networks and VGG. In order to accomplish the task of land cover classification, we create a land cover dataset of pixel-wise annotated images, and employ a transfer learning step and the variant dice loss function to promote the performance of FPN-VGG. The results indicate that FPN-VGG shows more competence for land cover classification comparing with other state-of-the-art fully convolutional networks. The transfer learning and dice loss function are beneficial to improve the performance of on the small and unbalanced dataset. Our best model on the dataset gets an overall accuracy of 82.9%, an average F1 score of 66.0% and an average IoU of 52.7%.

Download Full-text