scholarly journals Tree Species Classification of Drone Hyperspectral and RGB Imagery with Deep Learning Convolutional Neural Networks

2020 ◽  
Author(s):  
Somayeh Nezami ◽  
Ehsan Khoramshahi ◽  
Olli Nevalainen ◽  
Ilkka Pölönen ◽  
Eija Honkavaara
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Tree Species ◽  
Classification Accuracy ◽  
Performance Metrics ◽  
Test Site ◽  
Species Classification ◽  
Tree Species Classification ◽  
3D Cnn ◽  
Individual Trees

Interest in drone solutions in forestry applications is growing. Using drones, datasets can be captured flexibly and at high spatial and temporal resolutions when needed. In forestry applications, fundamental tasks include the detection of individual trees, tree species classification, bio-mass estimation, etc. Deep Neural Networks (DNN) have shown superior results when comparing with conventional machine learning methods such as Multi-Layer Perceptron (MLP) in cases of huge input data. The objective of this research was to investigate 3D convolutional neural networks (3D-CNN) to classify three major tree species in a boreal forest: pine, spruce, and birch. The proposed 3D-CNN models were employed to classify tree species in a test site in Finland. The classifiers were trained with a dataset of 3039 manually labelled trees. Then the accuracies were assessed by employing independent datasets of 803 records. To find the most efficient set of feature combination, we compare the performances of 3D-CNN models trained with hyperspectral (HS) channels, RGB channels, and canopy height model (CHM), separately and combined. It is demonstrated that the proposed 3D-CNN model with RGB and HS layers produces the highest classification accuracy. The producer accuracy of the best 3D-CNN classifier on the test dataset were 99.6%, 94.8%, and 97.4% for pines, spruces, and birches, respectively. The best 3D-CNN classifier produced ~5% better classification accuracy than the MLP with all layers. Our results suggest that the proposed method provides excellent classification results with acceptable performance metrics for HS datasets. Our results show that pine class was detectable in most layers. Spruce was most detectable in RGB data, while birch was most detectable in the HS layers. Furthermore, the RGB datasets provide acceptable results for many low-accuracy applications.

scholarly journals Tree Species Classification of Drone Hyperspectral and RGB Imagery with Deep Learning Convolutional Neural Networks

2020 ◽  
Vol 12 (7) ◽  
pp. 1070 ◽  
Author(s):  
Somayeh Nezami ◽  
Ehsan Khoramshahi ◽  
Olli Nevalainen ◽  
Ilkka Pölönen ◽  
Eija Honkavaara
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Tree Species ◽  
Classification Accuracy ◽  
Performance Metrics ◽  
Test Site ◽  
Biomass Estimation ◽  
Species Classification ◽  
Tree Species Classification ◽  
3D Cnn

Interest in drone solutions in forestry applications is growing. Using drones, datasets can be captured flexibly and at high spatial and temporal resolutions when needed. In forestry applications, fundamental tasks include the detection of individual trees, tree species classification, biomass estimation, etc. Deep neural networks (DNN) have shown superior results when comparing with conventional machine learning methods such as multi-layer perceptron (MLP) in cases of huge input data. The objective of this research is to investigate 3D convolutional neural networks (3D-CNN) to classify three major tree species in a boreal forest: pine, spruce, and birch. The proposed 3D-CNN models were employed to classify tree species in a test site in Finland. The classifiers were trained with a dataset of 3039 manually labelled trees. Then the accuracies were assessed by employing independent datasets of 803 records. To find the most efficient set of feature combination, we compare the performances of 3D-CNN models trained with hyperspectral (HS) channels, Red-Green-Blue (RGB) channels, and canopy height model (CHM), separately and combined. It is demonstrated that the proposed 3D-CNN model with RGB and HS layers produces the highest classification accuracy. The producer accuracy of the best 3D-CNN classifier on the test dataset were 99.6%, 94.8%, and 97.4% for pines, spruces, and birches, respectively. The best 3D-CNN classifier produced ~5% better classification accuracy than the MLP with all layers. Our results suggest that the proposed method provides excellent classification results with acceptable performance metrics for HS datasets. Our results show that pine class was detectable in most layers. Spruce was most detectable in RGB data, while birch was most detectable in the HS layers. Furthermore, the RGB datasets provide acceptable results for many low-accuracy applications.

scholarly journals Tree species classification from airborne hyperspectral and LiDAR data using 3D convolutional neural networks

2021 ◽  
Vol 256 ◽  
pp. 112322
Author(s):  
Janne Mäyrä ◽  
Sarita Keski-Saari ◽  
Sonja Kivinen ◽  
Topi Tanhuanpää ◽  
Pekka Hurskainen ◽  
...  
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Tree Species ◽  
Lidar Data ◽  
Species Classification ◽  
Tree Species Classification

scholarly journals RESNET-BASED TREE SPECIES CLASSIFICATION USING UAV IMAGES

2019 ◽  
Vol XLII-2/W13 ◽  
pp. 475-481 ◽  
Author(s):  
S. Natesan ◽  
C. Armenakis ◽  
U. Vepakomma
Keyword(s):  
Neural Networks ◽  
High Resolution ◽  
Tree Species ◽  
Classification Accuracy ◽  
Forest Tree ◽  
Tree Level ◽  
Species Classification ◽  
Individual Tree ◽  
Tree Species Classification ◽  
Rgb Images

<p><strong>Abstract.</strong> Tree species classification at individual tree level is a challenging problem in forest management. Deep learning, a cutting-edge technology evolved from Artificial Intelligence, was seen to outperform other techniques when it comes to complex problems such as image classification. In this work, we present a novel method to classify forest tree species through high resolution RGB images acquired with a simple consumer grade camera mounted on a UAV platform using Residual Neural Networks. We used UAV RGB images acquired over three years that varied in numerous acquisition parameters such as season, time, illumination and angle to train the neural network. To begin with, we have experimented with limited data towards the identification of two pine species namely red pine and white pine from the rest of the species. We performed two experiments, first with the images from all three acquisition years and the second with images from only one acquisition year. In the first experiment, we obtained 80% classification accuracy when the trained network was tested on a distinct set of images and in the second experiment, we obtained 51% classification accuracy. As a part of this work, a novel dataset of high-resolution labelled tree species is generated that can be used to conduct further studies involving deep neural networks in forestry.</p>

scholarly journals 3D-CNN BASED TREE SPECIES CLASSIFICATION USING MOBILE LIDAR DATA

2019 ◽  
Vol XLII-2/W13 ◽  
pp. 989-993
Author(s):  
H. Guan ◽  
Y. Yu ◽  
W. Yan ◽  
D. Li ◽  
J. Li
Keyword(s):  
Tree Species ◽  
Laser Scanning ◽  
Lidar Data ◽  
Species Classification ◽  
Section Data ◽  
Tree Species Classification ◽  
Intensity Information ◽  
Segmentation Approach ◽  
3D Cnn ◽  
Individual Trees

<p><strong>Abstract.</strong> Our work addresses the problem of classifying tree species from mobile LiDAR data. The work is a two step-wise strategy, including tree segmentation and tree species classification. In the tree segmentation step, a voxel-based upward growing filtering is proposed to remove terrain points from the mobile laser scanning data. Then, individual trees are segmented via a Euclidean distance clustering approach and Voxel-based Normalized Cut (VNCut) segmentation approach. In the tree species classification, a voxel-based 3D convolutional neural network (3D-CNN) model is developed based on intensity information. A road section data acquired by a RIEGL VMX-450 system are selected for evaluating the proposed tree classification method. Qualitative analysis shows that our algorithm achieves a good performance.</p>

scholarly journals An Evaluation of Pixel- and Object-Based Tree Species Classification in Mixed Deciduous Forests Using Pansharpened Very High Spatial Resolution Satellite Imagery

2021 ◽  
Vol 13 (10) ◽  
pp. 1868
Author(s):  
Martina Deur ◽  
Mateo Gašparović ◽  
Ivan Balenović
Keyword(s):  
Spatial Resolution ◽  
Satellite Imagery ◽  
Tree Species ◽  
Classification Accuracy ◽  
New Technologies ◽  
Deciduous Forest ◽  
Species Classification ◽  
Tree Species Classification ◽  
Object Based ◽  
Very High

Quality tree species information gathering is the basis for making proper decisions in forest management. By applying new technologies and remote sensing methods, very high resolution (VHR) satellite imagery can give sufficient spatial detail to achieve accurate species-level classification. In this study, the influence of pansharpening of the WorldView-3 (WV-3) satellite imagery on classification results of three main tree species (Quercus robur L., Carpinus betulus L., and Alnus glutinosa (L.) Geartn.) has been evaluated. In order to increase tree species classification accuracy, three different pansharpening algorithms (Bayes, RCS, and LMVM) have been conducted. The LMVM algorithm proved the most effective pansharpening technique. The pixel- and object-based classification were applied to three pansharpened imageries using a random forest (RF) algorithm. The results showed a very high overall accuracy (OA) for LMVM pansharpened imagery: 92% and 96% for tree species classification based on pixel- and object-based approach, respectively. As expected, the object-based exceeded the pixel-based approach (OA increased by 4%). The influence of fusion on classification results was analyzed as well. Overall classification accuracy was improved by the spatial resolution of pansharpened images (OA increased by 7% for pixel-based approach). Also, regardless of pixel- or object-based classification approaches, the influence of the use of pansharpening is highly beneficial to classifying complex, natural, and mixed deciduous forest areas.

scholarly journals Mapping Tree Species Composition Using OHS-1 Hyperspectral Data and Deep Learning Algorithms in Changbai Mountains, Northeast China

Forests ◽  
2019 ◽  
Vol 10 (9) ◽  
pp. 818
Author(s):  
Yanbiao Xi ◽  
Chunying Ren ◽  
Zongming Wang ◽  
Shiqing Wei ◽  
Jialing Bai ◽  
...  
Keyword(s):  
Deep Learning ◽  
Tree Species ◽  
Classification Accuracy ◽  
Learning Algorithms ◽  
Spectral Characteristics ◽  
Great Influence ◽  
Hyperspectral Images ◽  
Changbai Mountains ◽  
Species Classification ◽  
Tree Species Classification

The accurate characterization of tree species distribution in forest areas can help significantly reduce uncertainties in the estimation of ecosystem parameters and forest resources. Deep learning algorithms have become a hot topic in recent years, but they have so far not been applied to tree species classification. In this study, one-dimensional convolutional neural network (Conv1D), a popular deep learning algorithm, was proposed to automatically identify tree species using OHS-1 hyperspectral images. Additionally, the random forest (RF) classifier was applied to compare to the algorithm of deep learning. Based on our experiments, we drew three main conclusions: First, the OHS-1 hyperspectral images used in this study have high spatial resolution (10 m), which reduces the influence of mixed pixel effect and greatly improves the classification accuracy. Second, limited by the amount of sample data, Conv1D-based classifier does not need too many layers to achieve high classification accuracy. In addition, the size of the convolution kernel has a great influence on the classification accuracy. Finally, the accuracy of Conv1D (85.04%) is higher than that of RF model (80.61%). Especially for broadleaf species with similar spectral characteristics, such as Manchurian walnut and aspen, the accuracy of Conv1D-based classifier is significantly higher than RF classifier (87.15% and 71.77%, respectively). Thus, the Conv1D-based deep learning framework combined with hyperspectral imagery can efficiently improve the accuracy of tree species classification and has great application prospects in the future.

scholarly journals A Review: Individual Tree Species Classification Using Integrated Airborne LiDAR and Optical Imagery with a Focus on the Urban Environment

Forests ◽  
2018 ◽  
Vol 10 (1) ◽  
pp. 1 ◽  
Author(s):  
Kepu Wang ◽  
Tiejun Wang ◽  
Xuehua Liu
Keyword(s):  
Tree Species ◽  
Classification Accuracy ◽  
Urban Environments ◽  
Airborne Lidar ◽  
Lidar Data ◽  
Species Classification ◽  
Individual Tree ◽  
Urban Tree ◽  
Tree Species Classification ◽  
Optical Imagery

With the significant progress of urbanization, cities and towns are suffering from air pollution, heat island effects, and other environmental problems. Urban vegetation, especially trees, plays a significant role in solving these ecological problems. To maximize services provided by vegetation, urban tree species should be properly selected and optimally arranged. Therefore, accurate classification of tree species in urban environments has become a major issue. In this paper, we reviewed the potential of light detection and ranging (LiDAR) data to improve the accuracy of urban tree species classification. In detail, we reviewed the studies using LiDAR data in urban tree species mapping, especially studies where LiDAR data was fused with optical imagery, through classification accuracy comparison, general workflow extraction, and discussion and summarizing of the specific contribution of LiDAR. It is concluded that combining LiDAR data in urban tree species identification could achieve better classification accuracy than using either dataset individually, and that such improvements are mainly due to finer segmentation, shadowing effect reduction, and refinement of classification rules based on LiDAR. Furthermore, some suggestions are given to improve the classification accuracy on a finer and larger species level, while also aiming to maintain classification costs.

scholarly journals An Improved Res-UNet Model for Tree Species Classification Using Airborne High-Resolution Images

2020 ◽  
Vol 12 (7) ◽  
pp. 1128 ◽  
Author(s):  
Kaili Cao ◽  
Xiaoli Zhang
Keyword(s):  
Deep Learning ◽  
Tree Species ◽  
Classification Accuracy ◽  
Southern China ◽  
Forest Tree ◽  
Image Features ◽  
Support Vector ◽  
Learning Technology ◽  
Species Classification ◽  
Tree Species Classification

Tree species classification is important for the management and sustainable development of forest resources. Traditional object-oriented tree species classification methods, such as support vector machines, require manual feature selection and generally low accuracy, whereas deep learning technology can automatically extract image features to achieve end-to-end classification. Therefore, a tree classification method based on deep learning is proposed in this study. This method combines the semantic segmentation network U-Net and the feature extraction network ResNet into an improved Res-UNet network, where the convolutional layer of the U-Net network is represented by the residual unit of ResNet, and linear interpolation is used instead of deconvolution in each upsampling layer. At the output of the network, conditional random fields are used for post-processing. This network model is used to perform classification experiments on airborne orthophotos of Nanning Gaofeng Forest Farm in Guangxi, China. The results are then compared with those of U-Net and ResNet networks. The proposed method exhibits higher classification accuracy with an overall classification accuracy of 87%. Thus, the proposed model can effectively implement forest tree species classification and provide new opportunities for tree species classification in southern China.

scholarly journals Classification of Typical Tree Species in Laser Point Cloud Based on Deep Learning

2021 ◽  
Vol 13 (23) ◽  
pp. 4750
Author(s):  
Jianchang Chen ◽  
Yiming Chen ◽  
Zhengjun Liu
Keyword(s):  
Feature Extraction ◽  
Deep Learning ◽  
Tree Species ◽  
Classification Accuracy ◽  
Point Cloud ◽  
Laser Scanning ◽  
Species Classification ◽  
Tree Species Classification ◽  
Network Mapping

We propose the Point Cloud Tree Species Classification Network (PCTSCN) to overcome challenges in classifying tree species from laser data with deep learning methods. The network is mainly composed of two parts: a sampling component in the early stage and a feature extraction component in the later stage. We used geometric sampling to extract regions with local features from the tree contours since these tend to be species-specific. Then we used an improved Farthest Point Sampling method to extract the features from a global perspective. We input the intensity of the tree point cloud as a dimensional feature and spatial information into the neural network and mapped it to higher dimensions for feature extraction. We used the data obtained by Terrestrial Laser Scanning (TLS) and Unmanned Aerial Vehicle Laser Scanning (UAVLS) to conduct tree species classification experiments of white birch and larch. The experimental results showed that in both the TLS and UAVLS datasets, the input tree point cloud density and the highest feature dimensionality of the mapping had an impact on the classification accuracy of the tree species. When the single tree sample obtained by TLS consisted of 1024 points and the highest dimension of the network mapping was 512, the classification accuracy of the trained model reached 96%. For the individual tree samples obtained by UAVLS, which consisted of 2048 points and had the highest dimension of the network mapping of 1024, the classification accuracy of the trained model reached 92%. TLS data tree species classification accuracy of PCTSCN was improved by 2–9% compared with other models using the same point density, amount of data and highest feature dimension. The classification accuracy of tree species obtained by UAVLS was up to 8% higher. We propose PCTSCN to provide a new strategy for the intelligent classification of forest tree species.

scholarly journals Continental-scale Hyperspectral tree species classification in the National Ecological Observatory Network

2021 ◽  
Author(s):  
Sergio Marconi ◽  
Ben G Weinstein ◽  
Sheng Zou ◽  
Stephanie Ann Bohlman ◽  
Alina Zare ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Tree Species ◽  
General Model ◽  
Classification Accuracy ◽  
Tree Level ◽  
Species Classification ◽  
Site Specific ◽  
Continental Scale ◽  
Tree Species Classification ◽  
The Us

Advances in remote sensing imagery and computer vision applications unlock the potential for developing algorithms to classify individual trees from remote sensing at unprecedented scales. However, most approaches to date focus on site-specific applications and a small number of taxonomic groups. This limitation makes it hard to evaluate whether these approaches generalize well across broader geographic areas and ecosystems. Leveraging field surveys and hyperspectral remote sensing data from the National Ecological Observatory Network (NEON), we developed a continental extent model for tree species classification that can be applied to the entire network including a wide range of US terrestrial ecosystems. We compared the performance of the generalized approach to models trained at each individual site, evaluating advantages and challenges posed by training species classifiers at the US scale. We evaluated the effect of geography, environmental, and ecological conditions on the accuracy and precision of species predictions. On average, the general model resulted in good overall classification accuracy (micro-F1 score), with better accuracy than site-specific classifiers (average individual tree level accuracy of 0.77 for the general model and 0.72 for site-specific models). Aggregating species to the genus-level increased accuracy to 0.83. Regions with more species exhibited lower classification accuracy. Trees were more likely to be confused with congeneric and co-occurring species and confusion was highest for trees with structural damage and in complex closed-canopy forests. The model produced accurate estimates of uncertainty, correctly identifying trees where confusion was likely. Using only data from NEON this single integrated classifier can make predictions for 20% of all tree species found in forest ecosystems across the US, suggesting the potential for broad scale general models for species classification from hyperspectral imaging.

Sign in / Sign up

Export Citation Format

Share Document