Classification of Aerial Visible-Thermal Data Based on Deep Learning Models

Q: How can I download an article?

To download an article from SID, first log in to the site, search for the article title, and click on the 'Download Article' option.

Q: How can I download an ISI article?

To download an ISI article on SID, enter the keyword or article title in the search bar, view the relevant results, click on the desired article, and select the 'Download Article' option.

Q: How can I access the SID database?

To access the SID database, visit SID.ir, create an account, and log in to access scientific resources.

Q: Is downloading articles from SID free?

Some articles on SID are available for free, while others require payment. Details are specified on the article's page.

ABDI GH.; SAMADZADEGAN F.

Title

Classification of Aerial Visible-Thermal Data Based on Deep Learning Models

Author(s)

ABDI GH. | SAMADZADEGAN F. | Issue Writer Certificate

Keywords

Convolutional Neural NetworkQ1

Decision-Level FusionQ1

Deep LearningQ1

Stacked Sparse AutoencoderQ1

Thermal HyperspectralQ1

Abstract

Multi-sensor data fusion is one of the most common and popular remote sensing data classification topics by considering a robust and complete description about the objects of interest. Furthermore, deep feature extraction has recently attracted significant interest and has become a hot research topic in the geoscience and remote sensing research community. In this paper, a Deep Learning decision fusion approach is presented to perform multi-sensor urban remote sensing data classification that contains deep feature extraction, logistic regression classifier, decision-level classifier fusion and context-aware object-based post-processing steps. In this context, a deep architecture is designed to progressively learn invariant and abstract feature representations of the input data comprised of spectral, spatial or joint utilization of spectral-spatial features. In the last one, the raw spectral data are firstly used to take advantage of the available contiguous spectral bands for classification applications. The spatial feature descriptors are secondly made by a local window considering that a set of neighboring pixels for many cases belong to one class. A hybrid set of joint spectral-spatial information is finally made by stacking the above-mentioned feature descriptors. Then, a logistic regression classifier is applied to train high-level features at the top layer and to optimize the Deep Learning framework by enforcing gradient descent from the current setting of the parameters to minimize the training error on the labeling samples. In the next step, an enhanced classification map is estimated by integrating multiple classifier outcomes, followed by a context-aware object-based post-processing refining the obtained pixel-based land cover classification map. In this case, a multiresolution image segmentation method is employed to split the image data into multiple spatially non-overlapping regions and then, the final label of each segmented region is made by majority voting and considering relationships among spatial objects. A series of comparative experiments are conducted on the widely-used dataset of 2014 IEEE GRSS data fusion contest. It enables a challenging multi-resolution and multi-sensor image analysis and data fusion opportunity; the visual data contains a series of color images associated with different strips, and the Thermal Hyperspectral image was acquired by the 84 spectral bands Hyper-Cam airborne sensor over Thetford Mines in Qué bec, Canada, with 874×751 pixels (spatial resolution of 1-m) and comes with a seven class labeled ground truth map. In the above-described datasets, the training samples are randomly detached as one hundred of each ground truth label and the rest are used as the testing samples. A set of comparative experiments are carried out on the above-mentioned datasets to quantitatively investigate the significant advantages of the proposed classification frameworks over the conventional classifiers containing decision tree, discriminant analysis, naï ve Bayes, k-nearest neighbor and support vector machine. The obtained results illustrate the considerable advantages of the proposed Deep Learning decision fusion over the traditional classifiers. In this context, the proposed method provides 3. 91, 6. 65, 2. 81 and 5. 52 percent enhancements for visual, thermal, combination and context-aware object-based post-processing data respectively in terms of OA/Kappa metrics. On the other side, the joint use of imaging systems improves the performance of classification up to 7. 57 and 22. 22 percent with respect to the visible and Thermal Hyperspectral data, respectively.

No record.

APA: Copy

ABDI, GH., & SAMADZADEGAN, F.. (2018). Classification of Aerial Visible-Thermal Data Based on Deep Learning Models. JOURNAL OF GEOMATICS SCIENCE AND TECHNOLOGY, 8(1 ), 221-237. SID. https://sid.ir/paper/249340/en

Vancouver: Copy

ABDI GH., SAMADZADEGAN F.. Classification of Aerial Visible-Thermal Data Based on Deep Learning Models. JOURNAL OF GEOMATICS SCIENCE AND TECHNOLOGY[Internet]. 2018;8(1 ):221-237. Available from: https://sid.ir/paper/249340/en

IEEE: Copy

GH. ABDI, and F. SAMADZADEGAN, “Classification of Aerial Visible-Thermal Data Based on Deep Learning Models,” JOURNAL OF GEOMATICS SCIENCE AND TECHNOLOGY, vol. 8, no. 1 , pp. 221–237, 2018, [Online]. Available: https://sid.ir/paper/249340/en

Scientific Information Database

ISSN: 2588-4824

Journal Paper

Classification of Aerial Visible-Thermal Data Based on Deep Learning Models