Benchmarking anchor-based and anchor-free state-of-the-art deep learning methods for individual tree detection in rgb high-resolution images
Autor(a) principal: | |
---|---|
Data de Publicação: | 2021 |
Outros Autores: | , , , , , |
Tipo de documento: | Artigo |
Idioma: | eng |
Título da fonte: | Repositório Institucional da UNESP |
Texto Completo: | http://dx.doi.org/10.3390/rs13132482 http://hdl.handle.net/11449/229100 |
Resumo: | Urban forests contribute to maintaining livability and increase the resilience of cities in the face of population growth and climate change. Information about the geographical distribution of individual trees is essential for the proper management of these systems. RGB high-resolution aerial images have emerged as a cheap and efficient source of data, although detecting and mapping single trees in an urban environment is a challenging task. Thus, we propose the evaluation of novel methods for single tree crown detection, as most of these methods have not been investigated in remote sensing applications. A total of 21 methods were investigated, including anchor-based (one and two-stage) and anchor-free state-of-the-art deep-learning methods. We used two orthoimages divided into 220 non-overlapping patches of 512 × 512 pixels with a ground sample distance (GSD) of 10 cm. The orthoimages were manually annotated, and 3382 single tree crowns were identified as the ground-truth. Our findings show that the anchor-free detectors achieved the best average performance with an AP50 of 0.686. We observed that the two-stage anchor-based and anchor-free methods showed better performance for this task, emphasizing the FSAF, Double Heads, CARAFE, ATSS, and FoveaBox models. RetinaNet, which is currently commonly applied in remote sensing, did not show satisfactory performance, and Faster R-CNN had lower results than the best methods but with no statistically significant difference. Our findings contribute to a better understanding of the performance of novel deep-learning methods in remote sensing applications and could be used as an indicator of the most suitable methods in such applications. |
id |
UNSP_8b5cb9b3e80056ff7bb5823dd4deb381 |
---|---|
oai_identifier_str |
oai:repositorio.unesp.br:11449/229100 |
network_acronym_str |
UNSP |
network_name_str |
Repositório Institucional da UNESP |
repository_id_str |
2946 |
spelling |
Benchmarking anchor-based and anchor-free state-of-the-art deep learning methods for individual tree detection in rgb high-resolution imagesConvolutional neural networkObject detectionRemote sensingUrban forests contribute to maintaining livability and increase the resilience of cities in the face of population growth and climate change. Information about the geographical distribution of individual trees is essential for the proper management of these systems. RGB high-resolution aerial images have emerged as a cheap and efficient source of data, although detecting and mapping single trees in an urban environment is a challenging task. Thus, we propose the evaluation of novel methods for single tree crown detection, as most of these methods have not been investigated in remote sensing applications. A total of 21 methods were investigated, including anchor-based (one and two-stage) and anchor-free state-of-the-art deep-learning methods. We used two orthoimages divided into 220 non-overlapping patches of 512 × 512 pixels with a ground sample distance (GSD) of 10 cm. The orthoimages were manually annotated, and 3382 single tree crowns were identified as the ground-truth. Our findings show that the anchor-free detectors achieved the best average performance with an AP50 of 0.686. We observed that the two-stage anchor-based and anchor-free methods showed better performance for this task, emphasizing the FSAF, Double Heads, CARAFE, ATSS, and FoveaBox models. RetinaNet, which is currently commonly applied in remote sensing, did not show satisfactory performance, and Faster R-CNN had lower results than the best methods but with no statistically significant difference. Our findings contribute to a better understanding of the performance of novel deep-learning methods in remote sensing applications and could be used as an indicator of the most suitable methods in such applications.Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)Faculty of Engineering Architecture and Urbanism and Geography Federal University of Mato Grosso do SulFaculty of Computer Science Federal University of Mato Grosso do SulDepartment of Cartography São Paulo State University (UNESP)Computing Science and Mathematics Division Faculty of Natural Sciences University of StirlingDepartment of Cartography São Paulo State University (UNESP)CNPq: 303559/2019-5CNPq: 304052/2019-1CNPq: 433783/2018-4CAPES: 88881.311850/2018-01Federal University of Mato Grosso do SulUniversidade Estadual Paulista (UNESP)University of StirlingZamboni, PedroJunior, José MarcatoSilva, Jonathan de AndradeMiyoshi, Gabriela Takahashi [UNESP]Matsubara, Edson TakashiNogueira, KeillerGonçalves, Wesley Nunes2022-04-29T08:30:21Z2022-04-29T08:30:21Z2021-07-01info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articlehttp://dx.doi.org/10.3390/rs13132482Remote Sensing, v. 13, n. 13, 2021.2072-4292http://hdl.handle.net/11449/22910010.3390/rs131324822-s2.0-85109397264Scopusreponame:Repositório Institucional da UNESPinstname:Universidade Estadual Paulista (UNESP)instacron:UNESPengRemote Sensinginfo:eu-repo/semantics/openAccess2024-06-18T15:01:39Zoai:repositorio.unesp.br:11449/229100Repositório InstitucionalPUBhttp://repositorio.unesp.br/oai/requestopendoar:29462024-08-05T19:04:35.138846Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)false |
dc.title.none.fl_str_mv |
Benchmarking anchor-based and anchor-free state-of-the-art deep learning methods for individual tree detection in rgb high-resolution images |
title |
Benchmarking anchor-based and anchor-free state-of-the-art deep learning methods for individual tree detection in rgb high-resolution images |
spellingShingle |
Benchmarking anchor-based and anchor-free state-of-the-art deep learning methods for individual tree detection in rgb high-resolution images Zamboni, Pedro Convolutional neural network Object detection Remote sensing |
title_short |
Benchmarking anchor-based and anchor-free state-of-the-art deep learning methods for individual tree detection in rgb high-resolution images |
title_full |
Benchmarking anchor-based and anchor-free state-of-the-art deep learning methods for individual tree detection in rgb high-resolution images |
title_fullStr |
Benchmarking anchor-based and anchor-free state-of-the-art deep learning methods for individual tree detection in rgb high-resolution images |
title_full_unstemmed |
Benchmarking anchor-based and anchor-free state-of-the-art deep learning methods for individual tree detection in rgb high-resolution images |
title_sort |
Benchmarking anchor-based and anchor-free state-of-the-art deep learning methods for individual tree detection in rgb high-resolution images |
author |
Zamboni, Pedro |
author_facet |
Zamboni, Pedro Junior, José Marcato Silva, Jonathan de Andrade Miyoshi, Gabriela Takahashi [UNESP] Matsubara, Edson Takashi Nogueira, Keiller Gonçalves, Wesley Nunes |
author_role |
author |
author2 |
Junior, José Marcato Silva, Jonathan de Andrade Miyoshi, Gabriela Takahashi [UNESP] Matsubara, Edson Takashi Nogueira, Keiller Gonçalves, Wesley Nunes |
author2_role |
author author author author author author |
dc.contributor.none.fl_str_mv |
Federal University of Mato Grosso do Sul Universidade Estadual Paulista (UNESP) University of Stirling |
dc.contributor.author.fl_str_mv |
Zamboni, Pedro Junior, José Marcato Silva, Jonathan de Andrade Miyoshi, Gabriela Takahashi [UNESP] Matsubara, Edson Takashi Nogueira, Keiller Gonçalves, Wesley Nunes |
dc.subject.por.fl_str_mv |
Convolutional neural network Object detection Remote sensing |
topic |
Convolutional neural network Object detection Remote sensing |
description |
Urban forests contribute to maintaining livability and increase the resilience of cities in the face of population growth and climate change. Information about the geographical distribution of individual trees is essential for the proper management of these systems. RGB high-resolution aerial images have emerged as a cheap and efficient source of data, although detecting and mapping single trees in an urban environment is a challenging task. Thus, we propose the evaluation of novel methods for single tree crown detection, as most of these methods have not been investigated in remote sensing applications. A total of 21 methods were investigated, including anchor-based (one and two-stage) and anchor-free state-of-the-art deep-learning methods. We used two orthoimages divided into 220 non-overlapping patches of 512 × 512 pixels with a ground sample distance (GSD) of 10 cm. The orthoimages were manually annotated, and 3382 single tree crowns were identified as the ground-truth. Our findings show that the anchor-free detectors achieved the best average performance with an AP50 of 0.686. We observed that the two-stage anchor-based and anchor-free methods showed better performance for this task, emphasizing the FSAF, Double Heads, CARAFE, ATSS, and FoveaBox models. RetinaNet, which is currently commonly applied in remote sensing, did not show satisfactory performance, and Faster R-CNN had lower results than the best methods but with no statistically significant difference. Our findings contribute to a better understanding of the performance of novel deep-learning methods in remote sensing applications and could be used as an indicator of the most suitable methods in such applications. |
publishDate |
2021 |
dc.date.none.fl_str_mv |
2021-07-01 2022-04-29T08:30:21Z 2022-04-29T08:30:21Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/article |
format |
article |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
http://dx.doi.org/10.3390/rs13132482 Remote Sensing, v. 13, n. 13, 2021. 2072-4292 http://hdl.handle.net/11449/229100 10.3390/rs13132482 2-s2.0-85109397264 |
url |
http://dx.doi.org/10.3390/rs13132482 http://hdl.handle.net/11449/229100 |
identifier_str_mv |
Remote Sensing, v. 13, n. 13, 2021. 2072-4292 10.3390/rs13132482 2-s2.0-85109397264 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.relation.none.fl_str_mv |
Remote Sensing |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.source.none.fl_str_mv |
Scopus reponame:Repositório Institucional da UNESP instname:Universidade Estadual Paulista (UNESP) instacron:UNESP |
instname_str |
Universidade Estadual Paulista (UNESP) |
instacron_str |
UNESP |
institution |
UNESP |
reponame_str |
Repositório Institucional da UNESP |
collection |
Repositório Institucional da UNESP |
repository.name.fl_str_mv |
Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP) |
repository.mail.fl_str_mv |
|
_version_ |
1808129015706288128 |