Benchmarking anchor-based and anchor-free state-of-the-art deep learning methods for individual tree detection in rgb high-resolution images

Detalhes bibliográficos
Autor(a) principal: Zamboni, Pedro
Data de Publicação: 2021
Outros Autores: Junior, José Marcato, Silva, Jonathan de Andrade, Miyoshi, Gabriela Takahashi [UNESP], Matsubara, Edson Takashi, Nogueira, Keiller, Gonçalves, Wesley Nunes
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Institucional da UNESP
Texto Completo: http://dx.doi.org/10.3390/rs13132482
http://hdl.handle.net/11449/229100
Resumo: Urban forests contribute to maintaining livability and increase the resilience of cities in the face of population growth and climate change. Information about the geographical distribution of individual trees is essential for the proper management of these systems. RGB high-resolution aerial images have emerged as a cheap and efficient source of data, although detecting and mapping single trees in an urban environment is a challenging task. Thus, we propose the evaluation of novel methods for single tree crown detection, as most of these methods have not been investigated in remote sensing applications. A total of 21 methods were investigated, including anchor-based (one and two-stage) and anchor-free state-of-the-art deep-learning methods. We used two orthoimages divided into 220 non-overlapping patches of 512 × 512 pixels with a ground sample distance (GSD) of 10 cm. The orthoimages were manually annotated, and 3382 single tree crowns were identified as the ground-truth. Our findings show that the anchor-free detectors achieved the best average performance with an AP50 of 0.686. We observed that the two-stage anchor-based and anchor-free methods showed better performance for this task, emphasizing the FSAF, Double Heads, CARAFE, ATSS, and FoveaBox models. RetinaNet, which is currently commonly applied in remote sensing, did not show satisfactory performance, and Faster R-CNN had lower results than the best methods but with no statistically significant difference. Our findings contribute to a better understanding of the performance of novel deep-learning methods in remote sensing applications and could be used as an indicator of the most suitable methods in such applications.
id UNSP_8b5cb9b3e80056ff7bb5823dd4deb381
oai_identifier_str oai:repositorio.unesp.br:11449/229100
network_acronym_str UNSP
network_name_str Repositório Institucional da UNESP
repository_id_str 2946
spelling Benchmarking anchor-based and anchor-free state-of-the-art deep learning methods for individual tree detection in rgb high-resolution imagesConvolutional neural networkObject detectionRemote sensingUrban forests contribute to maintaining livability and increase the resilience of cities in the face of population growth and climate change. Information about the geographical distribution of individual trees is essential for the proper management of these systems. RGB high-resolution aerial images have emerged as a cheap and efficient source of data, although detecting and mapping single trees in an urban environment is a challenging task. Thus, we propose the evaluation of novel methods for single tree crown detection, as most of these methods have not been investigated in remote sensing applications. A total of 21 methods were investigated, including anchor-based (one and two-stage) and anchor-free state-of-the-art deep-learning methods. We used two orthoimages divided into 220 non-overlapping patches of 512 × 512 pixels with a ground sample distance (GSD) of 10 cm. The orthoimages were manually annotated, and 3382 single tree crowns were identified as the ground-truth. Our findings show that the anchor-free detectors achieved the best average performance with an AP50 of 0.686. We observed that the two-stage anchor-based and anchor-free methods showed better performance for this task, emphasizing the FSAF, Double Heads, CARAFE, ATSS, and FoveaBox models. RetinaNet, which is currently commonly applied in remote sensing, did not show satisfactory performance, and Faster R-CNN had lower results than the best methods but with no statistically significant difference. Our findings contribute to a better understanding of the performance of novel deep-learning methods in remote sensing applications and could be used as an indicator of the most suitable methods in such applications.Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)Faculty of Engineering Architecture and Urbanism and Geography Federal University of Mato Grosso do SulFaculty of Computer Science Federal University of Mato Grosso do SulDepartment of Cartography São Paulo State University (UNESP)Computing Science and Mathematics Division Faculty of Natural Sciences University of StirlingDepartment of Cartography São Paulo State University (UNESP)CNPq: 303559/2019-5CNPq: 304052/2019-1CNPq: 433783/2018-4CAPES: 88881.311850/2018-01Federal University of Mato Grosso do SulUniversidade Estadual Paulista (UNESP)University of StirlingZamboni, PedroJunior, José MarcatoSilva, Jonathan de AndradeMiyoshi, Gabriela Takahashi [UNESP]Matsubara, Edson TakashiNogueira, KeillerGonçalves, Wesley Nunes2022-04-29T08:30:21Z2022-04-29T08:30:21Z2021-07-01info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articlehttp://dx.doi.org/10.3390/rs13132482Remote Sensing, v. 13, n. 13, 2021.2072-4292http://hdl.handle.net/11449/22910010.3390/rs131324822-s2.0-85109397264Scopusreponame:Repositório Institucional da UNESPinstname:Universidade Estadual Paulista (UNESP)instacron:UNESPengRemote Sensinginfo:eu-repo/semantics/openAccess2024-06-18T15:01:39Zoai:repositorio.unesp.br:11449/229100Repositório InstitucionalPUBhttp://repositorio.unesp.br/oai/requestopendoar:29462024-08-05T19:04:35.138846Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)false
dc.title.none.fl_str_mv Benchmarking anchor-based and anchor-free state-of-the-art deep learning methods for individual tree detection in rgb high-resolution images
title Benchmarking anchor-based and anchor-free state-of-the-art deep learning methods for individual tree detection in rgb high-resolution images
spellingShingle Benchmarking anchor-based and anchor-free state-of-the-art deep learning methods for individual tree detection in rgb high-resolution images
Zamboni, Pedro
Convolutional neural network
Object detection
Remote sensing
title_short Benchmarking anchor-based and anchor-free state-of-the-art deep learning methods for individual tree detection in rgb high-resolution images
title_full Benchmarking anchor-based and anchor-free state-of-the-art deep learning methods for individual tree detection in rgb high-resolution images
title_fullStr Benchmarking anchor-based and anchor-free state-of-the-art deep learning methods for individual tree detection in rgb high-resolution images
title_full_unstemmed Benchmarking anchor-based and anchor-free state-of-the-art deep learning methods for individual tree detection in rgb high-resolution images
title_sort Benchmarking anchor-based and anchor-free state-of-the-art deep learning methods for individual tree detection in rgb high-resolution images
author Zamboni, Pedro
author_facet Zamboni, Pedro
Junior, José Marcato
Silva, Jonathan de Andrade
Miyoshi, Gabriela Takahashi [UNESP]
Matsubara, Edson Takashi
Nogueira, Keiller
Gonçalves, Wesley Nunes
author_role author
author2 Junior, José Marcato
Silva, Jonathan de Andrade
Miyoshi, Gabriela Takahashi [UNESP]
Matsubara, Edson Takashi
Nogueira, Keiller
Gonçalves, Wesley Nunes
author2_role author
author
author
author
author
author
dc.contributor.none.fl_str_mv Federal University of Mato Grosso do Sul
Universidade Estadual Paulista (UNESP)
University of Stirling
dc.contributor.author.fl_str_mv Zamboni, Pedro
Junior, José Marcato
Silva, Jonathan de Andrade
Miyoshi, Gabriela Takahashi [UNESP]
Matsubara, Edson Takashi
Nogueira, Keiller
Gonçalves, Wesley Nunes
dc.subject.por.fl_str_mv Convolutional neural network
Object detection
Remote sensing
topic Convolutional neural network
Object detection
Remote sensing
description Urban forests contribute to maintaining livability and increase the resilience of cities in the face of population growth and climate change. Information about the geographical distribution of individual trees is essential for the proper management of these systems. RGB high-resolution aerial images have emerged as a cheap and efficient source of data, although detecting and mapping single trees in an urban environment is a challenging task. Thus, we propose the evaluation of novel methods for single tree crown detection, as most of these methods have not been investigated in remote sensing applications. A total of 21 methods were investigated, including anchor-based (one and two-stage) and anchor-free state-of-the-art deep-learning methods. We used two orthoimages divided into 220 non-overlapping patches of 512 × 512 pixels with a ground sample distance (GSD) of 10 cm. The orthoimages were manually annotated, and 3382 single tree crowns were identified as the ground-truth. Our findings show that the anchor-free detectors achieved the best average performance with an AP50 of 0.686. We observed that the two-stage anchor-based and anchor-free methods showed better performance for this task, emphasizing the FSAF, Double Heads, CARAFE, ATSS, and FoveaBox models. RetinaNet, which is currently commonly applied in remote sensing, did not show satisfactory performance, and Faster R-CNN had lower results than the best methods but with no statistically significant difference. Our findings contribute to a better understanding of the performance of novel deep-learning methods in remote sensing applications and could be used as an indicator of the most suitable methods in such applications.
publishDate 2021
dc.date.none.fl_str_mv 2021-07-01
2022-04-29T08:30:21Z
2022-04-29T08:30:21Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://dx.doi.org/10.3390/rs13132482
Remote Sensing, v. 13, n. 13, 2021.
2072-4292
http://hdl.handle.net/11449/229100
10.3390/rs13132482
2-s2.0-85109397264
url http://dx.doi.org/10.3390/rs13132482
http://hdl.handle.net/11449/229100
identifier_str_mv Remote Sensing, v. 13, n. 13, 2021.
2072-4292
10.3390/rs13132482
2-s2.0-85109397264
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv Remote Sensing
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.source.none.fl_str_mv Scopus
reponame:Repositório Institucional da UNESP
instname:Universidade Estadual Paulista (UNESP)
instacron:UNESP
instname_str Universidade Estadual Paulista (UNESP)
instacron_str UNESP
institution UNESP
reponame_str Repositório Institucional da UNESP
collection Repositório Institucional da UNESP
repository.name.fl_str_mv Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)
repository.mail.fl_str_mv
_version_ 1808129015706288128