Boosted Mask R-CNN algorithm for accurately detecting strawberry plant canopies in the fields from low-altitude drone images

Detalhes bibliográficos
Autor(a) principal: LIN,Ping
Data de Publicação: 2022
Outros Autores: ZHANG,Huazhe, ZHAO,Feiyu, WANG,Xiaoxuan, LIU,Huan, CHEN,Yongming
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Food Science and Technology (Campinas)
Texto Completo: http://old.scielo.br/scielo.php?script=sci_arttext&pid=S0101-20612022000101392
Resumo: Abstract The research constructs a novel structure by integrating two parts of online object detection pipelines into the current state-of-the-art Mask R-CNN algorithm to improve the detection performance. The DJI Mavic Air drone is used to collect low-altitude sensing images of strawberry plant canopies. The data augmentation method is employed to feed more instances into the original image dataset to boost the generalization and robustness of the detection model in the training procedure. A ResNet50 backbone combined with a feature pyramid network is presented to extract the features of strawberry plant canopies. The online hard example mining algorithm is introduced to mine hard samples to learn rich features and update model weights. Soft non-maximum suppression based on recursive application on the remaining detection boxes within the predefined overlap threshold is proposed to improve the performance of identifying the large complex overlapping area of strawberry plant canopies. The qualitative results demonstrate that the improved detection model had an AP50 of 96.9 and an AR of 78.5 on the test set, which are approximately 30% higher than the original values.
id SBCTA-1_77c7b5619ba8c5d400ffc19cb23f3d6f
oai_identifier_str oai:scielo:S0101-20612022000101392
network_acronym_str SBCTA-1
network_name_str Food Science and Technology (Campinas)
repository_id_str
spelling Boosted Mask R-CNN algorithm for accurately detecting strawberry plant canopies in the fields from low-altitude drone imagesstrawberry plant canopyfeature pyramid networkonline hard examples miningsoft non-maximum suppressionAbstract The research constructs a novel structure by integrating two parts of online object detection pipelines into the current state-of-the-art Mask R-CNN algorithm to improve the detection performance. The DJI Mavic Air drone is used to collect low-altitude sensing images of strawberry plant canopies. The data augmentation method is employed to feed more instances into the original image dataset to boost the generalization and robustness of the detection model in the training procedure. A ResNet50 backbone combined with a feature pyramid network is presented to extract the features of strawberry plant canopies. The online hard example mining algorithm is introduced to mine hard samples to learn rich features and update model weights. Soft non-maximum suppression based on recursive application on the remaining detection boxes within the predefined overlap threshold is proposed to improve the performance of identifying the large complex overlapping area of strawberry plant canopies. The qualitative results demonstrate that the improved detection model had an AP50 of 96.9 and an AR of 78.5 on the test set, which are approximately 30% higher than the original values.Sociedade Brasileira de Ciência e Tecnologia de Alimentos2022-01-01info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersiontext/htmlhttp://old.scielo.br/scielo.php?script=sci_arttext&pid=S0101-20612022000101392Food Science and Technology v.42 2022reponame:Food Science and Technology (Campinas)instname:Sociedade Brasileira de Ciência e Tecnologia de Alimentos (SBCTA)instacron:SBCTA10.1590/fst.95922info:eu-repo/semantics/openAccessLIN,PingZHANG,HuazheZHAO,FeiyuWANG,XiaoxuanLIU,HuanCHEN,Yongmingeng2022-10-17T00:00:00Zoai:scielo:S0101-20612022000101392Revistahttp://www.scielo.br/ctaONGhttps://old.scielo.br/oai/scielo-oai.php||revista@sbcta.org.br1678-457X0101-2061opendoar:2022-10-17T00:00Food Science and Technology (Campinas) - Sociedade Brasileira de Ciência e Tecnologia de Alimentos (SBCTA)false
dc.title.none.fl_str_mv Boosted Mask R-CNN algorithm for accurately detecting strawberry plant canopies in the fields from low-altitude drone images
title Boosted Mask R-CNN algorithm for accurately detecting strawberry plant canopies in the fields from low-altitude drone images
spellingShingle Boosted Mask R-CNN algorithm for accurately detecting strawberry plant canopies in the fields from low-altitude drone images
LIN,Ping
strawberry plant canopy
feature pyramid network
online hard examples mining
soft non-maximum suppression
title_short Boosted Mask R-CNN algorithm for accurately detecting strawberry plant canopies in the fields from low-altitude drone images
title_full Boosted Mask R-CNN algorithm for accurately detecting strawberry plant canopies in the fields from low-altitude drone images
title_fullStr Boosted Mask R-CNN algorithm for accurately detecting strawberry plant canopies in the fields from low-altitude drone images
title_full_unstemmed Boosted Mask R-CNN algorithm for accurately detecting strawberry plant canopies in the fields from low-altitude drone images
title_sort Boosted Mask R-CNN algorithm for accurately detecting strawberry plant canopies in the fields from low-altitude drone images
author LIN,Ping
author_facet LIN,Ping
ZHANG,Huazhe
ZHAO,Feiyu
WANG,Xiaoxuan
LIU,Huan
CHEN,Yongming
author_role author
author2 ZHANG,Huazhe
ZHAO,Feiyu
WANG,Xiaoxuan
LIU,Huan
CHEN,Yongming
author2_role author
author
author
author
author
dc.contributor.author.fl_str_mv LIN,Ping
ZHANG,Huazhe
ZHAO,Feiyu
WANG,Xiaoxuan
LIU,Huan
CHEN,Yongming
dc.subject.por.fl_str_mv strawberry plant canopy
feature pyramid network
online hard examples mining
soft non-maximum suppression
topic strawberry plant canopy
feature pyramid network
online hard examples mining
soft non-maximum suppression
description Abstract The research constructs a novel structure by integrating two parts of online object detection pipelines into the current state-of-the-art Mask R-CNN algorithm to improve the detection performance. The DJI Mavic Air drone is used to collect low-altitude sensing images of strawberry plant canopies. The data augmentation method is employed to feed more instances into the original image dataset to boost the generalization and robustness of the detection model in the training procedure. A ResNet50 backbone combined with a feature pyramid network is presented to extract the features of strawberry plant canopies. The online hard example mining algorithm is introduced to mine hard samples to learn rich features and update model weights. Soft non-maximum suppression based on recursive application on the remaining detection boxes within the predefined overlap threshold is proposed to improve the performance of identifying the large complex overlapping area of strawberry plant canopies. The qualitative results demonstrate that the improved detection model had an AP50 of 96.9 and an AR of 78.5 on the test set, which are approximately 30% higher than the original values.
publishDate 2022
dc.date.none.fl_str_mv 2022-01-01
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://old.scielo.br/scielo.php?script=sci_arttext&pid=S0101-20612022000101392
url http://old.scielo.br/scielo.php?script=sci_arttext&pid=S0101-20612022000101392
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv 10.1590/fst.95922
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv text/html
dc.publisher.none.fl_str_mv Sociedade Brasileira de Ciência e Tecnologia de Alimentos
publisher.none.fl_str_mv Sociedade Brasileira de Ciência e Tecnologia de Alimentos
dc.source.none.fl_str_mv Food Science and Technology v.42 2022
reponame:Food Science and Technology (Campinas)
instname:Sociedade Brasileira de Ciência e Tecnologia de Alimentos (SBCTA)
instacron:SBCTA
instname_str Sociedade Brasileira de Ciência e Tecnologia de Alimentos (SBCTA)
instacron_str SBCTA
institution SBCTA
reponame_str Food Science and Technology (Campinas)
collection Food Science and Technology (Campinas)
repository.name.fl_str_mv Food Science and Technology (Campinas) - Sociedade Brasileira de Ciência e Tecnologia de Alimentos (SBCTA)
repository.mail.fl_str_mv ||revista@sbcta.org.br
_version_ 1752126335534235648