Boosted Mask R-CNN algorithm for accurately detecting strawberry plant canopies in the fields from low-altitude drone images
Autor(a) principal: | |
---|---|
Data de Publicação: | 2022 |
Outros Autores: | , , , , |
Tipo de documento: | Artigo |
Idioma: | eng |
Título da fonte: | Food Science and Technology (Campinas) |
Texto Completo: | http://old.scielo.br/scielo.php?script=sci_arttext&pid=S0101-20612022000101392 |
Resumo: | Abstract The research constructs a novel structure by integrating two parts of online object detection pipelines into the current state-of-the-art Mask R-CNN algorithm to improve the detection performance. The DJI Mavic Air drone is used to collect low-altitude sensing images of strawberry plant canopies. The data augmentation method is employed to feed more instances into the original image dataset to boost the generalization and robustness of the detection model in the training procedure. A ResNet50 backbone combined with a feature pyramid network is presented to extract the features of strawberry plant canopies. The online hard example mining algorithm is introduced to mine hard samples to learn rich features and update model weights. Soft non-maximum suppression based on recursive application on the remaining detection boxes within the predefined overlap threshold is proposed to improve the performance of identifying the large complex overlapping area of strawberry plant canopies. The qualitative results demonstrate that the improved detection model had an AP50 of 96.9 and an AR of 78.5 on the test set, which are approximately 30% higher than the original values. |
id |
SBCTA-1_77c7b5619ba8c5d400ffc19cb23f3d6f |
---|---|
oai_identifier_str |
oai:scielo:S0101-20612022000101392 |
network_acronym_str |
SBCTA-1 |
network_name_str |
Food Science and Technology (Campinas) |
repository_id_str |
|
spelling |
Boosted Mask R-CNN algorithm for accurately detecting strawberry plant canopies in the fields from low-altitude drone imagesstrawberry plant canopyfeature pyramid networkonline hard examples miningsoft non-maximum suppressionAbstract The research constructs a novel structure by integrating two parts of online object detection pipelines into the current state-of-the-art Mask R-CNN algorithm to improve the detection performance. The DJI Mavic Air drone is used to collect low-altitude sensing images of strawberry plant canopies. The data augmentation method is employed to feed more instances into the original image dataset to boost the generalization and robustness of the detection model in the training procedure. A ResNet50 backbone combined with a feature pyramid network is presented to extract the features of strawberry plant canopies. The online hard example mining algorithm is introduced to mine hard samples to learn rich features and update model weights. Soft non-maximum suppression based on recursive application on the remaining detection boxes within the predefined overlap threshold is proposed to improve the performance of identifying the large complex overlapping area of strawberry plant canopies. The qualitative results demonstrate that the improved detection model had an AP50 of 96.9 and an AR of 78.5 on the test set, which are approximately 30% higher than the original values.Sociedade Brasileira de Ciência e Tecnologia de Alimentos2022-01-01info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersiontext/htmlhttp://old.scielo.br/scielo.php?script=sci_arttext&pid=S0101-20612022000101392Food Science and Technology v.42 2022reponame:Food Science and Technology (Campinas)instname:Sociedade Brasileira de Ciência e Tecnologia de Alimentos (SBCTA)instacron:SBCTA10.1590/fst.95922info:eu-repo/semantics/openAccessLIN,PingZHANG,HuazheZHAO,FeiyuWANG,XiaoxuanLIU,HuanCHEN,Yongmingeng2022-10-17T00:00:00Zoai:scielo:S0101-20612022000101392Revistahttp://www.scielo.br/ctaONGhttps://old.scielo.br/oai/scielo-oai.php||revista@sbcta.org.br1678-457X0101-2061opendoar:2022-10-17T00:00Food Science and Technology (Campinas) - Sociedade Brasileira de Ciência e Tecnologia de Alimentos (SBCTA)false |
dc.title.none.fl_str_mv |
Boosted Mask R-CNN algorithm for accurately detecting strawberry plant canopies in the fields from low-altitude drone images |
title |
Boosted Mask R-CNN algorithm for accurately detecting strawberry plant canopies in the fields from low-altitude drone images |
spellingShingle |
Boosted Mask R-CNN algorithm for accurately detecting strawberry plant canopies in the fields from low-altitude drone images LIN,Ping strawberry plant canopy feature pyramid network online hard examples mining soft non-maximum suppression |
title_short |
Boosted Mask R-CNN algorithm for accurately detecting strawberry plant canopies in the fields from low-altitude drone images |
title_full |
Boosted Mask R-CNN algorithm for accurately detecting strawberry plant canopies in the fields from low-altitude drone images |
title_fullStr |
Boosted Mask R-CNN algorithm for accurately detecting strawberry plant canopies in the fields from low-altitude drone images |
title_full_unstemmed |
Boosted Mask R-CNN algorithm for accurately detecting strawberry plant canopies in the fields from low-altitude drone images |
title_sort |
Boosted Mask R-CNN algorithm for accurately detecting strawberry plant canopies in the fields from low-altitude drone images |
author |
LIN,Ping |
author_facet |
LIN,Ping ZHANG,Huazhe ZHAO,Feiyu WANG,Xiaoxuan LIU,Huan CHEN,Yongming |
author_role |
author |
author2 |
ZHANG,Huazhe ZHAO,Feiyu WANG,Xiaoxuan LIU,Huan CHEN,Yongming |
author2_role |
author author author author author |
dc.contributor.author.fl_str_mv |
LIN,Ping ZHANG,Huazhe ZHAO,Feiyu WANG,Xiaoxuan LIU,Huan CHEN,Yongming |
dc.subject.por.fl_str_mv |
strawberry plant canopy feature pyramid network online hard examples mining soft non-maximum suppression |
topic |
strawberry plant canopy feature pyramid network online hard examples mining soft non-maximum suppression |
description |
Abstract The research constructs a novel structure by integrating two parts of online object detection pipelines into the current state-of-the-art Mask R-CNN algorithm to improve the detection performance. The DJI Mavic Air drone is used to collect low-altitude sensing images of strawberry plant canopies. The data augmentation method is employed to feed more instances into the original image dataset to boost the generalization and robustness of the detection model in the training procedure. A ResNet50 backbone combined with a feature pyramid network is presented to extract the features of strawberry plant canopies. The online hard example mining algorithm is introduced to mine hard samples to learn rich features and update model weights. Soft non-maximum suppression based on recursive application on the remaining detection boxes within the predefined overlap threshold is proposed to improve the performance of identifying the large complex overlapping area of strawberry plant canopies. The qualitative results demonstrate that the improved detection model had an AP50 of 96.9 and an AR of 78.5 on the test set, which are approximately 30% higher than the original values. |
publishDate |
2022 |
dc.date.none.fl_str_mv |
2022-01-01 |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/article |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
format |
article |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
http://old.scielo.br/scielo.php?script=sci_arttext&pid=S0101-20612022000101392 |
url |
http://old.scielo.br/scielo.php?script=sci_arttext&pid=S0101-20612022000101392 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.relation.none.fl_str_mv |
10.1590/fst.95922 |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
text/html |
dc.publisher.none.fl_str_mv |
Sociedade Brasileira de Ciência e Tecnologia de Alimentos |
publisher.none.fl_str_mv |
Sociedade Brasileira de Ciência e Tecnologia de Alimentos |
dc.source.none.fl_str_mv |
Food Science and Technology v.42 2022 reponame:Food Science and Technology (Campinas) instname:Sociedade Brasileira de Ciência e Tecnologia de Alimentos (SBCTA) instacron:SBCTA |
instname_str |
Sociedade Brasileira de Ciência e Tecnologia de Alimentos (SBCTA) |
instacron_str |
SBCTA |
institution |
SBCTA |
reponame_str |
Food Science and Technology (Campinas) |
collection |
Food Science and Technology (Campinas) |
repository.name.fl_str_mv |
Food Science and Technology (Campinas) - Sociedade Brasileira de Ciência e Tecnologia de Alimentos (SBCTA) |
repository.mail.fl_str_mv |
||revista@sbcta.org.br |
_version_ |
1752126335534235648 |