Deep learning architectures for semantic segmentation and automatic estimation of severity of foliar symptoms caused by diseases or pests.

Detalhes bibliográficos
Autor(a) principal: GONÇALVES, J. P.
Data de Publicação: 2021
Outros Autores: PINTO, F. A. C., QUEIROZ, D. M., VILLAR, F. M. M., BARBEDO, J. G. A., DEL PONTE, E. M.
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Institucional da EMBRAPA (Repository Open Access to Scientific Information from EMBRAPA - Alice)
Texto Completo: http://www.alice.cnptia.embrapa.br/alice/handle/doc/1134326
https://doi.org/10.1016/j.biosystemseng.2021.08.011
Resumo: Colour-thresholding digital imaging methods are generally accurate for measuring the percentage of foliar area affected by disease or pests (severity), but they perform poorly when scene illumination and background are not uniform. In this study, six convolutional neural network (CNN) architectures were trained for semantic segmentation in images of individual leaves exhibiting necrotic lesions and/or yellowing, caused by the insect pest coffee leaf miner (CLM), and two fungal diseases: soybean rust (SBR) and wheat tan spot (WTS). All images were manually annotated for three classes: leaf background (B), healthy leaf (H) and injured leaf (I). Precision, recall, and Intersection over Union (IoU) metrics in the test image set were the highest for B, followed by H and I classes, regardless of the architecture. When the pixel-level predictions were used to calculate percent severity, Feature Pyramid Network (FPN), Unet and DeepLabv3+ (Xception) performed the best among the architectures: concordance coefficients were greater than 0.95, 0.96 and 0.98 for CLM, SBR and WTS datasets, respectively, when confronting predictions with the annotated severity. The other three architectures tended to misclassify healthy pixels as injured, leading to overestimation of severity. Results highlight the value of a CNN-based automatic segmentation method to determine the severity on images of foliar diseases obtained under challenging conditions of brightness and background. The accuracy levels of the severity estimated by the FPN, Unet and DeepLabv3 + (Xception) were similar to those obtained by a standard commercial software, which requires adjustment of segmentation parameters and removal of the complex background of the images, tasks that slow down the process.
id EMBR_d6b80144348f5252faec1ca15c562be2
oai_identifier_str oai:www.alice.cnptia.embrapa.br:doc/1134326
network_acronym_str EMBR
network_name_str Repositório Institucional da EMBRAPA (Repository Open Access to Scientific Information from EMBRAPA - Alice)
repository_id_str 2154
spelling Deep learning architectures for semantic segmentation and automatic estimation of severity of foliar symptoms caused by diseases or pests.Aprendizado profundoFitopatometriaInteligência artificialAprendizado de máquinaRede neural convolucionalSegmentação de imagemPhytopathometryMachine learningConvolutional neural networkImage segmentationDoença de PlantaArtificial intelligencePlant diseases and disordersNeural networksColour-thresholding digital imaging methods are generally accurate for measuring the percentage of foliar area affected by disease or pests (severity), but they perform poorly when scene illumination and background are not uniform. In this study, six convolutional neural network (CNN) architectures were trained for semantic segmentation in images of individual leaves exhibiting necrotic lesions and/or yellowing, caused by the insect pest coffee leaf miner (CLM), and two fungal diseases: soybean rust (SBR) and wheat tan spot (WTS). All images were manually annotated for three classes: leaf background (B), healthy leaf (H) and injured leaf (I). Precision, recall, and Intersection over Union (IoU) metrics in the test image set were the highest for B, followed by H and I classes, regardless of the architecture. When the pixel-level predictions were used to calculate percent severity, Feature Pyramid Network (FPN), Unet and DeepLabv3+ (Xception) performed the best among the architectures: concordance coefficients were greater than 0.95, 0.96 and 0.98 for CLM, SBR and WTS datasets, respectively, when confronting predictions with the annotated severity. The other three architectures tended to misclassify healthy pixels as injured, leading to overestimation of severity. Results highlight the value of a CNN-based automatic segmentation method to determine the severity on images of foliar diseases obtained under challenging conditions of brightness and background. The accuracy levels of the severity estimated by the FPN, Unet and DeepLabv3 + (Xception) were similar to those obtained by a standard commercial software, which requires adjustment of segmentation parameters and removal of the complex background of the images, tasks that slow down the process.JULIANO P. GONÇALVES, UFV; FRANCISCO A. C. PINTO, UFV; DANIEL M. QUEIROZ, UFV; FLORA M. M. VILLAR, UFV; JAYME GARCIA ARNAL BARBEDO, CNPTIA; EMERSON M. DEL PONTE, UFV.GONÇALVES, J. P.PINTO, F. A. C.QUEIROZ, D. M.VILLAR, F. M. M.BARBEDO, J. G. A.DEL PONTE, E. M.2021-09-14T13:01:47Z2021-09-14T13:01:47Z2021-09-142021info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleBiosystems Engineering, v. 210, p. 129-142, Oct. 2021.http://www.alice.cnptia.embrapa.br/alice/handle/doc/1134326https://doi.org/10.1016/j.biosystemseng.2021.08.011enginfo:eu-repo/semantics/openAccessreponame:Repositório Institucional da EMBRAPA (Repository Open Access to Scientific Information from EMBRAPA - Alice)instname:Empresa Brasileira de Pesquisa Agropecuária (Embrapa)instacron:EMBRAPA2021-09-14T13:01:56Zoai:www.alice.cnptia.embrapa.br:doc/1134326Repositório InstitucionalPUBhttps://www.alice.cnptia.embrapa.br/oai/requestopendoar:21542021-09-14T13:01:56falseRepositório InstitucionalPUBhttps://www.alice.cnptia.embrapa.br/oai/requestcg-riaa@embrapa.bropendoar:21542021-09-14T13:01:56Repositório Institucional da EMBRAPA (Repository Open Access to Scientific Information from EMBRAPA - Alice) - Empresa Brasileira de Pesquisa Agropecuária (Embrapa)false
dc.title.none.fl_str_mv Deep learning architectures for semantic segmentation and automatic estimation of severity of foliar symptoms caused by diseases or pests.
title Deep learning architectures for semantic segmentation and automatic estimation of severity of foliar symptoms caused by diseases or pests.
spellingShingle Deep learning architectures for semantic segmentation and automatic estimation of severity of foliar symptoms caused by diseases or pests.
GONÇALVES, J. P.
Aprendizado profundo
Fitopatometria
Inteligência artificial
Aprendizado de máquina
Rede neural convolucional
Segmentação de imagem
Phytopathometry
Machine learning
Convolutional neural network
Image segmentation
Doença de Planta
Artificial intelligence
Plant diseases and disorders
Neural networks
title_short Deep learning architectures for semantic segmentation and automatic estimation of severity of foliar symptoms caused by diseases or pests.
title_full Deep learning architectures for semantic segmentation and automatic estimation of severity of foliar symptoms caused by diseases or pests.
title_fullStr Deep learning architectures for semantic segmentation and automatic estimation of severity of foliar symptoms caused by diseases or pests.
title_full_unstemmed Deep learning architectures for semantic segmentation and automatic estimation of severity of foliar symptoms caused by diseases or pests.
title_sort Deep learning architectures for semantic segmentation and automatic estimation of severity of foliar symptoms caused by diseases or pests.
author GONÇALVES, J. P.
author_facet GONÇALVES, J. P.
PINTO, F. A. C.
QUEIROZ, D. M.
VILLAR, F. M. M.
BARBEDO, J. G. A.
DEL PONTE, E. M.
author_role author
author2 PINTO, F. A. C.
QUEIROZ, D. M.
VILLAR, F. M. M.
BARBEDO, J. G. A.
DEL PONTE, E. M.
author2_role author
author
author
author
author
dc.contributor.none.fl_str_mv JULIANO P. GONÇALVES, UFV; FRANCISCO A. C. PINTO, UFV; DANIEL M. QUEIROZ, UFV; FLORA M. M. VILLAR, UFV; JAYME GARCIA ARNAL BARBEDO, CNPTIA; EMERSON M. DEL PONTE, UFV.
dc.contributor.author.fl_str_mv GONÇALVES, J. P.
PINTO, F. A. C.
QUEIROZ, D. M.
VILLAR, F. M. M.
BARBEDO, J. G. A.
DEL PONTE, E. M.
dc.subject.por.fl_str_mv Aprendizado profundo
Fitopatometria
Inteligência artificial
Aprendizado de máquina
Rede neural convolucional
Segmentação de imagem
Phytopathometry
Machine learning
Convolutional neural network
Image segmentation
Doença de Planta
Artificial intelligence
Plant diseases and disorders
Neural networks
topic Aprendizado profundo
Fitopatometria
Inteligência artificial
Aprendizado de máquina
Rede neural convolucional
Segmentação de imagem
Phytopathometry
Machine learning
Convolutional neural network
Image segmentation
Doença de Planta
Artificial intelligence
Plant diseases and disorders
Neural networks
description Colour-thresholding digital imaging methods are generally accurate for measuring the percentage of foliar area affected by disease or pests (severity), but they perform poorly when scene illumination and background are not uniform. In this study, six convolutional neural network (CNN) architectures were trained for semantic segmentation in images of individual leaves exhibiting necrotic lesions and/or yellowing, caused by the insect pest coffee leaf miner (CLM), and two fungal diseases: soybean rust (SBR) and wheat tan spot (WTS). All images were manually annotated for three classes: leaf background (B), healthy leaf (H) and injured leaf (I). Precision, recall, and Intersection over Union (IoU) metrics in the test image set were the highest for B, followed by H and I classes, regardless of the architecture. When the pixel-level predictions were used to calculate percent severity, Feature Pyramid Network (FPN), Unet and DeepLabv3+ (Xception) performed the best among the architectures: concordance coefficients were greater than 0.95, 0.96 and 0.98 for CLM, SBR and WTS datasets, respectively, when confronting predictions with the annotated severity. The other three architectures tended to misclassify healthy pixels as injured, leading to overestimation of severity. Results highlight the value of a CNN-based automatic segmentation method to determine the severity on images of foliar diseases obtained under challenging conditions of brightness and background. The accuracy levels of the severity estimated by the FPN, Unet and DeepLabv3 + (Xception) were similar to those obtained by a standard commercial software, which requires adjustment of segmentation parameters and removal of the complex background of the images, tasks that slow down the process.
publishDate 2021
dc.date.none.fl_str_mv 2021-09-14T13:01:47Z
2021-09-14T13:01:47Z
2021-09-14
2021
dc.type.driver.fl_str_mv info:eu-repo/semantics/publishedVersion
info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv Biosystems Engineering, v. 210, p. 129-142, Oct. 2021.
http://www.alice.cnptia.embrapa.br/alice/handle/doc/1134326
https://doi.org/10.1016/j.biosystemseng.2021.08.011
identifier_str_mv Biosystems Engineering, v. 210, p. 129-142, Oct. 2021.
url http://www.alice.cnptia.embrapa.br/alice/handle/doc/1134326
https://doi.org/10.1016/j.biosystemseng.2021.08.011
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.source.none.fl_str_mv reponame:Repositório Institucional da EMBRAPA (Repository Open Access to Scientific Information from EMBRAPA - Alice)
instname:Empresa Brasileira de Pesquisa Agropecuária (Embrapa)
instacron:EMBRAPA
instname_str Empresa Brasileira de Pesquisa Agropecuária (Embrapa)
instacron_str EMBRAPA
institution EMBRAPA
reponame_str Repositório Institucional da EMBRAPA (Repository Open Access to Scientific Information from EMBRAPA - Alice)
collection Repositório Institucional da EMBRAPA (Repository Open Access to Scientific Information from EMBRAPA - Alice)
repository.name.fl_str_mv Repositório Institucional da EMBRAPA (Repository Open Access to Scientific Information from EMBRAPA - Alice) - Empresa Brasileira de Pesquisa Agropecuária (Embrapa)
repository.mail.fl_str_mv cg-riaa@embrapa.br
_version_ 1794503509331148800