Identification of low accuracy regions in land cover maps using uncertainty measures and classification confidence

Detalhes bibliográficos
Autor(a) principal: Fonte, C. C.
Data de Publicação: 2018
Outros Autores: Gonçalves, L. M. S.
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: http://hdl.handle.net/10316/107685
https://doi.org/10.5194/isprs-archives-XLII-4-201-2018
Resumo: The aim of this article is to assess if the data provided by soft classifiers and uncertainty measures can be used to identify regions with different levels of accuracy in a classified image. To this aim a soft Bayesian classifier was used, which enables the assignment of classifications confidence levels to all pixels. Two uncertainty measures were also used, namely the Relative Maximum Deviation (RMD) uncertainty measure and the Normalized Entropy (NE). The approach was tested on a case study. A multispectral IKONOS image was classified and the classification uncertainty and confidence where computed and analysed. Regions with different levels of uncertainty and confidence were identified. Reference datasets were then used to assess the classification accuracy of the whole study area and also in the regions with different levels of uncertainty and confidence. A comparative analysis was made on the variation of accuracy and classification uncertainty and confidence along the map and per class. The results show that for the regions with more uncertainty or less confidence the spatially constrained confusion matrices always generate lower values of global accuracy than for global accuracy of the regions with less uncertainty or more confidence. The analysis of the user’s and producer’s accuracy also shows the same general tendency. Proposals are then made on methodologies to use the information provided by the uncertainty and confidence to identify less reliable regions and also to improve classification results using fully automated approaches.
id RCAP_da4fdbc2b2bd0e601571163c47f7e286
oai_identifier_str oai:estudogeral.uc.pt:10316/107685
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling Identification of low accuracy regions in land cover maps using uncertainty measures and classification confidenceMultispectral imagesClassificationUncertaintyConfidenceAccuracySpatial variationThe aim of this article is to assess if the data provided by soft classifiers and uncertainty measures can be used to identify regions with different levels of accuracy in a classified image. To this aim a soft Bayesian classifier was used, which enables the assignment of classifications confidence levels to all pixels. Two uncertainty measures were also used, namely the Relative Maximum Deviation (RMD) uncertainty measure and the Normalized Entropy (NE). The approach was tested on a case study. A multispectral IKONOS image was classified and the classification uncertainty and confidence where computed and analysed. Regions with different levels of uncertainty and confidence were identified. Reference datasets were then used to assess the classification accuracy of the whole study area and also in the regions with different levels of uncertainty and confidence. A comparative analysis was made on the variation of accuracy and classification uncertainty and confidence along the map and per class. The results show that for the regions with more uncertainty or less confidence the spatially constrained confusion matrices always generate lower values of global accuracy than for global accuracy of the regions with less uncertainty or more confidence. The analysis of the user’s and producer’s accuracy also shows the same general tendency. Proposals are then made on methodologies to use the information provided by the uncertainty and confidence to identify less reliable regions and also to improve classification results using fully automated approaches.International Society for Photogrammetry and Remote Sensing2018info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articlehttp://hdl.handle.net/10316/107685http://hdl.handle.net/10316/107685https://doi.org/10.5194/isprs-archives-XLII-4-201-2018eng2194-9034Fonte, C. C.Gonçalves, L. M. S.info:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2023-07-27T08:21:42Zoai:estudogeral.uc.pt:10316/107685Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-19T21:24:00.447540Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv Identification of low accuracy regions in land cover maps using uncertainty measures and classification confidence
title Identification of low accuracy regions in land cover maps using uncertainty measures and classification confidence
spellingShingle Identification of low accuracy regions in land cover maps using uncertainty measures and classification confidence
Fonte, C. C.
Multispectral images
Classification
Uncertainty
Confidence
Accuracy
Spatial variation
title_short Identification of low accuracy regions in land cover maps using uncertainty measures and classification confidence
title_full Identification of low accuracy regions in land cover maps using uncertainty measures and classification confidence
title_fullStr Identification of low accuracy regions in land cover maps using uncertainty measures and classification confidence
title_full_unstemmed Identification of low accuracy regions in land cover maps using uncertainty measures and classification confidence
title_sort Identification of low accuracy regions in land cover maps using uncertainty measures and classification confidence
author Fonte, C. C.
author_facet Fonte, C. C.
Gonçalves, L. M. S.
author_role author
author2 Gonçalves, L. M. S.
author2_role author
dc.contributor.author.fl_str_mv Fonte, C. C.
Gonçalves, L. M. S.
dc.subject.por.fl_str_mv Multispectral images
Classification
Uncertainty
Confidence
Accuracy
Spatial variation
topic Multispectral images
Classification
Uncertainty
Confidence
Accuracy
Spatial variation
description The aim of this article is to assess if the data provided by soft classifiers and uncertainty measures can be used to identify regions with different levels of accuracy in a classified image. To this aim a soft Bayesian classifier was used, which enables the assignment of classifications confidence levels to all pixels. Two uncertainty measures were also used, namely the Relative Maximum Deviation (RMD) uncertainty measure and the Normalized Entropy (NE). The approach was tested on a case study. A multispectral IKONOS image was classified and the classification uncertainty and confidence where computed and analysed. Regions with different levels of uncertainty and confidence were identified. Reference datasets were then used to assess the classification accuracy of the whole study area and also in the regions with different levels of uncertainty and confidence. A comparative analysis was made on the variation of accuracy and classification uncertainty and confidence along the map and per class. The results show that for the regions with more uncertainty or less confidence the spatially constrained confusion matrices always generate lower values of global accuracy than for global accuracy of the regions with less uncertainty or more confidence. The analysis of the user’s and producer’s accuracy also shows the same general tendency. Proposals are then made on methodologies to use the information provided by the uncertainty and confidence to identify less reliable regions and also to improve classification results using fully automated approaches.
publishDate 2018
dc.date.none.fl_str_mv 2018
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10316/107685
http://hdl.handle.net/10316/107685
https://doi.org/10.5194/isprs-archives-XLII-4-201-2018
url http://hdl.handle.net/10316/107685
https://doi.org/10.5194/isprs-archives-XLII-4-201-2018
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv 2194-9034
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.publisher.none.fl_str_mv International Society for Photogrammetry and Remote Sensing
publisher.none.fl_str_mv International Society for Photogrammetry and Remote Sensing
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799134125867663360