Semi-supervised Segmentation Based on Error-Correcting Supervision

Detalhes bibliográficos
Autor(a) principal: Mendel, Robert
Data de Publicação: 2020
Outros Autores: de Souza, Luis Antonio, Rauber, David, Papa, João Paulo [UNESP], Palm, Christoph
Tipo de documento: Artigo de conferência
Idioma: eng
Título da fonte: Repositório Institucional da UNESP
Texto Completo: http://dx.doi.org/10.1007/978-3-030-58526-6_9
http://hdl.handle.net/11449/233045
Resumo: Pixel-level classification is an essential part of computer vision. For learning from labeled data, many powerful deep learning models have been developed recently. In this work, we augment such supervised segmentation models by allowing them to learn from unlabeled data. Our semi-supervised approach, termed Error-Correcting Supervision, leverages a collaborative strategy. Apart from the supervised training on the labeled data, the segmentation network is judged by an additional network. The secondary correction network learns on the labeled data to optimally spot correct predictions, as well as to amend incorrect ones. As auxiliary regularization term, the corrector directly influences the supervised training of the segmentation network. On unlabeled data, the output of the correction network is essential to create a proxy for the unknown truth. The corrector’s output is combined with the segmentation network’s prediction to form the new target. We propose a loss function that incorporates both the pseudo-labels as well as the predictive certainty of the correction network. Our approach can easily be added to supervised segmentation models. We show consistent improvements over a supervised baseline on experiments on both the Pascal VOC 2012 and the Cityscapes datasets with varying amounts of labeled data.
id UNSP_07c3370b84effeb1a4467e106a7e9c29
oai_identifier_str oai:repositorio.unesp.br:11449/233045
network_acronym_str UNSP
network_name_str Repositório Institucional da UNESP
repository_id_str 2946
spelling Semi-supervised Segmentation Based on Error-Correcting SupervisionPixel-level classification is an essential part of computer vision. For learning from labeled data, many powerful deep learning models have been developed recently. In this work, we augment such supervised segmentation models by allowing them to learn from unlabeled data. Our semi-supervised approach, termed Error-Correcting Supervision, leverages a collaborative strategy. Apart from the supervised training on the labeled data, the segmentation network is judged by an additional network. The secondary correction network learns on the labeled data to optimally spot correct predictions, as well as to amend incorrect ones. As auxiliary regularization term, the corrector directly influences the supervised training of the segmentation network. On unlabeled data, the output of the correction network is essential to create a proxy for the unknown truth. The corrector’s output is combined with the segmentation network’s prediction to form the new target. We propose a loss function that incorporates both the pseudo-labels as well as the predictive certainty of the correction network. Our approach can easily be added to supervised segmentation models. We show consistent improvements over a supervised baseline on experiments on both the Pascal VOC 2012 and the Cityscapes datasets with varying amounts of labeled data.Ostbayerische Technische Hochschule RegensburgFederal University of São CarlosSão Paulo State UniversitySão Paulo State UniversityOstbayerische Technische Hochschule RegensburgUniversidade Federal de São Carlos (UFSCar)Universidade Estadual Paulista (UNESP)Mendel, Robertde Souza, Luis AntonioRauber, DavidPapa, João Paulo [UNESP]Palm, Christoph2022-05-01T00:16:35Z2022-05-01T00:16:35Z2020-01-01info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/conferenceObject141-157http://dx.doi.org/10.1007/978-3-030-58526-6_9Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), v. 12374 LNCS, p. 141-157.1611-33490302-9743http://hdl.handle.net/11449/23304510.1007/978-3-030-58526-6_92-s2.0-85093086803Scopusreponame:Repositório Institucional da UNESPinstname:Universidade Estadual Paulista (UNESP)instacron:UNESPengLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)info:eu-repo/semantics/openAccess2024-04-23T16:11:27Zoai:repositorio.unesp.br:11449/233045Repositório InstitucionalPUBhttp://repositorio.unesp.br/oai/requestopendoar:29462024-08-05T21:06:37.903306Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)false
dc.title.none.fl_str_mv Semi-supervised Segmentation Based on Error-Correcting Supervision
title Semi-supervised Segmentation Based on Error-Correcting Supervision
spellingShingle Semi-supervised Segmentation Based on Error-Correcting Supervision
Mendel, Robert
title_short Semi-supervised Segmentation Based on Error-Correcting Supervision
title_full Semi-supervised Segmentation Based on Error-Correcting Supervision
title_fullStr Semi-supervised Segmentation Based on Error-Correcting Supervision
title_full_unstemmed Semi-supervised Segmentation Based on Error-Correcting Supervision
title_sort Semi-supervised Segmentation Based on Error-Correcting Supervision
author Mendel, Robert
author_facet Mendel, Robert
de Souza, Luis Antonio
Rauber, David
Papa, João Paulo [UNESP]
Palm, Christoph
author_role author
author2 de Souza, Luis Antonio
Rauber, David
Papa, João Paulo [UNESP]
Palm, Christoph
author2_role author
author
author
author
dc.contributor.none.fl_str_mv Ostbayerische Technische Hochschule Regensburg
Universidade Federal de São Carlos (UFSCar)
Universidade Estadual Paulista (UNESP)
dc.contributor.author.fl_str_mv Mendel, Robert
de Souza, Luis Antonio
Rauber, David
Papa, João Paulo [UNESP]
Palm, Christoph
description Pixel-level classification is an essential part of computer vision. For learning from labeled data, many powerful deep learning models have been developed recently. In this work, we augment such supervised segmentation models by allowing them to learn from unlabeled data. Our semi-supervised approach, termed Error-Correcting Supervision, leverages a collaborative strategy. Apart from the supervised training on the labeled data, the segmentation network is judged by an additional network. The secondary correction network learns on the labeled data to optimally spot correct predictions, as well as to amend incorrect ones. As auxiliary regularization term, the corrector directly influences the supervised training of the segmentation network. On unlabeled data, the output of the correction network is essential to create a proxy for the unknown truth. The corrector’s output is combined with the segmentation network’s prediction to form the new target. We propose a loss function that incorporates both the pseudo-labels as well as the predictive certainty of the correction network. Our approach can easily be added to supervised segmentation models. We show consistent improvements over a supervised baseline on experiments on both the Pascal VOC 2012 and the Cityscapes datasets with varying amounts of labeled data.
publishDate 2020
dc.date.none.fl_str_mv 2020-01-01
2022-05-01T00:16:35Z
2022-05-01T00:16:35Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/conferenceObject
format conferenceObject
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://dx.doi.org/10.1007/978-3-030-58526-6_9
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), v. 12374 LNCS, p. 141-157.
1611-3349
0302-9743
http://hdl.handle.net/11449/233045
10.1007/978-3-030-58526-6_9
2-s2.0-85093086803
url http://dx.doi.org/10.1007/978-3-030-58526-6_9
http://hdl.handle.net/11449/233045
identifier_str_mv Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), v. 12374 LNCS, p. 141-157.
1611-3349
0302-9743
10.1007/978-3-030-58526-6_9
2-s2.0-85093086803
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv 141-157
dc.source.none.fl_str_mv Scopus
reponame:Repositório Institucional da UNESP
instname:Universidade Estadual Paulista (UNESP)
instacron:UNESP
instname_str Universidade Estadual Paulista (UNESP)
instacron_str UNESP
institution UNESP
reponame_str Repositório Institucional da UNESP
collection Repositório Institucional da UNESP
repository.name.fl_str_mv Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)
repository.mail.fl_str_mv
_version_ 1808129285338169344