Semi-supervised Segmentation Based on Error-Correcting Supervision
Autor(a) principal: | |
---|---|
Data de Publicação: | 2020 |
Outros Autores: | , , , |
Tipo de documento: | Artigo de conferência |
Idioma: | eng |
Título da fonte: | Repositório Institucional da UNESP |
Texto Completo: | http://dx.doi.org/10.1007/978-3-030-58526-6_9 http://hdl.handle.net/11449/233045 |
Resumo: | Pixel-level classification is an essential part of computer vision. For learning from labeled data, many powerful deep learning models have been developed recently. In this work, we augment such supervised segmentation models by allowing them to learn from unlabeled data. Our semi-supervised approach, termed Error-Correcting Supervision, leverages a collaborative strategy. Apart from the supervised training on the labeled data, the segmentation network is judged by an additional network. The secondary correction network learns on the labeled data to optimally spot correct predictions, as well as to amend incorrect ones. As auxiliary regularization term, the corrector directly influences the supervised training of the segmentation network. On unlabeled data, the output of the correction network is essential to create a proxy for the unknown truth. The corrector’s output is combined with the segmentation network’s prediction to form the new target. We propose a loss function that incorporates both the pseudo-labels as well as the predictive certainty of the correction network. Our approach can easily be added to supervised segmentation models. We show consistent improvements over a supervised baseline on experiments on both the Pascal VOC 2012 and the Cityscapes datasets with varying amounts of labeled data. |
id |
UNSP_07c3370b84effeb1a4467e106a7e9c29 |
---|---|
oai_identifier_str |
oai:repositorio.unesp.br:11449/233045 |
network_acronym_str |
UNSP |
network_name_str |
Repositório Institucional da UNESP |
repository_id_str |
2946 |
spelling |
Semi-supervised Segmentation Based on Error-Correcting SupervisionPixel-level classification is an essential part of computer vision. For learning from labeled data, many powerful deep learning models have been developed recently. In this work, we augment such supervised segmentation models by allowing them to learn from unlabeled data. Our semi-supervised approach, termed Error-Correcting Supervision, leverages a collaborative strategy. Apart from the supervised training on the labeled data, the segmentation network is judged by an additional network. The secondary correction network learns on the labeled data to optimally spot correct predictions, as well as to amend incorrect ones. As auxiliary regularization term, the corrector directly influences the supervised training of the segmentation network. On unlabeled data, the output of the correction network is essential to create a proxy for the unknown truth. The corrector’s output is combined with the segmentation network’s prediction to form the new target. We propose a loss function that incorporates both the pseudo-labels as well as the predictive certainty of the correction network. Our approach can easily be added to supervised segmentation models. We show consistent improvements over a supervised baseline on experiments on both the Pascal VOC 2012 and the Cityscapes datasets with varying amounts of labeled data.Ostbayerische Technische Hochschule RegensburgFederal University of São CarlosSão Paulo State UniversitySão Paulo State UniversityOstbayerische Technische Hochschule RegensburgUniversidade Federal de São Carlos (UFSCar)Universidade Estadual Paulista (UNESP)Mendel, Robertde Souza, Luis AntonioRauber, DavidPapa, João Paulo [UNESP]Palm, Christoph2022-05-01T00:16:35Z2022-05-01T00:16:35Z2020-01-01info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/conferenceObject141-157http://dx.doi.org/10.1007/978-3-030-58526-6_9Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), v. 12374 LNCS, p. 141-157.1611-33490302-9743http://hdl.handle.net/11449/23304510.1007/978-3-030-58526-6_92-s2.0-85093086803Scopusreponame:Repositório Institucional da UNESPinstname:Universidade Estadual Paulista (UNESP)instacron:UNESPengLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)info:eu-repo/semantics/openAccess2024-04-23T16:11:27Zoai:repositorio.unesp.br:11449/233045Repositório InstitucionalPUBhttp://repositorio.unesp.br/oai/requestopendoar:29462024-08-05T21:06:37.903306Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)false |
dc.title.none.fl_str_mv |
Semi-supervised Segmentation Based on Error-Correcting Supervision |
title |
Semi-supervised Segmentation Based on Error-Correcting Supervision |
spellingShingle |
Semi-supervised Segmentation Based on Error-Correcting Supervision Mendel, Robert |
title_short |
Semi-supervised Segmentation Based on Error-Correcting Supervision |
title_full |
Semi-supervised Segmentation Based on Error-Correcting Supervision |
title_fullStr |
Semi-supervised Segmentation Based on Error-Correcting Supervision |
title_full_unstemmed |
Semi-supervised Segmentation Based on Error-Correcting Supervision |
title_sort |
Semi-supervised Segmentation Based on Error-Correcting Supervision |
author |
Mendel, Robert |
author_facet |
Mendel, Robert de Souza, Luis Antonio Rauber, David Papa, João Paulo [UNESP] Palm, Christoph |
author_role |
author |
author2 |
de Souza, Luis Antonio Rauber, David Papa, João Paulo [UNESP] Palm, Christoph |
author2_role |
author author author author |
dc.contributor.none.fl_str_mv |
Ostbayerische Technische Hochschule Regensburg Universidade Federal de São Carlos (UFSCar) Universidade Estadual Paulista (UNESP) |
dc.contributor.author.fl_str_mv |
Mendel, Robert de Souza, Luis Antonio Rauber, David Papa, João Paulo [UNESP] Palm, Christoph |
description |
Pixel-level classification is an essential part of computer vision. For learning from labeled data, many powerful deep learning models have been developed recently. In this work, we augment such supervised segmentation models by allowing them to learn from unlabeled data. Our semi-supervised approach, termed Error-Correcting Supervision, leverages a collaborative strategy. Apart from the supervised training on the labeled data, the segmentation network is judged by an additional network. The secondary correction network learns on the labeled data to optimally spot correct predictions, as well as to amend incorrect ones. As auxiliary regularization term, the corrector directly influences the supervised training of the segmentation network. On unlabeled data, the output of the correction network is essential to create a proxy for the unknown truth. The corrector’s output is combined with the segmentation network’s prediction to form the new target. We propose a loss function that incorporates both the pseudo-labels as well as the predictive certainty of the correction network. Our approach can easily be added to supervised segmentation models. We show consistent improvements over a supervised baseline on experiments on both the Pascal VOC 2012 and the Cityscapes datasets with varying amounts of labeled data. |
publishDate |
2020 |
dc.date.none.fl_str_mv |
2020-01-01 2022-05-01T00:16:35Z 2022-05-01T00:16:35Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/conferenceObject |
format |
conferenceObject |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
http://dx.doi.org/10.1007/978-3-030-58526-6_9 Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), v. 12374 LNCS, p. 141-157. 1611-3349 0302-9743 http://hdl.handle.net/11449/233045 10.1007/978-3-030-58526-6_9 2-s2.0-85093086803 |
url |
http://dx.doi.org/10.1007/978-3-030-58526-6_9 http://hdl.handle.net/11449/233045 |
identifier_str_mv |
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), v. 12374 LNCS, p. 141-157. 1611-3349 0302-9743 10.1007/978-3-030-58526-6_9 2-s2.0-85093086803 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.relation.none.fl_str_mv |
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
141-157 |
dc.source.none.fl_str_mv |
Scopus reponame:Repositório Institucional da UNESP instname:Universidade Estadual Paulista (UNESP) instacron:UNESP |
instname_str |
Universidade Estadual Paulista (UNESP) |
instacron_str |
UNESP |
institution |
UNESP |
reponame_str |
Repositório Institucional da UNESP |
collection |
Repositório Institucional da UNESP |
repository.name.fl_str_mv |
Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP) |
repository.mail.fl_str_mv |
|
_version_ |
1808129285338169344 |