Graph Convolutional Networks based on manifold learning for semi-supervised image classification
Autor(a) principal: | |
---|---|
Data de Publicação: | 2023 |
Outros Autores: | , |
Tipo de documento: | Artigo |
Idioma: | eng |
Título da fonte: | Repositório Institucional da UNESP |
Texto Completo: | http://dx.doi.org/10.1016/j.cviu.2022.103618 http://hdl.handle.net/11449/246625 |
Resumo: | Due to a huge volume of information in many domains, the need for classification methods is imperious. In spite of many advances, most of the approaches require a large amount of labeled data, which is often not available, due to costs and difficulties of manual labeling processes. In this scenario, unsupervised and semi-supervised approaches have been gaining increasing attention. The GCNs (Graph Convolutional Neural Networks) represent a promising solution since they encode the neighborhood information and have achieved state-of-the-art results on scenarios with limited labeled data. However, since GCNs require graph-structured data, their use for semi-supervised image classification is still scarce in the literature. In this work, we propose a novel approach, the Manifold-GCN, based on GCNs for semi-supervised image classification. The main hypothesis of this paper is that the use of manifold learning to model the graph structure can further improve the GCN classification. To the best of our knowledge, this is the first framework that allows the combination of GCNs with different types of manifold learning approaches for image classification. All manifold learning algorithms employed are completely unsupervised, which is especially useful for scenarios where the availability of labeled data is a concern. A broad experimental evaluation was conducted considering 5 GCN models, 3 manifold learning approaches, 3 image datasets, and 5 deep features. The results reveal that our approach presents better accuracy than traditional and recent state-of-the-art methods with very efficient run times for both training and testing. |
id |
UNSP_6672eba4ea4ab1958ddb16ad84274ccb |
---|---|
oai_identifier_str |
oai:repositorio.unesp.br:11449/246625 |
network_acronym_str |
UNSP |
network_name_str |
Repositório Institucional da UNESP |
repository_id_str |
2946 |
spelling |
Graph Convolutional Networks based on manifold learning for semi-supervised image classificationGraph Convolutional NetworksImage classificationManifold learningSemi-supervisedDue to a huge volume of information in many domains, the need for classification methods is imperious. In spite of many advances, most of the approaches require a large amount of labeled data, which is often not available, due to costs and difficulties of manual labeling processes. In this scenario, unsupervised and semi-supervised approaches have been gaining increasing attention. The GCNs (Graph Convolutional Neural Networks) represent a promising solution since they encode the neighborhood information and have achieved state-of-the-art results on scenarios with limited labeled data. However, since GCNs require graph-structured data, their use for semi-supervised image classification is still scarce in the literature. In this work, we propose a novel approach, the Manifold-GCN, based on GCNs for semi-supervised image classification. The main hypothesis of this paper is that the use of manifold learning to model the graph structure can further improve the GCN classification. To the best of our knowledge, this is the first framework that allows the combination of GCNs with different types of manifold learning approaches for image classification. All manifold learning algorithms employed are completely unsupervised, which is especially useful for scenarios where the availability of labeled data is a concern. A broad experimental evaluation was conducted considering 5 GCN models, 3 manifold learning approaches, 3 image datasets, and 5 deep features. The results reveal that our approach presents better accuracy than traditional and recent state-of-the-art methods with very efficient run times for both training and testing.Fulbright AustriaMicrosoft ResearchPetrobrasFundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)National Science FoundationDepartment of Statistics Applied Mathematics and Computing State University of São Paulo (UNESP), Av. 24-A, 1515, SPDepartment of Computer and Information Sciences Temple University, North 12th Street, 1925Department of Statistics Applied Mathematics and Computing State University of São Paulo (UNESP), Av. 24-A, 1515, SPPetrobras: #2017/00285-6FAPESP: #2017/25908-6FAPESP: #2018/15597-6FAPESP: #2020/11366-0CNPq: #309439/2020-5CNPq: #422667/2021-8National Science Foundation: IIS-2107213Universidade Estadual Paulista (UNESP)Temple UniversityValem, Lucas Pascotti [UNESP]Guimarães Pedronette, Daniel Carlos [UNESP]Latecki, Longin Jan2023-07-29T12:46:04Z2023-07-29T12:46:04Z2023-01-01info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articlehttp://dx.doi.org/10.1016/j.cviu.2022.103618Computer Vision and Image Understanding, v. 227.1090-235X1077-3142http://hdl.handle.net/11449/24662510.1016/j.cviu.2022.1036182-s2.0-85145969614Scopusreponame:Repositório Institucional da UNESPinstname:Universidade Estadual Paulista (UNESP)instacron:UNESPengComputer Vision and Image Understandinginfo:eu-repo/semantics/openAccess2023-07-29T12:46:04Zoai:repositorio.unesp.br:11449/246625Repositório InstitucionalPUBhttp://repositorio.unesp.br/oai/requestopendoar:29462024-08-05T21:56:33.801749Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)false |
dc.title.none.fl_str_mv |
Graph Convolutional Networks based on manifold learning for semi-supervised image classification |
title |
Graph Convolutional Networks based on manifold learning for semi-supervised image classification |
spellingShingle |
Graph Convolutional Networks based on manifold learning for semi-supervised image classification Valem, Lucas Pascotti [UNESP] Graph Convolutional Networks Image classification Manifold learning Semi-supervised |
title_short |
Graph Convolutional Networks based on manifold learning for semi-supervised image classification |
title_full |
Graph Convolutional Networks based on manifold learning for semi-supervised image classification |
title_fullStr |
Graph Convolutional Networks based on manifold learning for semi-supervised image classification |
title_full_unstemmed |
Graph Convolutional Networks based on manifold learning for semi-supervised image classification |
title_sort |
Graph Convolutional Networks based on manifold learning for semi-supervised image classification |
author |
Valem, Lucas Pascotti [UNESP] |
author_facet |
Valem, Lucas Pascotti [UNESP] Guimarães Pedronette, Daniel Carlos [UNESP] Latecki, Longin Jan |
author_role |
author |
author2 |
Guimarães Pedronette, Daniel Carlos [UNESP] Latecki, Longin Jan |
author2_role |
author author |
dc.contributor.none.fl_str_mv |
Universidade Estadual Paulista (UNESP) Temple University |
dc.contributor.author.fl_str_mv |
Valem, Lucas Pascotti [UNESP] Guimarães Pedronette, Daniel Carlos [UNESP] Latecki, Longin Jan |
dc.subject.por.fl_str_mv |
Graph Convolutional Networks Image classification Manifold learning Semi-supervised |
topic |
Graph Convolutional Networks Image classification Manifold learning Semi-supervised |
description |
Due to a huge volume of information in many domains, the need for classification methods is imperious. In spite of many advances, most of the approaches require a large amount of labeled data, which is often not available, due to costs and difficulties of manual labeling processes. In this scenario, unsupervised and semi-supervised approaches have been gaining increasing attention. The GCNs (Graph Convolutional Neural Networks) represent a promising solution since they encode the neighborhood information and have achieved state-of-the-art results on scenarios with limited labeled data. However, since GCNs require graph-structured data, their use for semi-supervised image classification is still scarce in the literature. In this work, we propose a novel approach, the Manifold-GCN, based on GCNs for semi-supervised image classification. The main hypothesis of this paper is that the use of manifold learning to model the graph structure can further improve the GCN classification. To the best of our knowledge, this is the first framework that allows the combination of GCNs with different types of manifold learning approaches for image classification. All manifold learning algorithms employed are completely unsupervised, which is especially useful for scenarios where the availability of labeled data is a concern. A broad experimental evaluation was conducted considering 5 GCN models, 3 manifold learning approaches, 3 image datasets, and 5 deep features. The results reveal that our approach presents better accuracy than traditional and recent state-of-the-art methods with very efficient run times for both training and testing. |
publishDate |
2023 |
dc.date.none.fl_str_mv |
2023-07-29T12:46:04Z 2023-07-29T12:46:04Z 2023-01-01 |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/article |
format |
article |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
http://dx.doi.org/10.1016/j.cviu.2022.103618 Computer Vision and Image Understanding, v. 227. 1090-235X 1077-3142 http://hdl.handle.net/11449/246625 10.1016/j.cviu.2022.103618 2-s2.0-85145969614 |
url |
http://dx.doi.org/10.1016/j.cviu.2022.103618 http://hdl.handle.net/11449/246625 |
identifier_str_mv |
Computer Vision and Image Understanding, v. 227. 1090-235X 1077-3142 10.1016/j.cviu.2022.103618 2-s2.0-85145969614 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.relation.none.fl_str_mv |
Computer Vision and Image Understanding |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.source.none.fl_str_mv |
Scopus reponame:Repositório Institucional da UNESP instname:Universidade Estadual Paulista (UNESP) instacron:UNESP |
instname_str |
Universidade Estadual Paulista (UNESP) |
instacron_str |
UNESP |
institution |
UNESP |
reponame_str |
Repositório Institucional da UNESP |
collection |
Repositório Institucional da UNESP |
repository.name.fl_str_mv |
Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP) |
repository.mail.fl_str_mv |
|
_version_ |
1808129375899484160 |