Graph Convolutional Networks based on manifold learning for semi-supervised image classification

Detalhes bibliográficos
Autor(a) principal: Valem, Lucas Pascotti [UNESP]
Data de Publicação: 2023
Outros Autores: Guimarães Pedronette, Daniel Carlos [UNESP], Latecki, Longin Jan
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Institucional da UNESP
Texto Completo: http://dx.doi.org/10.1016/j.cviu.2022.103618
http://hdl.handle.net/11449/246625
Resumo: Due to a huge volume of information in many domains, the need for classification methods is imperious. In spite of many advances, most of the approaches require a large amount of labeled data, which is often not available, due to costs and difficulties of manual labeling processes. In this scenario, unsupervised and semi-supervised approaches have been gaining increasing attention. The GCNs (Graph Convolutional Neural Networks) represent a promising solution since they encode the neighborhood information and have achieved state-of-the-art results on scenarios with limited labeled data. However, since GCNs require graph-structured data, their use for semi-supervised image classification is still scarce in the literature. In this work, we propose a novel approach, the Manifold-GCN, based on GCNs for semi-supervised image classification. The main hypothesis of this paper is that the use of manifold learning to model the graph structure can further improve the GCN classification. To the best of our knowledge, this is the first framework that allows the combination of GCNs with different types of manifold learning approaches for image classification. All manifold learning algorithms employed are completely unsupervised, which is especially useful for scenarios where the availability of labeled data is a concern. A broad experimental evaluation was conducted considering 5 GCN models, 3 manifold learning approaches, 3 image datasets, and 5 deep features. The results reveal that our approach presents better accuracy than traditional and recent state-of-the-art methods with very efficient run times for both training and testing.
id UNSP_6672eba4ea4ab1958ddb16ad84274ccb
oai_identifier_str oai:repositorio.unesp.br:11449/246625
network_acronym_str UNSP
network_name_str Repositório Institucional da UNESP
repository_id_str 2946
spelling Graph Convolutional Networks based on manifold learning for semi-supervised image classificationGraph Convolutional NetworksImage classificationManifold learningSemi-supervisedDue to a huge volume of information in many domains, the need for classification methods is imperious. In spite of many advances, most of the approaches require a large amount of labeled data, which is often not available, due to costs and difficulties of manual labeling processes. In this scenario, unsupervised and semi-supervised approaches have been gaining increasing attention. The GCNs (Graph Convolutional Neural Networks) represent a promising solution since they encode the neighborhood information and have achieved state-of-the-art results on scenarios with limited labeled data. However, since GCNs require graph-structured data, their use for semi-supervised image classification is still scarce in the literature. In this work, we propose a novel approach, the Manifold-GCN, based on GCNs for semi-supervised image classification. The main hypothesis of this paper is that the use of manifold learning to model the graph structure can further improve the GCN classification. To the best of our knowledge, this is the first framework that allows the combination of GCNs with different types of manifold learning approaches for image classification. All manifold learning algorithms employed are completely unsupervised, which is especially useful for scenarios where the availability of labeled data is a concern. A broad experimental evaluation was conducted considering 5 GCN models, 3 manifold learning approaches, 3 image datasets, and 5 deep features. The results reveal that our approach presents better accuracy than traditional and recent state-of-the-art methods with very efficient run times for both training and testing.Fulbright AustriaMicrosoft ResearchPetrobrasFundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)National Science FoundationDepartment of Statistics Applied Mathematics and Computing State University of São Paulo (UNESP), Av. 24-A, 1515, SPDepartment of Computer and Information Sciences Temple University, North 12th Street, 1925Department of Statistics Applied Mathematics and Computing State University of São Paulo (UNESP), Av. 24-A, 1515, SPPetrobras: #2017/00285-6FAPESP: #2017/25908-6FAPESP: #2018/15597-6FAPESP: #2020/11366-0CNPq: #309439/2020-5CNPq: #422667/2021-8National Science Foundation: IIS-2107213Universidade Estadual Paulista (UNESP)Temple UniversityValem, Lucas Pascotti [UNESP]Guimarães Pedronette, Daniel Carlos [UNESP]Latecki, Longin Jan2023-07-29T12:46:04Z2023-07-29T12:46:04Z2023-01-01info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articlehttp://dx.doi.org/10.1016/j.cviu.2022.103618Computer Vision and Image Understanding, v. 227.1090-235X1077-3142http://hdl.handle.net/11449/24662510.1016/j.cviu.2022.1036182-s2.0-85145969614Scopusreponame:Repositório Institucional da UNESPinstname:Universidade Estadual Paulista (UNESP)instacron:UNESPengComputer Vision and Image Understandinginfo:eu-repo/semantics/openAccess2023-07-29T12:46:04Zoai:repositorio.unesp.br:11449/246625Repositório InstitucionalPUBhttp://repositorio.unesp.br/oai/requestopendoar:29462024-08-05T21:56:33.801749Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)false
dc.title.none.fl_str_mv Graph Convolutional Networks based on manifold learning for semi-supervised image classification
title Graph Convolutional Networks based on manifold learning for semi-supervised image classification
spellingShingle Graph Convolutional Networks based on manifold learning for semi-supervised image classification
Valem, Lucas Pascotti [UNESP]
Graph Convolutional Networks
Image classification
Manifold learning
Semi-supervised
title_short Graph Convolutional Networks based on manifold learning for semi-supervised image classification
title_full Graph Convolutional Networks based on manifold learning for semi-supervised image classification
title_fullStr Graph Convolutional Networks based on manifold learning for semi-supervised image classification
title_full_unstemmed Graph Convolutional Networks based on manifold learning for semi-supervised image classification
title_sort Graph Convolutional Networks based on manifold learning for semi-supervised image classification
author Valem, Lucas Pascotti [UNESP]
author_facet Valem, Lucas Pascotti [UNESP]
Guimarães Pedronette, Daniel Carlos [UNESP]
Latecki, Longin Jan
author_role author
author2 Guimarães Pedronette, Daniel Carlos [UNESP]
Latecki, Longin Jan
author2_role author
author
dc.contributor.none.fl_str_mv Universidade Estadual Paulista (UNESP)
Temple University
dc.contributor.author.fl_str_mv Valem, Lucas Pascotti [UNESP]
Guimarães Pedronette, Daniel Carlos [UNESP]
Latecki, Longin Jan
dc.subject.por.fl_str_mv Graph Convolutional Networks
Image classification
Manifold learning
Semi-supervised
topic Graph Convolutional Networks
Image classification
Manifold learning
Semi-supervised
description Due to a huge volume of information in many domains, the need for classification methods is imperious. In spite of many advances, most of the approaches require a large amount of labeled data, which is often not available, due to costs and difficulties of manual labeling processes. In this scenario, unsupervised and semi-supervised approaches have been gaining increasing attention. The GCNs (Graph Convolutional Neural Networks) represent a promising solution since they encode the neighborhood information and have achieved state-of-the-art results on scenarios with limited labeled data. However, since GCNs require graph-structured data, their use for semi-supervised image classification is still scarce in the literature. In this work, we propose a novel approach, the Manifold-GCN, based on GCNs for semi-supervised image classification. The main hypothesis of this paper is that the use of manifold learning to model the graph structure can further improve the GCN classification. To the best of our knowledge, this is the first framework that allows the combination of GCNs with different types of manifold learning approaches for image classification. All manifold learning algorithms employed are completely unsupervised, which is especially useful for scenarios where the availability of labeled data is a concern. A broad experimental evaluation was conducted considering 5 GCN models, 3 manifold learning approaches, 3 image datasets, and 5 deep features. The results reveal that our approach presents better accuracy than traditional and recent state-of-the-art methods with very efficient run times for both training and testing.
publishDate 2023
dc.date.none.fl_str_mv 2023-07-29T12:46:04Z
2023-07-29T12:46:04Z
2023-01-01
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://dx.doi.org/10.1016/j.cviu.2022.103618
Computer Vision and Image Understanding, v. 227.
1090-235X
1077-3142
http://hdl.handle.net/11449/246625
10.1016/j.cviu.2022.103618
2-s2.0-85145969614
url http://dx.doi.org/10.1016/j.cviu.2022.103618
http://hdl.handle.net/11449/246625
identifier_str_mv Computer Vision and Image Understanding, v. 227.
1090-235X
1077-3142
10.1016/j.cviu.2022.103618
2-s2.0-85145969614
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv Computer Vision and Image Understanding
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.source.none.fl_str_mv Scopus
reponame:Repositório Institucional da UNESP
instname:Universidade Estadual Paulista (UNESP)
instacron:UNESP
instname_str Universidade Estadual Paulista (UNESP)
instacron_str UNESP
institution UNESP
reponame_str Repositório Institucional da UNESP
collection Repositório Institucional da UNESP
repository.name.fl_str_mv Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)
repository.mail.fl_str_mv
_version_ 1808129375899484160