Improving Transferability of Domain Adaptation Networks Through Domain Alignment Layers

Detalhes bibliográficos
Autor(a) principal: Silva, Lucas F. A.
Data de Publicação: 2021
Outros Autores: Pedronette, Daniel C. G. [UNESP], Faria, Fabio A., Papa, Joao P. [UNESP], Almeida, Jurandy
Tipo de documento: Artigo de conferência
Idioma: eng
Título da fonte: Repositório Institucional da UNESP
Texto Completo: http://dx.doi.org/10.1109/SIBGRAPI54419.2021.00031
http://hdl.handle.net/11449/234112
Resumo: Deep learning (DL) has been the primary approach used in various computer vision tasks due to its relevant results achieved on many tasks. However, on real-world scenarios with partially or no labeled data, DL methods are also prone to the well-known domain shift problem. Multi-source unsupervised domain adaptation (MSDA) aims at learning a predictor for an unlabeled domain by assigning weak knowledge from a bag of source models. However, most works conduct domain adaptation leveraging only the extracted features and reducing their domain shift from the perspective of loss function designs. In this paper, we argue that it is not sufficient to handle domain shift only based on domain-level features, but it is also essential to align such information on the feature space. Unlike previous works, we focus on the network design and propose to embed Multi-Source version of DomaIn Alignment Layers (MS-DIAL) at different levels of the predictor. These layers are designed to match the feature distributions between different domains and can be easily applied to various MSDA methods. To show the robustness of our approach, we conducted an extensive experimental evaluation considering two challenging scenarios: digit recognition and object classification. The experimental results indicated that our approach can improve state-of-the-art MSDA methods, yielding relative gains of up to +30.64% on their classification accuracies.
id UNSP_4c84d78c20983566482425746f7a01f4
oai_identifier_str oai:repositorio.unesp.br:11449/234112
network_acronym_str UNSP
network_name_str Repositório Institucional da UNESP
repository_id_str 2946
spelling Improving Transferability of Domain Adaptation Networks Through Domain Alignment LayersDeep learning (DL) has been the primary approach used in various computer vision tasks due to its relevant results achieved on many tasks. However, on real-world scenarios with partially or no labeled data, DL methods are also prone to the well-known domain shift problem. Multi-source unsupervised domain adaptation (MSDA) aims at learning a predictor for an unlabeled domain by assigning weak knowledge from a bag of source models. However, most works conduct domain adaptation leveraging only the extracted features and reducing their domain shift from the perspective of loss function designs. In this paper, we argue that it is not sufficient to handle domain shift only based on domain-level features, but it is also essential to align such information on the feature space. Unlike previous works, we focus on the network design and propose to embed Multi-Source version of DomaIn Alignment Layers (MS-DIAL) at different levels of the predictor. These layers are designed to match the feature distributions between different domains and can be easily applied to various MSDA methods. To show the robustness of our approach, we conducted an extensive experimental evaluation considering two challenging scenarios: digit recognition and object classification. The experimental results indicated that our approach can improve state-of-the-art MSDA methods, yielding relative gains of up to +30.64% on their classification accuracies.Universidade Federal de São Paulo - UNIFESP Instituto de Ciência e Tecnologia, SPSão Paulo State University - UNESP Dept. of Statistics Applied Mathematics and Computing, SPSão Paulo State University - UNESP Dept. of Computing, SPSão Paulo State University - UNESP Dept. of Statistics Applied Mathematics and Computing, SPSão Paulo State University - UNESP Dept. of Computing, SPUniversidade Federal de São Paulo (UNIFESP)Universidade Estadual Paulista (UNESP)Silva, Lucas F. A.Pedronette, Daniel C. G. [UNESP]Faria, Fabio A.Papa, Joao P. [UNESP]Almeida, Jurandy2022-05-01T13:41:30Z2022-05-01T13:41:30Z2021-01-01info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/conferenceObject168-175http://dx.doi.org/10.1109/SIBGRAPI54419.2021.00031Proceedings - 2021 34th SIBGRAPI Conference on Graphics, Patterns and Images, SIBGRAPI 2021, p. 168-175.http://hdl.handle.net/11449/23411210.1109/SIBGRAPI54419.2021.000312-s2.0-85124223941Scopusreponame:Repositório Institucional da UNESPinstname:Universidade Estadual Paulista (UNESP)instacron:UNESPengProceedings - 2021 34th SIBGRAPI Conference on Graphics, Patterns and Images, SIBGRAPI 2021info:eu-repo/semantics/openAccess2024-04-23T16:11:27Zoai:repositorio.unesp.br:11449/234112Repositório InstitucionalPUBhttp://repositorio.unesp.br/oai/requestopendoar:29462024-08-05T21:02:33.745914Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)false
dc.title.none.fl_str_mv Improving Transferability of Domain Adaptation Networks Through Domain Alignment Layers
title Improving Transferability of Domain Adaptation Networks Through Domain Alignment Layers
spellingShingle Improving Transferability of Domain Adaptation Networks Through Domain Alignment Layers
Silva, Lucas F. A.
title_short Improving Transferability of Domain Adaptation Networks Through Domain Alignment Layers
title_full Improving Transferability of Domain Adaptation Networks Through Domain Alignment Layers
title_fullStr Improving Transferability of Domain Adaptation Networks Through Domain Alignment Layers
title_full_unstemmed Improving Transferability of Domain Adaptation Networks Through Domain Alignment Layers
title_sort Improving Transferability of Domain Adaptation Networks Through Domain Alignment Layers
author Silva, Lucas F. A.
author_facet Silva, Lucas F. A.
Pedronette, Daniel C. G. [UNESP]
Faria, Fabio A.
Papa, Joao P. [UNESP]
Almeida, Jurandy
author_role author
author2 Pedronette, Daniel C. G. [UNESP]
Faria, Fabio A.
Papa, Joao P. [UNESP]
Almeida, Jurandy
author2_role author
author
author
author
dc.contributor.none.fl_str_mv Universidade Federal de São Paulo (UNIFESP)
Universidade Estadual Paulista (UNESP)
dc.contributor.author.fl_str_mv Silva, Lucas F. A.
Pedronette, Daniel C. G. [UNESP]
Faria, Fabio A.
Papa, Joao P. [UNESP]
Almeida, Jurandy
description Deep learning (DL) has been the primary approach used in various computer vision tasks due to its relevant results achieved on many tasks. However, on real-world scenarios with partially or no labeled data, DL methods are also prone to the well-known domain shift problem. Multi-source unsupervised domain adaptation (MSDA) aims at learning a predictor for an unlabeled domain by assigning weak knowledge from a bag of source models. However, most works conduct domain adaptation leveraging only the extracted features and reducing their domain shift from the perspective of loss function designs. In this paper, we argue that it is not sufficient to handle domain shift only based on domain-level features, but it is also essential to align such information on the feature space. Unlike previous works, we focus on the network design and propose to embed Multi-Source version of DomaIn Alignment Layers (MS-DIAL) at different levels of the predictor. These layers are designed to match the feature distributions between different domains and can be easily applied to various MSDA methods. To show the robustness of our approach, we conducted an extensive experimental evaluation considering two challenging scenarios: digit recognition and object classification. The experimental results indicated that our approach can improve state-of-the-art MSDA methods, yielding relative gains of up to +30.64% on their classification accuracies.
publishDate 2021
dc.date.none.fl_str_mv 2021-01-01
2022-05-01T13:41:30Z
2022-05-01T13:41:30Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/conferenceObject
format conferenceObject
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://dx.doi.org/10.1109/SIBGRAPI54419.2021.00031
Proceedings - 2021 34th SIBGRAPI Conference on Graphics, Patterns and Images, SIBGRAPI 2021, p. 168-175.
http://hdl.handle.net/11449/234112
10.1109/SIBGRAPI54419.2021.00031
2-s2.0-85124223941
url http://dx.doi.org/10.1109/SIBGRAPI54419.2021.00031
http://hdl.handle.net/11449/234112
identifier_str_mv Proceedings - 2021 34th SIBGRAPI Conference on Graphics, Patterns and Images, SIBGRAPI 2021, p. 168-175.
10.1109/SIBGRAPI54419.2021.00031
2-s2.0-85124223941
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv Proceedings - 2021 34th SIBGRAPI Conference on Graphics, Patterns and Images, SIBGRAPI 2021
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv 168-175
dc.source.none.fl_str_mv Scopus
reponame:Repositório Institucional da UNESP
instname:Universidade Estadual Paulista (UNESP)
instacron:UNESP
instname_str Universidade Estadual Paulista (UNESP)
instacron_str UNESP
institution UNESP
reponame_str Repositório Institucional da UNESP
collection Repositório Institucional da UNESP
repository.name.fl_str_mv Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)
repository.mail.fl_str_mv
_version_ 1808129277368991744