Improving Transferability of Domain Adaptation Networks Through Domain Alignment Layers
Autor(a) principal: | |
---|---|
Data de Publicação: | 2021 |
Outros Autores: | , , , |
Tipo de documento: | Artigo de conferência |
Idioma: | eng |
Título da fonte: | Repositório Institucional da UNESP |
Texto Completo: | http://dx.doi.org/10.1109/SIBGRAPI54419.2021.00031 http://hdl.handle.net/11449/234112 |
Resumo: | Deep learning (DL) has been the primary approach used in various computer vision tasks due to its relevant results achieved on many tasks. However, on real-world scenarios with partially or no labeled data, DL methods are also prone to the well-known domain shift problem. Multi-source unsupervised domain adaptation (MSDA) aims at learning a predictor for an unlabeled domain by assigning weak knowledge from a bag of source models. However, most works conduct domain adaptation leveraging only the extracted features and reducing their domain shift from the perspective of loss function designs. In this paper, we argue that it is not sufficient to handle domain shift only based on domain-level features, but it is also essential to align such information on the feature space. Unlike previous works, we focus on the network design and propose to embed Multi-Source version of DomaIn Alignment Layers (MS-DIAL) at different levels of the predictor. These layers are designed to match the feature distributions between different domains and can be easily applied to various MSDA methods. To show the robustness of our approach, we conducted an extensive experimental evaluation considering two challenging scenarios: digit recognition and object classification. The experimental results indicated that our approach can improve state-of-the-art MSDA methods, yielding relative gains of up to +30.64% on their classification accuracies. |
id |
UNSP_4c84d78c20983566482425746f7a01f4 |
---|---|
oai_identifier_str |
oai:repositorio.unesp.br:11449/234112 |
network_acronym_str |
UNSP |
network_name_str |
Repositório Institucional da UNESP |
repository_id_str |
2946 |
spelling |
Improving Transferability of Domain Adaptation Networks Through Domain Alignment LayersDeep learning (DL) has been the primary approach used in various computer vision tasks due to its relevant results achieved on many tasks. However, on real-world scenarios with partially or no labeled data, DL methods are also prone to the well-known domain shift problem. Multi-source unsupervised domain adaptation (MSDA) aims at learning a predictor for an unlabeled domain by assigning weak knowledge from a bag of source models. However, most works conduct domain adaptation leveraging only the extracted features and reducing their domain shift from the perspective of loss function designs. In this paper, we argue that it is not sufficient to handle domain shift only based on domain-level features, but it is also essential to align such information on the feature space. Unlike previous works, we focus on the network design and propose to embed Multi-Source version of DomaIn Alignment Layers (MS-DIAL) at different levels of the predictor. These layers are designed to match the feature distributions between different domains and can be easily applied to various MSDA methods. To show the robustness of our approach, we conducted an extensive experimental evaluation considering two challenging scenarios: digit recognition and object classification. The experimental results indicated that our approach can improve state-of-the-art MSDA methods, yielding relative gains of up to +30.64% on their classification accuracies.Universidade Federal de São Paulo - UNIFESP Instituto de Ciência e Tecnologia, SPSão Paulo State University - UNESP Dept. of Statistics Applied Mathematics and Computing, SPSão Paulo State University - UNESP Dept. of Computing, SPSão Paulo State University - UNESP Dept. of Statistics Applied Mathematics and Computing, SPSão Paulo State University - UNESP Dept. of Computing, SPUniversidade Federal de São Paulo (UNIFESP)Universidade Estadual Paulista (UNESP)Silva, Lucas F. A.Pedronette, Daniel C. G. [UNESP]Faria, Fabio A.Papa, Joao P. [UNESP]Almeida, Jurandy2022-05-01T13:41:30Z2022-05-01T13:41:30Z2021-01-01info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/conferenceObject168-175http://dx.doi.org/10.1109/SIBGRAPI54419.2021.00031Proceedings - 2021 34th SIBGRAPI Conference on Graphics, Patterns and Images, SIBGRAPI 2021, p. 168-175.http://hdl.handle.net/11449/23411210.1109/SIBGRAPI54419.2021.000312-s2.0-85124223941Scopusreponame:Repositório Institucional da UNESPinstname:Universidade Estadual Paulista (UNESP)instacron:UNESPengProceedings - 2021 34th SIBGRAPI Conference on Graphics, Patterns and Images, SIBGRAPI 2021info:eu-repo/semantics/openAccess2024-04-23T16:11:27Zoai:repositorio.unesp.br:11449/234112Repositório InstitucionalPUBhttp://repositorio.unesp.br/oai/requestopendoar:29462024-08-05T21:02:33.745914Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)false |
dc.title.none.fl_str_mv |
Improving Transferability of Domain Adaptation Networks Through Domain Alignment Layers |
title |
Improving Transferability of Domain Adaptation Networks Through Domain Alignment Layers |
spellingShingle |
Improving Transferability of Domain Adaptation Networks Through Domain Alignment Layers Silva, Lucas F. A. |
title_short |
Improving Transferability of Domain Adaptation Networks Through Domain Alignment Layers |
title_full |
Improving Transferability of Domain Adaptation Networks Through Domain Alignment Layers |
title_fullStr |
Improving Transferability of Domain Adaptation Networks Through Domain Alignment Layers |
title_full_unstemmed |
Improving Transferability of Domain Adaptation Networks Through Domain Alignment Layers |
title_sort |
Improving Transferability of Domain Adaptation Networks Through Domain Alignment Layers |
author |
Silva, Lucas F. A. |
author_facet |
Silva, Lucas F. A. Pedronette, Daniel C. G. [UNESP] Faria, Fabio A. Papa, Joao P. [UNESP] Almeida, Jurandy |
author_role |
author |
author2 |
Pedronette, Daniel C. G. [UNESP] Faria, Fabio A. Papa, Joao P. [UNESP] Almeida, Jurandy |
author2_role |
author author author author |
dc.contributor.none.fl_str_mv |
Universidade Federal de São Paulo (UNIFESP) Universidade Estadual Paulista (UNESP) |
dc.contributor.author.fl_str_mv |
Silva, Lucas F. A. Pedronette, Daniel C. G. [UNESP] Faria, Fabio A. Papa, Joao P. [UNESP] Almeida, Jurandy |
description |
Deep learning (DL) has been the primary approach used in various computer vision tasks due to its relevant results achieved on many tasks. However, on real-world scenarios with partially or no labeled data, DL methods are also prone to the well-known domain shift problem. Multi-source unsupervised domain adaptation (MSDA) aims at learning a predictor for an unlabeled domain by assigning weak knowledge from a bag of source models. However, most works conduct domain adaptation leveraging only the extracted features and reducing their domain shift from the perspective of loss function designs. In this paper, we argue that it is not sufficient to handle domain shift only based on domain-level features, but it is also essential to align such information on the feature space. Unlike previous works, we focus on the network design and propose to embed Multi-Source version of DomaIn Alignment Layers (MS-DIAL) at different levels of the predictor. These layers are designed to match the feature distributions between different domains and can be easily applied to various MSDA methods. To show the robustness of our approach, we conducted an extensive experimental evaluation considering two challenging scenarios: digit recognition and object classification. The experimental results indicated that our approach can improve state-of-the-art MSDA methods, yielding relative gains of up to +30.64% on their classification accuracies. |
publishDate |
2021 |
dc.date.none.fl_str_mv |
2021-01-01 2022-05-01T13:41:30Z 2022-05-01T13:41:30Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/conferenceObject |
format |
conferenceObject |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
http://dx.doi.org/10.1109/SIBGRAPI54419.2021.00031 Proceedings - 2021 34th SIBGRAPI Conference on Graphics, Patterns and Images, SIBGRAPI 2021, p. 168-175. http://hdl.handle.net/11449/234112 10.1109/SIBGRAPI54419.2021.00031 2-s2.0-85124223941 |
url |
http://dx.doi.org/10.1109/SIBGRAPI54419.2021.00031 http://hdl.handle.net/11449/234112 |
identifier_str_mv |
Proceedings - 2021 34th SIBGRAPI Conference on Graphics, Patterns and Images, SIBGRAPI 2021, p. 168-175. 10.1109/SIBGRAPI54419.2021.00031 2-s2.0-85124223941 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.relation.none.fl_str_mv |
Proceedings - 2021 34th SIBGRAPI Conference on Graphics, Patterns and Images, SIBGRAPI 2021 |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
168-175 |
dc.source.none.fl_str_mv |
Scopus reponame:Repositório Institucional da UNESP instname:Universidade Estadual Paulista (UNESP) instacron:UNESP |
instname_str |
Universidade Estadual Paulista (UNESP) |
instacron_str |
UNESP |
institution |
UNESP |
reponame_str |
Repositório Institucional da UNESP |
collection |
Repositório Institucional da UNESP |
repository.name.fl_str_mv |
Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP) |
repository.mail.fl_str_mv |
|
_version_ |
1808129277368991744 |