Comparing Handcrafted Features and Deep Neural Representations for Domain Generalization in Human Activity Recognition

Detalhes bibliográficos
Autor(a) principal: Bento, Nuno
Data de Publicação: 2022
Outros Autores: Rebelo, Joana, Barandas, Marília, Carreiro, André V., Campagner, Andrea, Cabitza, Federico, Gamboa, Hugo
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: http://hdl.handle.net/10362/145396
Resumo: Human Activity Recognition (HAR) has been studied extensively, yet current approaches are not capable of generalizing across different domains (i.e., subjects, devices, or datasets) with acceptable performance. This lack of generalization hinders the applicability of these models in real-world environments. As deep neural networks are becoming increasingly popular in recent work, there is a need for an explicit comparison between handcrafted and deep representations in Out-of-Distribution (OOD) settings. This paper compares both approaches in multiple domains using homogenized public datasets. First, we compare several metrics to validate three different OOD settings. In our main experiments, we then verify that even though deep learning initially outperforms models with handcrafted features, the situation is reversed as the distance from the training distribution increases. These findings support the hypothesis that handcrafted features may generalize better across specific domains.
id RCAP_e3279e4c116337c4733a8d41899a004b
oai_identifier_str oai:run.unl.pt:10362/145396
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling Comparing Handcrafted Features and Deep Neural Representations for Domain Generalization in Human Activity Recognitionaccelerometerdeep learningdomain generalizationhuman activity recognitionAnalytical ChemistryInformation SystemsBiochemistryAtomic and Molecular Physics, and OpticsInstrumentationElectrical and Electronic EngineeringHuman Activity Recognition (HAR) has been studied extensively, yet current approaches are not capable of generalizing across different domains (i.e., subjects, devices, or datasets) with acceptable performance. This lack of generalization hinders the applicability of these models in real-world environments. As deep neural networks are becoming increasingly popular in recent work, there is a need for an explicit comparison between handcrafted and deep representations in Out-of-Distribution (OOD) settings. This paper compares both approaches in multiple domains using homogenized public datasets. First, we compare several metrics to validate three different OOD settings. In our main experiments, we then verify that even though deep learning initially outperforms models with handcrafted features, the situation is reversed as the distance from the training distribution increases. These findings support the hypothesis that handcrafted features may generalize better across specific domains.DF – Departamento de FísicaLIBPhys-UNLRUNBento, NunoRebelo, JoanaBarandas, MaríliaCarreiro, André V.Campagner, AndreaCabitza, FedericoGamboa, Hugo2022-11-10T22:13:17Z2022-09-272022-09-27T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/article20application/pdfhttp://hdl.handle.net/10362/145396eng1424-8220PURE: 47342285https://doi.org/10.3390/s22197324info:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2024-03-11T05:25:44Zoai:run.unl.pt:10362/145396Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-20T03:52:03.540349Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv Comparing Handcrafted Features and Deep Neural Representations for Domain Generalization in Human Activity Recognition
title Comparing Handcrafted Features and Deep Neural Representations for Domain Generalization in Human Activity Recognition
spellingShingle Comparing Handcrafted Features and Deep Neural Representations for Domain Generalization in Human Activity Recognition
Bento, Nuno
accelerometer
deep learning
domain generalization
human activity recognition
Analytical Chemistry
Information Systems
Biochemistry
Atomic and Molecular Physics, and Optics
Instrumentation
Electrical and Electronic Engineering
title_short Comparing Handcrafted Features and Deep Neural Representations for Domain Generalization in Human Activity Recognition
title_full Comparing Handcrafted Features and Deep Neural Representations for Domain Generalization in Human Activity Recognition
title_fullStr Comparing Handcrafted Features and Deep Neural Representations for Domain Generalization in Human Activity Recognition
title_full_unstemmed Comparing Handcrafted Features and Deep Neural Representations for Domain Generalization in Human Activity Recognition
title_sort Comparing Handcrafted Features and Deep Neural Representations for Domain Generalization in Human Activity Recognition
author Bento, Nuno
author_facet Bento, Nuno
Rebelo, Joana
Barandas, Marília
Carreiro, André V.
Campagner, Andrea
Cabitza, Federico
Gamboa, Hugo
author_role author
author2 Rebelo, Joana
Barandas, Marília
Carreiro, André V.
Campagner, Andrea
Cabitza, Federico
Gamboa, Hugo
author2_role author
author
author
author
author
author
dc.contributor.none.fl_str_mv DF – Departamento de Física
LIBPhys-UNL
RUN
dc.contributor.author.fl_str_mv Bento, Nuno
Rebelo, Joana
Barandas, Marília
Carreiro, André V.
Campagner, Andrea
Cabitza, Federico
Gamboa, Hugo
dc.subject.por.fl_str_mv accelerometer
deep learning
domain generalization
human activity recognition
Analytical Chemistry
Information Systems
Biochemistry
Atomic and Molecular Physics, and Optics
Instrumentation
Electrical and Electronic Engineering
topic accelerometer
deep learning
domain generalization
human activity recognition
Analytical Chemistry
Information Systems
Biochemistry
Atomic and Molecular Physics, and Optics
Instrumentation
Electrical and Electronic Engineering
description Human Activity Recognition (HAR) has been studied extensively, yet current approaches are not capable of generalizing across different domains (i.e., subjects, devices, or datasets) with acceptable performance. This lack of generalization hinders the applicability of these models in real-world environments. As deep neural networks are becoming increasingly popular in recent work, there is a need for an explicit comparison between handcrafted and deep representations in Out-of-Distribution (OOD) settings. This paper compares both approaches in multiple domains using homogenized public datasets. First, we compare several metrics to validate three different OOD settings. In our main experiments, we then verify that even though deep learning initially outperforms models with handcrafted features, the situation is reversed as the distance from the training distribution increases. These findings support the hypothesis that handcrafted features may generalize better across specific domains.
publishDate 2022
dc.date.none.fl_str_mv 2022-11-10T22:13:17Z
2022-09-27
2022-09-27T00:00:00Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10362/145396
url http://hdl.handle.net/10362/145396
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv 1424-8220
PURE: 47342285
https://doi.org/10.3390/s22197324
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv 20
application/pdf
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799138112424640512