Fostering emotion recognition in children with autism spectrum disorder

Detalhes bibliográficos
Autor(a) principal: Silva, Vinicius Corrêa Alves
Data de Publicação: 2021
Outros Autores: Soares, Filomena, Esteves, João Sena, Santos, Cristina, Pereira, Ana Paula da Silva
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: http://hdl.handle.net/1822/75361
Resumo: Facial expressions are of utmost importance in social interactions, allowing communicative prompts for a speaking turn and feedback. Nevertheless, not all have the ability to express themselves socially and emotionally in verbal and non-verbal communication. In particular, individuals with Autism Spectrum Disorder (ASD) are characterized by impairments in social communication, repetitive patterns of behaviour, and restricted activities or interests. In the literature, the use of robotic tools is reported to promote social interaction with children with ASD. The main goal of this work is to develop a system capable of automatic detecting emotions through facial expressions and interfacing them with a robotic platform (Zeno R50 Robokind® robotic platform, named ZECA) in order to allow social interaction with children with ASD. ZECA was used as a mediator in social communication activities. The experimental setup and methodology for a real-time facial expression (happiness, sadness, anger, surprise, fear, and neutral) recognition system was based on the Intel® RealSense™ 3D sensor and on facial features extraction and multiclass Support Vector Machine classifier. The results obtained allowed to infer that the proposed system is adequate in support sessions with children with ASD, giving a strong indication that it may be used in fostering emotion recognition and imitation skills.
id RCAP_dba0fb7fd10a6023d80c7478eae6e7f9
oai_identifier_str oai:repositorium.sdum.uminho.pt:1822/75361
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str
spelling Fostering emotion recognition in children with autism spectrum disorderHuman Computer InteractionZeno R50 RobotHuman Com Support Vector MachineFacial ExpressionsEmotions RecognitionAutism Spectrum DisorderSupport Vector MachineFacial expres-sionsEngenharia e Tecnologia::Engenharia Eletrotécnica, Eletrónica e InformáticaScience & TechnologyEducação de qualidadeFacial expressions are of utmost importance in social interactions, allowing communicative prompts for a speaking turn and feedback. Nevertheless, not all have the ability to express themselves socially and emotionally in verbal and non-verbal communication. In particular, individuals with Autism Spectrum Disorder (ASD) are characterized by impairments in social communication, repetitive patterns of behaviour, and restricted activities or interests. In the literature, the use of robotic tools is reported to promote social interaction with children with ASD. The main goal of this work is to develop a system capable of automatic detecting emotions through facial expressions and interfacing them with a robotic platform (Zeno R50 Robokind® robotic platform, named ZECA) in order to allow social interaction with children with ASD. ZECA was used as a mediator in social communication activities. The experimental setup and methodology for a real-time facial expression (happiness, sadness, anger, surprise, fear, and neutral) recognition system was based on the Intel® RealSense™ 3D sensor and on facial features extraction and multiclass Support Vector Machine classifier. The results obtained allowed to infer that the proposed system is adequate in support sessions with children with ASD, giving a strong indication that it may be used in fostering emotion recognition and imitation skills.Centro Algoritmi & CIEd. CT—Fundação para a Ciência e Tecnologia within the R&D Units Project Scope: UIDB/00319/2020. Vinicius Silva thanks FCT for the PhD scholarship SFRH/BD/SFRH/BD/133314/2017.MDPIUniversidade do MinhoSilva, Vinicius Corrêa AlvesSoares, FilomenaEsteves, João SenaSantos, CristinaPereira, Ana Paula da Silva2021-092021-09-01T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/1822/75361engSilva, V.; Soares, F.; Esteves, J.S.; Santos, C.P.; & Pereira, A.P. (2021). Fostering emotion recognition in children with autism spectrum disorder. Multimodal Technol. Interact., 5(10), 57- 752414-408810.3390/mti5100057https://www.mdpi.com/2414-4088/5/10/57info:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2023-07-21T12:06:11ZPortal AgregadorONG
dc.title.none.fl_str_mv Fostering emotion recognition in children with autism spectrum disorder
title Fostering emotion recognition in children with autism spectrum disorder
spellingShingle Fostering emotion recognition in children with autism spectrum disorder
Silva, Vinicius Corrêa Alves
Human Computer Interaction
Zeno R50 Robot
Human Com Support Vector Machine
Facial Expressions
Emotions Recognition
Autism Spectrum Disorder
Support Vector Machine
Facial expres-sions
Engenharia e Tecnologia::Engenharia Eletrotécnica, Eletrónica e Informática
Science & Technology
Educação de qualidade
title_short Fostering emotion recognition in children with autism spectrum disorder
title_full Fostering emotion recognition in children with autism spectrum disorder
title_fullStr Fostering emotion recognition in children with autism spectrum disorder
title_full_unstemmed Fostering emotion recognition in children with autism spectrum disorder
title_sort Fostering emotion recognition in children with autism spectrum disorder
author Silva, Vinicius Corrêa Alves
author_facet Silva, Vinicius Corrêa Alves
Soares, Filomena
Esteves, João Sena
Santos, Cristina
Pereira, Ana Paula da Silva
author_role author
author2 Soares, Filomena
Esteves, João Sena
Santos, Cristina
Pereira, Ana Paula da Silva
author2_role author
author
author
author
dc.contributor.none.fl_str_mv Universidade do Minho
dc.contributor.author.fl_str_mv Silva, Vinicius Corrêa Alves
Soares, Filomena
Esteves, João Sena
Santos, Cristina
Pereira, Ana Paula da Silva
dc.subject.por.fl_str_mv Human Computer Interaction
Zeno R50 Robot
Human Com Support Vector Machine
Facial Expressions
Emotions Recognition
Autism Spectrum Disorder
Support Vector Machine
Facial expres-sions
Engenharia e Tecnologia::Engenharia Eletrotécnica, Eletrónica e Informática
Science & Technology
Educação de qualidade
topic Human Computer Interaction
Zeno R50 Robot
Human Com Support Vector Machine
Facial Expressions
Emotions Recognition
Autism Spectrum Disorder
Support Vector Machine
Facial expres-sions
Engenharia e Tecnologia::Engenharia Eletrotécnica, Eletrónica e Informática
Science & Technology
Educação de qualidade
description Facial expressions are of utmost importance in social interactions, allowing communicative prompts for a speaking turn and feedback. Nevertheless, not all have the ability to express themselves socially and emotionally in verbal and non-verbal communication. In particular, individuals with Autism Spectrum Disorder (ASD) are characterized by impairments in social communication, repetitive patterns of behaviour, and restricted activities or interests. In the literature, the use of robotic tools is reported to promote social interaction with children with ASD. The main goal of this work is to develop a system capable of automatic detecting emotions through facial expressions and interfacing them with a robotic platform (Zeno R50 Robokind® robotic platform, named ZECA) in order to allow social interaction with children with ASD. ZECA was used as a mediator in social communication activities. The experimental setup and methodology for a real-time facial expression (happiness, sadness, anger, surprise, fear, and neutral) recognition system was based on the Intel® RealSense™ 3D sensor and on facial features extraction and multiclass Support Vector Machine classifier. The results obtained allowed to infer that the proposed system is adequate in support sessions with children with ASD, giving a strong indication that it may be used in fostering emotion recognition and imitation skills.
publishDate 2021
dc.date.none.fl_str_mv 2021-09
2021-09-01T00:00:00Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/1822/75361
url http://hdl.handle.net/1822/75361
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv Silva, V.; Soares, F.; Esteves, J.S.; Santos, C.P.; & Pereira, A.P. (2021). Fostering emotion recognition in children with autism spectrum disorder. Multimodal Technol. Interact., 5(10), 57- 75
2414-4088
10.3390/mti5100057
https://www.mdpi.com/2414-4088/5/10/57
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv MDPI
publisher.none.fl_str_mv MDPI
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1777303682064318464