Fostering emotion recognition in children with autism spectrum disorder
Autor(a) principal: | |
---|---|
Data de Publicação: | 2021 |
Outros Autores: | , , , |
Tipo de documento: | Artigo |
Idioma: | eng |
Título da fonte: | Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
Texto Completo: | http://hdl.handle.net/1822/75361 |
Resumo: | Facial expressions are of utmost importance in social interactions, allowing communicative prompts for a speaking turn and feedback. Nevertheless, not all have the ability to express themselves socially and emotionally in verbal and non-verbal communication. In particular, individuals with Autism Spectrum Disorder (ASD) are characterized by impairments in social communication, repetitive patterns of behaviour, and restricted activities or interests. In the literature, the use of robotic tools is reported to promote social interaction with children with ASD. The main goal of this work is to develop a system capable of automatic detecting emotions through facial expressions and interfacing them with a robotic platform (Zeno R50 Robokind® robotic platform, named ZECA) in order to allow social interaction with children with ASD. ZECA was used as a mediator in social communication activities. The experimental setup and methodology for a real-time facial expression (happiness, sadness, anger, surprise, fear, and neutral) recognition system was based on the Intel® RealSense™ 3D sensor and on facial features extraction and multiclass Support Vector Machine classifier. The results obtained allowed to infer that the proposed system is adequate in support sessions with children with ASD, giving a strong indication that it may be used in fostering emotion recognition and imitation skills. |
id |
RCAP_dba0fb7fd10a6023d80c7478eae6e7f9 |
---|---|
oai_identifier_str |
oai:repositorium.sdum.uminho.pt:1822/75361 |
network_acronym_str |
RCAP |
network_name_str |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
repository_id_str |
|
spelling |
Fostering emotion recognition in children with autism spectrum disorderHuman Computer InteractionZeno R50 RobotHuman Com Support Vector MachineFacial ExpressionsEmotions RecognitionAutism Spectrum DisorderSupport Vector MachineFacial expres-sionsEngenharia e Tecnologia::Engenharia Eletrotécnica, Eletrónica e InformáticaScience & TechnologyEducação de qualidadeFacial expressions are of utmost importance in social interactions, allowing communicative prompts for a speaking turn and feedback. Nevertheless, not all have the ability to express themselves socially and emotionally in verbal and non-verbal communication. In particular, individuals with Autism Spectrum Disorder (ASD) are characterized by impairments in social communication, repetitive patterns of behaviour, and restricted activities or interests. In the literature, the use of robotic tools is reported to promote social interaction with children with ASD. The main goal of this work is to develop a system capable of automatic detecting emotions through facial expressions and interfacing them with a robotic platform (Zeno R50 Robokind® robotic platform, named ZECA) in order to allow social interaction with children with ASD. ZECA was used as a mediator in social communication activities. The experimental setup and methodology for a real-time facial expression (happiness, sadness, anger, surprise, fear, and neutral) recognition system was based on the Intel® RealSense™ 3D sensor and on facial features extraction and multiclass Support Vector Machine classifier. The results obtained allowed to infer that the proposed system is adequate in support sessions with children with ASD, giving a strong indication that it may be used in fostering emotion recognition and imitation skills.Centro Algoritmi & CIEd. CT—Fundação para a Ciência e Tecnologia within the R&D Units Project Scope: UIDB/00319/2020. Vinicius Silva thanks FCT for the PhD scholarship SFRH/BD/SFRH/BD/133314/2017.MDPIUniversidade do MinhoSilva, Vinicius Corrêa AlvesSoares, FilomenaEsteves, João SenaSantos, CristinaPereira, Ana Paula da Silva2021-092021-09-01T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/1822/75361engSilva, V.; Soares, F.; Esteves, J.S.; Santos, C.P.; & Pereira, A.P. (2021). Fostering emotion recognition in children with autism spectrum disorder. Multimodal Technol. Interact., 5(10), 57- 752414-408810.3390/mti5100057https://www.mdpi.com/2414-4088/5/10/57info:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2023-07-21T12:06:11ZPortal AgregadorONG |
dc.title.none.fl_str_mv |
Fostering emotion recognition in children with autism spectrum disorder |
title |
Fostering emotion recognition in children with autism spectrum disorder |
spellingShingle |
Fostering emotion recognition in children with autism spectrum disorder Silva, Vinicius Corrêa Alves Human Computer Interaction Zeno R50 Robot Human Com Support Vector Machine Facial Expressions Emotions Recognition Autism Spectrum Disorder Support Vector Machine Facial expres-sions Engenharia e Tecnologia::Engenharia Eletrotécnica, Eletrónica e Informática Science & Technology Educação de qualidade |
title_short |
Fostering emotion recognition in children with autism spectrum disorder |
title_full |
Fostering emotion recognition in children with autism spectrum disorder |
title_fullStr |
Fostering emotion recognition in children with autism spectrum disorder |
title_full_unstemmed |
Fostering emotion recognition in children with autism spectrum disorder |
title_sort |
Fostering emotion recognition in children with autism spectrum disorder |
author |
Silva, Vinicius Corrêa Alves |
author_facet |
Silva, Vinicius Corrêa Alves Soares, Filomena Esteves, João Sena Santos, Cristina Pereira, Ana Paula da Silva |
author_role |
author |
author2 |
Soares, Filomena Esteves, João Sena Santos, Cristina Pereira, Ana Paula da Silva |
author2_role |
author author author author |
dc.contributor.none.fl_str_mv |
Universidade do Minho |
dc.contributor.author.fl_str_mv |
Silva, Vinicius Corrêa Alves Soares, Filomena Esteves, João Sena Santos, Cristina Pereira, Ana Paula da Silva |
dc.subject.por.fl_str_mv |
Human Computer Interaction Zeno R50 Robot Human Com Support Vector Machine Facial Expressions Emotions Recognition Autism Spectrum Disorder Support Vector Machine Facial expres-sions Engenharia e Tecnologia::Engenharia Eletrotécnica, Eletrónica e Informática Science & Technology Educação de qualidade |
topic |
Human Computer Interaction Zeno R50 Robot Human Com Support Vector Machine Facial Expressions Emotions Recognition Autism Spectrum Disorder Support Vector Machine Facial expres-sions Engenharia e Tecnologia::Engenharia Eletrotécnica, Eletrónica e Informática Science & Technology Educação de qualidade |
description |
Facial expressions are of utmost importance in social interactions, allowing communicative prompts for a speaking turn and feedback. Nevertheless, not all have the ability to express themselves socially and emotionally in verbal and non-verbal communication. In particular, individuals with Autism Spectrum Disorder (ASD) are characterized by impairments in social communication, repetitive patterns of behaviour, and restricted activities or interests. In the literature, the use of robotic tools is reported to promote social interaction with children with ASD. The main goal of this work is to develop a system capable of automatic detecting emotions through facial expressions and interfacing them with a robotic platform (Zeno R50 Robokind® robotic platform, named ZECA) in order to allow social interaction with children with ASD. ZECA was used as a mediator in social communication activities. The experimental setup and methodology for a real-time facial expression (happiness, sadness, anger, surprise, fear, and neutral) recognition system was based on the Intel® RealSense™ 3D sensor and on facial features extraction and multiclass Support Vector Machine classifier. The results obtained allowed to infer that the proposed system is adequate in support sessions with children with ASD, giving a strong indication that it may be used in fostering emotion recognition and imitation skills. |
publishDate |
2021 |
dc.date.none.fl_str_mv |
2021-09 2021-09-01T00:00:00Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/article |
format |
article |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
http://hdl.handle.net/1822/75361 |
url |
http://hdl.handle.net/1822/75361 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.relation.none.fl_str_mv |
Silva, V.; Soares, F.; Esteves, J.S.; Santos, C.P.; & Pereira, A.P. (2021). Fostering emotion recognition in children with autism spectrum disorder. Multimodal Technol. Interact., 5(10), 57- 75 2414-4088 10.3390/mti5100057 https://www.mdpi.com/2414-4088/5/10/57 |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
application/pdf |
dc.publisher.none.fl_str_mv |
MDPI |
publisher.none.fl_str_mv |
MDPI |
dc.source.none.fl_str_mv |
reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação instacron:RCAAP |
instname_str |
Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação |
instacron_str |
RCAAP |
institution |
RCAAP |
reponame_str |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
collection |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
repository.name.fl_str_mv |
|
repository.mail.fl_str_mv |
|
_version_ |
1777303682064318464 |