Towards sociable virtual humans : multimodal recognition of human input and behavior
Autor(a) principal: | |
---|---|
Data de Publicação: | 2007 |
Outros Autores: | , , , , , |
Tipo de documento: | Artigo |
Idioma: | eng |
Título da fonte: | Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
Texto Completo: | http://hdl.handle.net/1822/9257 |
Resumo: | One of the biggest obstacles for constructing effective sociable virtual humans lies in the failure of machines to recognize the desires, feelings and intentions of the human user. Virtual humans lack the ability to fully understand and decode the communication signals human users emit when communicating with each other. This article describes our research in overcoming this problem by developing senses for the virtual humans which enables them to hear and understand human speech, localize the human user in front of the display system, recognize hand postures and to recognize the emotional state of the human user by classifying facial expression. We report on the methods needed to perform these tasks in real-time and conclude with an outlook on promising research issues of the future. |
id |
RCAP_2a5d2d20ef4cbad8f6b264f65e0d2965 |
---|---|
oai_identifier_str |
oai:repositorium.sdum.uminho.pt:1822/9257 |
network_acronym_str |
RCAP |
network_name_str |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
repository_id_str |
7160 |
spelling |
Towards sociable virtual humans : multimodal recognition of human input and behaviorMan-Machine communicationAvatarsGesture recognitionSpeech recognitionAffective computingOne of the biggest obstacles for constructing effective sociable virtual humans lies in the failure of machines to recognize the desires, feelings and intentions of the human user. Virtual humans lack the ability to fully understand and decode the communication signals human users emit when communicating with each other. This article describes our research in overcoming this problem by developing senses for the virtual humans which enables them to hear and understand human speech, localize the human user in front of the display system, recognize hand postures and to recognize the emotional state of the human user by classifying facial expression. We report on the methods needed to perform these tasks in real-time and conclude with an outlook on promising research issues of the future.Ipi PressUniversidade do MinhoEckes, ChristianBiatov, KonstantinHülsken, FrankKöhler, JoachimBreuer, PiaBranco, PedroEncarnação, Luis Miguel Eggeling da20072007-01-01T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/1822/9257eng"International Journal of Virtual Reality." ISSN 1741-1874. 6:4 (2007) 21-30.1741-1874info:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2023-07-21T12:48:35Zoai:repositorium.sdum.uminho.pt:1822/9257Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-19T19:46:52.771801Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse |
dc.title.none.fl_str_mv |
Towards sociable virtual humans : multimodal recognition of human input and behavior |
title |
Towards sociable virtual humans : multimodal recognition of human input and behavior |
spellingShingle |
Towards sociable virtual humans : multimodal recognition of human input and behavior Eckes, Christian Man-Machine communication Avatars Gesture recognition Speech recognition Affective computing |
title_short |
Towards sociable virtual humans : multimodal recognition of human input and behavior |
title_full |
Towards sociable virtual humans : multimodal recognition of human input and behavior |
title_fullStr |
Towards sociable virtual humans : multimodal recognition of human input and behavior |
title_full_unstemmed |
Towards sociable virtual humans : multimodal recognition of human input and behavior |
title_sort |
Towards sociable virtual humans : multimodal recognition of human input and behavior |
author |
Eckes, Christian |
author_facet |
Eckes, Christian Biatov, Konstantin Hülsken, Frank Köhler, Joachim Breuer, Pia Branco, Pedro Encarnação, Luis Miguel Eggeling da |
author_role |
author |
author2 |
Biatov, Konstantin Hülsken, Frank Köhler, Joachim Breuer, Pia Branco, Pedro Encarnação, Luis Miguel Eggeling da |
author2_role |
author author author author author author |
dc.contributor.none.fl_str_mv |
Universidade do Minho |
dc.contributor.author.fl_str_mv |
Eckes, Christian Biatov, Konstantin Hülsken, Frank Köhler, Joachim Breuer, Pia Branco, Pedro Encarnação, Luis Miguel Eggeling da |
dc.subject.por.fl_str_mv |
Man-Machine communication Avatars Gesture recognition Speech recognition Affective computing |
topic |
Man-Machine communication Avatars Gesture recognition Speech recognition Affective computing |
description |
One of the biggest obstacles for constructing effective sociable virtual humans lies in the failure of machines to recognize the desires, feelings and intentions of the human user. Virtual humans lack the ability to fully understand and decode the communication signals human users emit when communicating with each other. This article describes our research in overcoming this problem by developing senses for the virtual humans which enables them to hear and understand human speech, localize the human user in front of the display system, recognize hand postures and to recognize the emotional state of the human user by classifying facial expression. We report on the methods needed to perform these tasks in real-time and conclude with an outlook on promising research issues of the future. |
publishDate |
2007 |
dc.date.none.fl_str_mv |
2007 2007-01-01T00:00:00Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/article |
format |
article |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
http://hdl.handle.net/1822/9257 |
url |
http://hdl.handle.net/1822/9257 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.relation.none.fl_str_mv |
"International Journal of Virtual Reality." ISSN 1741-1874. 6:4 (2007) 21-30. 1741-1874 |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
application/pdf |
dc.publisher.none.fl_str_mv |
Ipi Press |
publisher.none.fl_str_mv |
Ipi Press |
dc.source.none.fl_str_mv |
reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação instacron:RCAAP |
instname_str |
Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação |
instacron_str |
RCAAP |
institution |
RCAAP |
reponame_str |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
collection |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
repository.name.fl_str_mv |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação |
repository.mail.fl_str_mv |
|
_version_ |
1799133039802974208 |