ANA: a virtual assistant that sees and hears to help tetraplegic online learning
Autor(a) principal: | |
---|---|
Data de Publicação: | 2019 |
Outros Autores: | , , , |
Tipo de documento: | Artigo de conferência |
Idioma: | eng |
Título da fonte: | Repositório Institucional da UNESP |
Texto Completo: | http://hdl.handle.net/11449/195649 |
Resumo: | To use a computer, users with spinal cord injury must employ special tools that, in most cases, demand a great effort. In online courses, such tools often become a distraction, which might hinder the learning process. Solutions such as tongue mouses, smart glasses and computer vision systems, although promising, still face considerable usability problems. On the other hand, ANA, our conversational agent that can hear and listen to the student, has proven quite promising In Tests have shown that, while using our assistant, tetraplegics were able to focus more on their studies than on the system's interface. In this paper, we present our latest advances on ANA's architecture, introducing a computational grammar that allows for the insertion in online courses of learning objects (LOs) to which students can talk in a natural way. Those LOs respond by performing the requested action. We present the grammar used for processing commands in natural language and show how it is integrated with Google's conversational AI assistant. |
id |
UNSP_eebc9b9aaf917b59ffae9051d532a7f0 |
---|---|
oai_identifier_str |
oai:repositorio.unesp.br:11449/195649 |
network_acronym_str |
UNSP |
network_name_str |
Repositório Institucional da UNESP |
repository_id_str |
2946 |
spelling |
ANA: a virtual assistant that sees and hears to help tetraplegic online learningPeople with tetraplegiaEducationSmart agentNatural Language ProcessingTo use a computer, users with spinal cord injury must employ special tools that, in most cases, demand a great effort. In online courses, such tools often become a distraction, which might hinder the learning process. Solutions such as tongue mouses, smart glasses and computer vision systems, although promising, still face considerable usability problems. On the other hand, ANA, our conversational agent that can hear and listen to the student, has proven quite promising In Tests have shown that, while using our assistant, tetraplegics were able to focus more on their studies than on the system's interface. In this paper, we present our latest advances on ANA's architecture, introducing a computational grammar that allows for the insertion in online courses of learning objects (LOs) to which students can talk in a natural way. Those LOs respond by performing the requested action. We present the grammar used for processing commands in natural language and show how it is integrated with Google's conversational AI assistant.State Univ Cearca, Postgrad Dept Comp Sci, Fortaleza, Ceara, BrazilState Univ Cearca, Dept Comp Sci, Fortaleza, Ceara, BrazilFed Univ Fortaleza, Postgrad Dept Linguist, Fortaleza, Ceara, BrazilState Univ Sao Paulo, Dept Comp Engn, Sao Paulo, BrazilState Univ Sao Paulo, Dept Comp Engn, Sao Paulo, BrazilIeeeState Univ CearcaFed Univ FortalezaUniversidade Estadual Paulista (Unesp)Soares, Maikon I. da S.Oliveira, Francisco C. de M. B.Muniz, Pedro H. G.Nascimento, Marcos D. do [UNESP]IEEE2020-12-10T17:59:03Z2020-12-10T17:59:03Z2019-01-01info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/conferenceObject52019 Ieee Frontiers In Education Conference (fie 2019). New York: Ieee, 5 p., 2019.0190-5848http://hdl.handle.net/11449/195649WOS:000565244800203Web of Sciencereponame:Repositório Institucional da UNESPinstname:Universidade Estadual Paulista (UNESP)instacron:UNESPeng2019 Ieee Frontiers In Education Conference (fie 2019)info:eu-repo/semantics/openAccess2021-10-23T10:18:18Zoai:repositorio.unesp.br:11449/195649Repositório InstitucionalPUBhttp://repositorio.unesp.br/oai/requestopendoar:29462021-10-23T10:18:18Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)false |
dc.title.none.fl_str_mv |
ANA: a virtual assistant that sees and hears to help tetraplegic online learning |
title |
ANA: a virtual assistant that sees and hears to help tetraplegic online learning |
spellingShingle |
ANA: a virtual assistant that sees and hears to help tetraplegic online learning Soares, Maikon I. da S. People with tetraplegia Education Smart agent Natural Language Processing |
title_short |
ANA: a virtual assistant that sees and hears to help tetraplegic online learning |
title_full |
ANA: a virtual assistant that sees and hears to help tetraplegic online learning |
title_fullStr |
ANA: a virtual assistant that sees and hears to help tetraplegic online learning |
title_full_unstemmed |
ANA: a virtual assistant that sees and hears to help tetraplegic online learning |
title_sort |
ANA: a virtual assistant that sees and hears to help tetraplegic online learning |
author |
Soares, Maikon I. da S. |
author_facet |
Soares, Maikon I. da S. Oliveira, Francisco C. de M. B. Muniz, Pedro H. G. Nascimento, Marcos D. do [UNESP] IEEE |
author_role |
author |
author2 |
Oliveira, Francisco C. de M. B. Muniz, Pedro H. G. Nascimento, Marcos D. do [UNESP] IEEE |
author2_role |
author author author author |
dc.contributor.none.fl_str_mv |
State Univ Cearca Fed Univ Fortaleza Universidade Estadual Paulista (Unesp) |
dc.contributor.author.fl_str_mv |
Soares, Maikon I. da S. Oliveira, Francisco C. de M. B. Muniz, Pedro H. G. Nascimento, Marcos D. do [UNESP] IEEE |
dc.subject.por.fl_str_mv |
People with tetraplegia Education Smart agent Natural Language Processing |
topic |
People with tetraplegia Education Smart agent Natural Language Processing |
description |
To use a computer, users with spinal cord injury must employ special tools that, in most cases, demand a great effort. In online courses, such tools often become a distraction, which might hinder the learning process. Solutions such as tongue mouses, smart glasses and computer vision systems, although promising, still face considerable usability problems. On the other hand, ANA, our conversational agent that can hear and listen to the student, has proven quite promising In Tests have shown that, while using our assistant, tetraplegics were able to focus more on their studies than on the system's interface. In this paper, we present our latest advances on ANA's architecture, introducing a computational grammar that allows for the insertion in online courses of learning objects (LOs) to which students can talk in a natural way. Those LOs respond by performing the requested action. We present the grammar used for processing commands in natural language and show how it is integrated with Google's conversational AI assistant. |
publishDate |
2019 |
dc.date.none.fl_str_mv |
2019-01-01 2020-12-10T17:59:03Z 2020-12-10T17:59:03Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/conferenceObject |
format |
conferenceObject |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
2019 Ieee Frontiers In Education Conference (fie 2019). New York: Ieee, 5 p., 2019. 0190-5848 http://hdl.handle.net/11449/195649 WOS:000565244800203 |
identifier_str_mv |
2019 Ieee Frontiers In Education Conference (fie 2019). New York: Ieee, 5 p., 2019. 0190-5848 WOS:000565244800203 |
url |
http://hdl.handle.net/11449/195649 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.relation.none.fl_str_mv |
2019 Ieee Frontiers In Education Conference (fie 2019) |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
5 |
dc.publisher.none.fl_str_mv |
Ieee |
publisher.none.fl_str_mv |
Ieee |
dc.source.none.fl_str_mv |
Web of Science reponame:Repositório Institucional da UNESP instname:Universidade Estadual Paulista (UNESP) instacron:UNESP |
instname_str |
Universidade Estadual Paulista (UNESP) |
instacron_str |
UNESP |
institution |
UNESP |
reponame_str |
Repositório Institucional da UNESP |
collection |
Repositório Institucional da UNESP |
repository.name.fl_str_mv |
Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP) |
repository.mail.fl_str_mv |
|
_version_ |
1803045953255505920 |