ANA: A virtual assistant that sees and hears to help tetraplegic online learning

• Autor(a) principal: Soares, Maikon I. Da S.
• Data de Publicação: 2019
• Outros Autores: Oliveira, Francisco C. De M. B., Muniz, Pedro H. G., Nascimento, Marcos D. Do
• Tipo de documento: Artigo de conferência
• Idioma: eng
• Título da fonte: Repositório Institucional da UNESP
• Texto Completo: http://dx.doi.org/10.1109/FIE43999.2019.9028558; http://hdl.handle.net/11449/221452
• topic: Education; Natural Language Processing; People with tetraplegia; Smart agent

To use a computer, users with spinal cord injury must employ special tools that, in most cases, demand a great effort. In online courses, such tools often become a distraction, which might hinder the learning process. Solutions such as tongue mouses, smart glasses and computer vision systems, although promising, still face considerable usability problems. On the other hand, ANA, our conversational agent that can hear and listen to the student, has proven quite promising [1]. Tests have shown that, while using our assistant, tetraplegia were able to focus more on their studies than on the system's interface. In this paper, we present our latest advances on ANA's architecture, introducing a computational grammar that allows for the insertion in online courses of 'learning objects' (LOs) to which students can talk in a natural way. Those LOs respond by performing the requested action. We present the grammar used for processing commands in natural language and show how it is integrated with Google's conversational AI assistant.