Exploring educational immersive videogames: an empirical study with a 3D multimodal interaction prototype

• Autor(a) principal: Alves Fernandes,LMA
• Data de Publicação: 2016
• Outros Autores: Gonçalo Conde Matos, Diogo Pires Azevedo, Ricardo Rodrigues Nunes, Hugo Paredes, Leonel Morgado, Luis Barbosa, Paulo Martins, Benjamim Fonseca, Cristovao,P, de Carvalho,F, Cardoso,B
• Tipo de documento: Artigo
• Idioma: eng
• Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
• Texto Completo: http://repositorio.inesctec.pt/handle/123456789/4080; http://dx.doi.org/10.1080/0144929x.2016.1232754

Gestural interaction devices emerged and originated various studies on multimodal human-computer interaction to improve user experience (UX). However, there is a knowledge gap regarding the use of these devices to enhance learning. We present an exploratory study which analysed the UX with a multimodal immersive videogame prototype, based on a Portuguese historical/cultural episode. Evaluation tests took place in high school environments and public videogaming events. Two users would be present simultaneously in the same virtual reality (VR) environment: one as the helmsman aboard Vasco da Gama's fifteenth-century Portuguese ship and the other as the mythical Adamastor stone giant at the Cape of Good Hope. The helmsman player wore a VR headset to explore the environment, whereas the giant player used body motion to control the giant, and observed results on a screen, with no headset. This allowed a preliminary characterisation of UX, identifying challenges and potential use of these devices in multi-user virtual learning contexts. We also discuss the combined use of such devices, towards future development of similar systems, and its implications on learning improvement through multimodal human-computer interaction.