Serious game augmented reality 3D for physical rehabilitation

• Autor(a) principal: Gaspar, Miguel Gil Ferreira Vaz
• Data de Publicação: 2023
• Tipo de documento: Dissertação
• Idioma: eng
• Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
• Texto Completo: http://hdl.handle.net/10071/29382
• topic: Unity 3D; Oculus quest; Augmented reality; Physical rehabilitation; Realidade aumentada; Reabilitação física

This research consists in the development of a PhysioAR framework (Augmented Reality Physiotherapy) that consider a set of two wearable sensors (Left Controller and Right Controller and Meta/Oculus Quest headset controller for use in natural interactions with a set of AR therapeutic serious games developed on the Unity 3D. The system allows to perform training sessions for hands and fingers, knees and legs motor rehabilitation bearing in mind that the games are for people who have suffered from stroke. The training is part of special care that must be taken for this through the serious games that are properly adapted to be a source of motivation and easy to be played. This FisioAR project includes, two different apps designed, one for calendar and for physiotherapists has a background data with all information needed to do and other to make login in main app and have the possibility to interact with our three types of games specifically designed, developed and implemented for Oculus Quest. Two different mobile apps were constructed on Outsystems platform, where one is destinated to physiotherapists and other is destinated to AVC patient’s. Three Different types of serious games were developed on Unity Platform Engine and all the games have specific contents to be played according with motor and cognitive rehabilitation objectives. The first game called Boxes Game, has six cubes displayed with different colors and six spheres also with six different colors. The main goal of this game is to put the maximum number of spheres in a box with the same color. This game will involve the use of legs, knees and arms and can be easily adapted to each patients’ conditions, making it more or less demanding. The Second Game is called Garden Care Game. Its scenario was made with prefabs (assets) and materials from Unity asset store to simulate a realistic garden, with a watering can, fences and a set of flowers. The main goal of this game is to care the flowers with water. This simple goal is related with the measurement of the wrist rotation made by the patient through wearable sensors while watering each flower. This game as a score for each flower watered. In the Third Game called Puzzle Game, there’s a white screen with the same number of divisions as the existing image blocks in project.