A Framework for Mobile Augmented Reality in Urban Maintenance

• Autor(a) principal: Rodrigues, André Oliveira
• Data de Publicação: 2021
• Tipo de documento: Dissertação
• Idioma: eng
• Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
• Texto Completo: http://hdl.handle.net/10362/132667
• topic: Mobile Applications; Augmented Reality; 3D Applications; 3D Graphics; Image Processing; Urban Maintenance; Domínio/Área Científica::Engenharia e Tecnologia::Engenharia Eletrotécnica, Eletrónica e Informática

Mobile handheld devices such as smartphones have become increasingly powerful in modern times. Because of this, there has been a surge in 3D graphics-heavy mobile applications that aim to provide immersive experiences. An example of this phenomenon would be Augmented Reality (AR) applications, which have been increasingly popular and offer a wide array of use-cases. The ability to merge the real world with the virtual world seamlessly using the built-in camera of the smartphone brings a whole new world of possibilities, which makes it interesting to explore how such a technology could be used to solve real-world problems. This dissertation focuses on applying this technology in the field of urban maintenance. To do so, a mobile AR application was developed, designed to be used by urban maintenance workers as a field-assistance tool. Using any standard smartphone camera, the developed system can accurately detect any equipment and augment it with relevant information and step-by-step instructions on how to do any required maintenance jobs. Alongside this mobile application, a desktop application was also developed with the purposes of creating and authoring the data and augmentations that should be displayed during a given job, called Archer. Lastly, this dissertation proposes a novel approach to automatically detect and minimize the amount of points (checkpoints) at which the application will ask the user to perform a new equipment recognition, which are useful in order to maintain tracking stability as the user modifies the real-world object during the course of the job. The experiments and user tests conducted during the final stages of this dissertation demonstrate the accuracy and practicality of the developed systems, proving that they can effectively be used to greatly improve the workflow of urban maintenance workers.