Interface para controle e monitoramento de ambiente colaborativo em realidade virtual

Detalhes bibliográficos
Autor(a) principal: Berwaldt, Natan Luiz Paetzhold
Data de Publicação: 2023
Tipo de documento: Dissertação
Idioma: por
Título da fonte: Repositório Institucional Manancial UFSM
Texto Completo: http://repositorio.ufsm.br/handle/1/30323
Resumo: The growing interest in virtual reality (VR) devices has driven the generation of content for virtual environments (VEs). Part of this content is built upon the immersive experiences that VR can provide through real-time interaction, engagement, spatial perception, and enrichment of the overall experience. These aspects are beneficial for developing educational and training environments. However, using a virtual reality head-mounted display (HMD) disconnects users’ senses from the physical world they are currently in, and being immersed in the virtual environment makes it challenging for them to configure the simulation settings without breaking the immersion. With this in mind, this dissertation proposes developing a framework that combines multiple metaphors of indirect interaction into a unified virtual interface, enabling users to control collaborative simulations and effectively interact with other users within the virtual environment. The virtual interface is a reduced 3D representation of the environment, based on the World-in-Miniature metaphor, integrating state-of-the-art techniques with new features such as different ways of rendering, level of detail, and focus on specific regions of interest. We also present a technique for remote interaction using virtual cameras to enhance monitoring capabilities further, extending the Through-The-Lens technique with remotely controllable cameras and floating interaction panels that adapt to the user’s surroundings. The framework is finally evaluated in more detail when applied as a monitoring tool for instructors supervising a collaborative VR training simulation. We demonstrate how this system can facilitate various environment configurations and multiuser monitoring and interaction within the virtual environment without breaking the immersion.
id UFSM-20_763f6f0e115adcf32f9d59eec9b65e74
oai_identifier_str oai:repositorio.ufsm.br:1/30323
network_acronym_str UFSM-20
network_name_str Repositório Institucional Manancial UFSM
repository_id_str 3913
spelling 2023-10-09T18:46:18Z2023-10-09T18:46:18Z2023-09-27http://repositorio.ufsm.br/handle/1/30323The growing interest in virtual reality (VR) devices has driven the generation of content for virtual environments (VEs). Part of this content is built upon the immersive experiences that VR can provide through real-time interaction, engagement, spatial perception, and enrichment of the overall experience. These aspects are beneficial for developing educational and training environments. However, using a virtual reality head-mounted display (HMD) disconnects users’ senses from the physical world they are currently in, and being immersed in the virtual environment makes it challenging for them to configure the simulation settings without breaking the immersion. With this in mind, this dissertation proposes developing a framework that combines multiple metaphors of indirect interaction into a unified virtual interface, enabling users to control collaborative simulations and effectively interact with other users within the virtual environment. The virtual interface is a reduced 3D representation of the environment, based on the World-in-Miniature metaphor, integrating state-of-the-art techniques with new features such as different ways of rendering, level of detail, and focus on specific regions of interest. We also present a technique for remote interaction using virtual cameras to enhance monitoring capabilities further, extending the Through-The-Lens technique with remotely controllable cameras and floating interaction panels that adapt to the user’s surroundings. The framework is finally evaluated in more detail when applied as a monitoring tool for instructors supervising a collaborative VR training simulation. We demonstrate how this system can facilitate various environment configurations and multiuser monitoring and interaction within the virtual environment without breaking the immersion.O crescente interesse em dispositivos de realidade virtual (RV) tem impulsionado a geração de conteúdo para ambientes virtuais (AVs). Parte desse conteúdo é construído com base nas experiências imersivas que a RV pode proporcionar por meio da interação em tempo real, engajamento, percepção espacial e enriquecimento da experiência, que são extremamente úteis para desenvolver ambientes de ensino e aprendizagem. No entanto, o uso de um dispositivo de realidade virtual montado na cabeça desconecta os sentidos dos usuários do mundo real em que estão fisicamente presentes, e estar imerso no ambiente virtual dificulta a configuração da simulação em que os usuários estão sem quebrar a imersão. Tendo isso em mente, esta dissertação propõe o desenvolvimento de um framework que combina múltiplas metáforas de interação indireta em uma interface virtual unificada, possibilitando ao usuário exercer controle sobre simulações colaborativas e interagir efetivamente com outros usuários dentro do ambiente virtual. A interface virtual funciona como uma representação 3D reduzida do ambiente, baseada na metáfora World-in-Miniature, integrando técnicas do estado da arte com novas características como escolha de forma de renderização, nível de detalhamento e foco em regiões específicas de interesse. Também apresentamos uma técnica de interação a distância por meio da utilização de câmeras virtuais para aprimorar ainda mais a capacidade de monitoramento do usuário, expandindo a técnica Through-The-Lens com câmeras remotamente controláveis e painéis de interação que se adaptam no entorno do usuário. O framework é por fim avaliado de forma mais detalhada quando aplicado como uma ferramenta de monitoramento para instrutores na supervisão de uma simulação de treinamento colaborativo em RV. Mostramos como este sistema pode possibilitar a realização de várias tarefas de configuração do ambiente e monitoramento e interação com múltiplos usuários dentro do ambiente virtual sem quebrar a imersão.porUniversidade Federal de Santa MariaCentro de TecnologiaPrograma de Pós-Graduação em Ciência da ComputaçãoUFSMBrasilCiência da ComputaçãoAttribution-NonCommercial-NoDerivatives 4.0 Internationalhttp://creativecommons.org/licenses/by-nc-nd/4.0/info:eu-repo/semantics/openAccessRealidade virtualInterfaceInteraçãoTreinamentoSimulaçãoVirtual realityInterfaceInteractionTrainingSimulationCNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAOInterface para controle e monitoramento de ambiente colaborativo em realidade virtualInterface for control and monitoring of collaborative environment in virtual realityinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisPozzer, Cesar Tadeuhttp://lattes.cnpq.br/4519764091092504Rutzig, Mateus BeckClua, Esteban Walter Gonzalezhttp://lattes.cnpq.br/0625472894519266Berwaldt, Natan Luiz Paetzhold1003000000076006006006006007a18407a-9bdc-4098-9de7-4e45311009dbcf0a7d28-1258-42eb-8858-e5b6df351e5d17a4b7f7-e108-4dbd-92c4-69647193c254a8951918-986e-44ae-97b3-fe34f7622a5dreponame:Repositório Institucional Manancial UFSMinstname:Universidade Federal de Santa Maria (UFSM)instacron:UFSMCC-LICENSElicense_rdflicense_rdfapplication/rdf+xml; charset=utf-8805http://repositorio.ufsm.br/bitstream/1/30323/2/license_rdf4460e5956bc1d1639be9ae6146a50347MD52ORIGINALDIS_PPGCC_2023_BERWALDT_NATAN.pdfDIS_PPGCC_2023_BERWALDT_NATAN.pdfDissertação de mestradoapplication/pdf19546675http://repositorio.ufsm.br/bitstream/1/30323/1/DIS_PPGCC_2023_BERWALDT_NATAN.pdfb2dbe7aab54b5c503368932b684dcf60MD51LICENSElicense.txtlicense.txttext/plain; charset=utf-816http://repositorio.ufsm.br/bitstream/1/30323/3/license.txtf8fcb28efb1c8cf0dc096bec902bf4c4MD531/303232023-10-09 15:46:18.649oai:repositorio.ufsm.br:1/30323Q3JlYXRpdmUgQ29tbW9ucw==Repositório Institucionalhttp://repositorio.ufsm.br/PUBhttp://repositorio.ufsm.br/oai/requestouvidoria@ufsm.bropendoar:39132023-10-09T18:46:18Repositório Institucional Manancial UFSM - Universidade Federal de Santa Maria (UFSM)false
dc.title.por.fl_str_mv Interface para controle e monitoramento de ambiente colaborativo em realidade virtual
dc.title.alternative.eng.fl_str_mv Interface for control and monitoring of collaborative environment in virtual reality
title Interface para controle e monitoramento de ambiente colaborativo em realidade virtual
spellingShingle Interface para controle e monitoramento de ambiente colaborativo em realidade virtual
Berwaldt, Natan Luiz Paetzhold
Realidade virtual
Interface
Interação
Treinamento
Simulação
Virtual reality
Interface
Interaction
Training
Simulation
CNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO
title_short Interface para controle e monitoramento de ambiente colaborativo em realidade virtual
title_full Interface para controle e monitoramento de ambiente colaborativo em realidade virtual
title_fullStr Interface para controle e monitoramento de ambiente colaborativo em realidade virtual
title_full_unstemmed Interface para controle e monitoramento de ambiente colaborativo em realidade virtual
title_sort Interface para controle e monitoramento de ambiente colaborativo em realidade virtual
author Berwaldt, Natan Luiz Paetzhold
author_facet Berwaldt, Natan Luiz Paetzhold
author_role author
dc.contributor.advisor1.fl_str_mv Pozzer, Cesar Tadeu
dc.contributor.advisor1Lattes.fl_str_mv http://lattes.cnpq.br/4519764091092504
dc.contributor.referee1.fl_str_mv Rutzig, Mateus Beck
dc.contributor.referee2.fl_str_mv Clua, Esteban Walter Gonzalez
dc.contributor.authorLattes.fl_str_mv http://lattes.cnpq.br/0625472894519266
dc.contributor.author.fl_str_mv Berwaldt, Natan Luiz Paetzhold
contributor_str_mv Pozzer, Cesar Tadeu
Rutzig, Mateus Beck
Clua, Esteban Walter Gonzalez
dc.subject.por.fl_str_mv Realidade virtual
Interface
Interação
Treinamento
Simulação
topic Realidade virtual
Interface
Interação
Treinamento
Simulação
Virtual reality
Interface
Interaction
Training
Simulation
CNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO
dc.subject.eng.fl_str_mv Virtual reality
Interface
Interaction
Training
Simulation
dc.subject.cnpq.fl_str_mv CNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO
description The growing interest in virtual reality (VR) devices has driven the generation of content for virtual environments (VEs). Part of this content is built upon the immersive experiences that VR can provide through real-time interaction, engagement, spatial perception, and enrichment of the overall experience. These aspects are beneficial for developing educational and training environments. However, using a virtual reality head-mounted display (HMD) disconnects users’ senses from the physical world they are currently in, and being immersed in the virtual environment makes it challenging for them to configure the simulation settings without breaking the immersion. With this in mind, this dissertation proposes developing a framework that combines multiple metaphors of indirect interaction into a unified virtual interface, enabling users to control collaborative simulations and effectively interact with other users within the virtual environment. The virtual interface is a reduced 3D representation of the environment, based on the World-in-Miniature metaphor, integrating state-of-the-art techniques with new features such as different ways of rendering, level of detail, and focus on specific regions of interest. We also present a technique for remote interaction using virtual cameras to enhance monitoring capabilities further, extending the Through-The-Lens technique with remotely controllable cameras and floating interaction panels that adapt to the user’s surroundings. The framework is finally evaluated in more detail when applied as a monitoring tool for instructors supervising a collaborative VR training simulation. We demonstrate how this system can facilitate various environment configurations and multiuser monitoring and interaction within the virtual environment without breaking the immersion.
publishDate 2023
dc.date.accessioned.fl_str_mv 2023-10-09T18:46:18Z
dc.date.available.fl_str_mv 2023-10-09T18:46:18Z
dc.date.issued.fl_str_mv 2023-09-27
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://repositorio.ufsm.br/handle/1/30323
url http://repositorio.ufsm.br/handle/1/30323
dc.language.iso.fl_str_mv por
language por
dc.relation.cnpq.fl_str_mv 100300000007
dc.relation.confidence.fl_str_mv 600
600
600
600
600
dc.relation.authority.fl_str_mv 7a18407a-9bdc-4098-9de7-4e45311009db
cf0a7d28-1258-42eb-8858-e5b6df351e5d
17a4b7f7-e108-4dbd-92c4-69647193c254
a8951918-986e-44ae-97b3-fe34f7622a5d
dc.rights.driver.fl_str_mv Attribution-NonCommercial-NoDerivatives 4.0 International
http://creativecommons.org/licenses/by-nc-nd/4.0/
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Attribution-NonCommercial-NoDerivatives 4.0 International
http://creativecommons.org/licenses/by-nc-nd/4.0/
eu_rights_str_mv openAccess
dc.publisher.none.fl_str_mv Universidade Federal de Santa Maria
Centro de Tecnologia
dc.publisher.program.fl_str_mv Programa de Pós-Graduação em Ciência da Computação
dc.publisher.initials.fl_str_mv UFSM
dc.publisher.country.fl_str_mv Brasil
dc.publisher.department.fl_str_mv Ciência da Computação
publisher.none.fl_str_mv Universidade Federal de Santa Maria
Centro de Tecnologia
dc.source.none.fl_str_mv reponame:Repositório Institucional Manancial UFSM
instname:Universidade Federal de Santa Maria (UFSM)
instacron:UFSM
instname_str Universidade Federal de Santa Maria (UFSM)
instacron_str UFSM
institution UFSM
reponame_str Repositório Institucional Manancial UFSM
collection Repositório Institucional Manancial UFSM
bitstream.url.fl_str_mv http://repositorio.ufsm.br/bitstream/1/30323/2/license_rdf
http://repositorio.ufsm.br/bitstream/1/30323/1/DIS_PPGCC_2023_BERWALDT_NATAN.pdf
http://repositorio.ufsm.br/bitstream/1/30323/3/license.txt
bitstream.checksum.fl_str_mv 4460e5956bc1d1639be9ae6146a50347
b2dbe7aab54b5c503368932b684dcf60
f8fcb28efb1c8cf0dc096bec902bf4c4
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
MD5
repository.name.fl_str_mv Repositório Institucional Manancial UFSM - Universidade Federal de Santa Maria (UFSM)
repository.mail.fl_str_mv ouvidoria@ufsm.br
_version_ 1808854728610676736