Analysis and evaluation of optimization techniques for tracking in augmented reality applications

Detalhes bibliográficos
Autor(a) principal: Teixeira, João Marcelo Xavier Natário
Data de Publicação: 2013
Tipo de documento: Tese
Idioma: eng
Título da fonte: Repositório Institucional da UFPE
Texto Completo: https://repositorio.ufpe.br/handle/123456789/12268
Resumo: Real-time computer vision applications that run on the field and make frequent use of wearable computers have a critical restriction on the amount of processing they can perform, because of the fact that most (if not all) of the application runs on the wearable platform. A balancing scheme capable of allowing the application to use more processing power is fundamental both when input scenarios present more visual restrictions regarding, for example, the object to be tracked, and also to reduce processing in order to save battery and CPU time for other applications when the captured video is better controlled (more accessible). The fact that computer vision applications may run on a variety of platforms justifies the need for defining a model that automatically adjusts the tracker being used in applications with hard performance constraints. Performance degradation in wearable platforms can be greater than expected, as desktop and mobile platforms present different levels of hardware capabilities, and consequently, different performance restrictions. This doctoral thesis addresses the object tracking problem using a decision model, in such a way that prioritizes using the least computationally intensive algorithm whenever possible. It has the following specific objectives: to investigate and implement different tracking techniques, to choose/define a reference metric that can be used to detect image interference (occlusion, image noise, etc.), to propose a decision model that allows automatic switching of different trackers in order to balance the application's performance, and to reduce the application's workload without compromising tracking quality. The effectiveness of the system will be verified by synthetic case studies that comprise different object classes that can be tracked, focusing on augmented reality applications that can run on wearable platforms. Different tracking algorithms will be part of the proposed decision model. It will be shown that by switching among these algorithms, it is possible to reach a performance improvement of a factor of three, while keeping a minimum quality defined by a reprojection error of 10 pixels when compared to the use of only the best algorithm independent of its computational cost. This work results in better performance of applications with memory and battery restrictions.
id UFPE_af9260c5c3972ce4d84b62c836491703
oai_identifier_str oai:repositorio.ufpe.br:123456789/12268
network_acronym_str UFPE
network_name_str Repositório Institucional da UFPE
repository_id_str 2221
spelling Teixeira, João Marcelo Xavier NatárioKelner, Judith Teichrieb, Veronica 2015-03-12T19:02:48Z2015-03-12T19:02:48Z2013-03-01TEIXEIRA, João Marcelo Xavier Natário. Analysis and evaluation of optmization techniques for tracking in augmentes reality applications. Recife, 2013. 93 f. Tese (doutorado) - UFPE, Centro de Informática, Programa de Pós-graduação em Ciência da Computação, 2013..https://repositorio.ufpe.br/handle/123456789/12268Real-time computer vision applications that run on the field and make frequent use of wearable computers have a critical restriction on the amount of processing they can perform, because of the fact that most (if not all) of the application runs on the wearable platform. A balancing scheme capable of allowing the application to use more processing power is fundamental both when input scenarios present more visual restrictions regarding, for example, the object to be tracked, and also to reduce processing in order to save battery and CPU time for other applications when the captured video is better controlled (more accessible). The fact that computer vision applications may run on a variety of platforms justifies the need for defining a model that automatically adjusts the tracker being used in applications with hard performance constraints. Performance degradation in wearable platforms can be greater than expected, as desktop and mobile platforms present different levels of hardware capabilities, and consequently, different performance restrictions. This doctoral thesis addresses the object tracking problem using a decision model, in such a way that prioritizes using the least computationally intensive algorithm whenever possible. It has the following specific objectives: to investigate and implement different tracking techniques, to choose/define a reference metric that can be used to detect image interference (occlusion, image noise, etc.), to propose a decision model that allows automatic switching of different trackers in order to balance the application's performance, and to reduce the application's workload without compromising tracking quality. The effectiveness of the system will be verified by synthetic case studies that comprise different object classes that can be tracked, focusing on augmented reality applications that can run on wearable platforms. Different tracking algorithms will be part of the proposed decision model. It will be shown that by switching among these algorithms, it is possible to reach a performance improvement of a factor of three, while keeping a minimum quality defined by a reprojection error of 10 pixels when compared to the use of only the best algorithm independent of its computational cost. This work results in better performance of applications with memory and battery restrictions.Aplicações de visão computacional em tempo real executadas em campo fazem uso frequente de computadores vestíveis, os quais apresentam uma restrição crítica na quantidade de processamento que podem suportar, uma vez que a maior parte da aplicação (se não sua totalidade) deverá executar na plataforma vestível. É fundamental um esquema de balanceamento de carga capaz de permitir que a aplicação utilize mais poder de processamento quando os cenários de entrada apresentam mais restrições visuais, por exemplo, referentes ao objeto a ser rastreado, e diminua tal processamento com o objetivo de economizar bateria e tempo de CPU em aplicações quando o vídeo capturado é mais controlado (mais acessível). O fato de aplicações de visão computacional executarem em uma variedade de plataformas justifica se definir um modelo que ajuste automaticamente o rastreador em uso em aplicações com restrições de recursos computacionais. A degradação de desempenho em plataformas vestíveis pode ser maior do que a esperada, uma vez que plataformas desktop e móvel apresentam diferentes níveis de configurações de hardware, e consequentemente, diferentes restrições de desempenho. Esta tese de doutorado soluciona o problema do rastreamento de objetos usando um modelo de decisão, objetivando utilizar o algoritmo menos custoso sempre que possível. Como objetivos específicos têm-se: investigar e implementar diferentes técnicas de rastreamento, para escolher/definir uma métrica de referência que possa ser usada para detectar interferência na imagem (oclusão, ruído, etc.), propor um modelo de decisão que permita chaveamento automático entre diferentes rastreadores visando balancear o desempenho da aplicação baseado na métrica escolhida, e diminuir a quantidade de processamento requerida pela aplicação sem comprometer a qualidade do rastreamento envolvido. A eficiência do sistema será verificada através de estudos de caso sintéticos que compreendem diferentes classes de objetos que podem ser rastreados, focando em aplicações de realidade aumentada que executam em plataformas vestíveis. Diferentes algoritmos de rastreamento farão parte do modelo de decisão e através do chaveamento entre eles, será demonstrado que é possível atingir uma melhoria no desempenho de até três vezes, mantendo uma qualidade mínima definida como erro de reprojeção de até 10 pixels quando comparado à utilização apenas do algoritmo que gera a melhor qualidade de rastreamento, independente do seu custo computacional. O impacto desse trabalho implicará em uma melhor qualidade de aplicações com restrições de quantidade de memória, carga de baterias, entre outras.CAPES e CNPqengUniversidade Federal de PernambucoAttribution-NonCommercial-NoDerivs 3.0 Brazilhttp://creativecommons.org/licenses/by-nc-nd/3.0/br/info:eu-repo/semantics/openAccessRealidade aumentadaVisão computacionalAlto desempenhoAugmented realityComputer visionHigh performanceAnalysis and evaluation of optimization techniques for tracking in augmented reality applicationsinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/doctoralThesisreponame:Repositório Institucional da UFPEinstname:Universidade Federal de Pernambuco (UFPE)instacron:UFPETHUMBNAILTese Joao Teixeira.pdf.jpgTese Joao Teixeira.pdf.jpgGenerated Thumbnailimage/jpeg1290https://repositorio.ufpe.br/bitstream/123456789/12268/5/Tese%20Joao%20Teixeira.pdf.jpgd2ecc3e6b33b599ed250f229ffedd425MD55ORIGINALTese Joao Teixeira.pdfTese Joao Teixeira.pdfapplication/pdf5813706https://repositorio.ufpe.br/bitstream/123456789/12268/1/Tese%20Joao%20Teixeira.pdf85ed76e5022129077b181bca61f92678MD51CC-LICENSElicense_rdflicense_rdfapplication/rdf+xml; charset=utf-81232https://repositorio.ufpe.br/bitstream/123456789/12268/2/license_rdf66e71c371cc565284e70f40736c94386MD52LICENSElicense.txtlicense.txttext/plain; charset=utf-82311https://repositorio.ufpe.br/bitstream/123456789/12268/3/license.txt4b8a02c7f2818eaf00dcf2260dd5eb08MD53TEXTTese Joao Teixeira.pdf.txtTese Joao Teixeira.pdf.txtExtracted texttext/plain187995https://repositorio.ufpe.br/bitstream/123456789/12268/4/Tese%20Joao%20Teixeira.pdf.txtdc5bae23f0330fb3b051965d607e2873MD54123456789/122682019-10-25 17:24:18.454oai:repositorio.ufpe.br:123456789/12268TGljZW7Dp2EgZGUgRGlzdHJpYnVpw6fDo28gTsOjbyBFeGNsdXNpdmEKClRvZG8gZGVwb3NpdGFudGUgZGUgbWF0ZXJpYWwgbm8gUmVwb3NpdMOzcmlvIEluc3RpdHVjaW9uYWwgKFJJKSBkZXZlIGNvbmNlZGVyLCDDoCBVbml2ZXJzaWRhZGUgRmVkZXJhbCBkZSBQZXJuYW1idWNvIChVRlBFKSwgdW1hIExpY2Vuw6dhIGRlIERpc3RyaWJ1acOnw6NvIE7Do28gRXhjbHVzaXZhIHBhcmEgbWFudGVyIGUgdG9ybmFyIGFjZXNzw612ZWlzIG9zIHNldXMgZG9jdW1lbnRvcywgZW0gZm9ybWF0byBkaWdpdGFsLCBuZXN0ZSByZXBvc2l0w7NyaW8uCgpDb20gYSBjb25jZXNzw6NvIGRlc3RhIGxpY2Vuw6dhIG7Do28gZXhjbHVzaXZhLCBvIGRlcG9zaXRhbnRlIG1hbnTDqW0gdG9kb3Mgb3MgZGlyZWl0b3MgZGUgYXV0b3IuCl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwoKTGljZW7Dp2EgZGUgRGlzdHJpYnVpw6fDo28gTsOjbyBFeGNsdXNpdmEKCkFvIGNvbmNvcmRhciBjb20gZXN0YSBsaWNlbsOnYSBlIGFjZWl0w6EtbGEsIHZvY8OqIChhdXRvciBvdSBkZXRlbnRvciBkb3MgZGlyZWl0b3MgYXV0b3JhaXMpOgoKYSkgRGVjbGFyYSBxdWUgY29uaGVjZSBhIHBvbMOtdGljYSBkZSBjb3B5cmlnaHQgZGEgZWRpdG9yYSBkbyBzZXUgZG9jdW1lbnRvOwpiKSBEZWNsYXJhIHF1ZSBjb25oZWNlIGUgYWNlaXRhIGFzIERpcmV0cml6ZXMgcGFyYSBvIFJlcG9zaXTDs3JpbyBJbnN0aXR1Y2lvbmFsIGRhIFVGUEU7CmMpIENvbmNlZGUgw6AgVUZQRSBvIGRpcmVpdG8gbsOjbyBleGNsdXNpdm8gZGUgYXJxdWl2YXIsIHJlcHJvZHV6aXIsIGNvbnZlcnRlciAoY29tbyBkZWZpbmlkbyBhIHNlZ3VpciksIGNvbXVuaWNhciBlL291IGRpc3RyaWJ1aXIsIG5vIFJJLCBvIGRvY3VtZW50byBlbnRyZWd1ZSAoaW5jbHVpbmRvIG8gcmVzdW1vL2Fic3RyYWN0KSBlbSBmb3JtYXRvIGRpZ2l0YWwgb3UgcG9yIG91dHJvIG1laW87CmQpIERlY2xhcmEgcXVlIGF1dG9yaXphIGEgVUZQRSBhIGFycXVpdmFyIG1haXMgZGUgdW1hIGPDs3BpYSBkZXN0ZSBkb2N1bWVudG8gZSBjb252ZXJ0w6otbG8sIHNlbSBhbHRlcmFyIG8gc2V1IGNvbnRlw7pkbywgcGFyYSBxdWFscXVlciBmb3JtYXRvIGRlIGZpY2hlaXJvLCBtZWlvIG91IHN1cG9ydGUsIHBhcmEgZWZlaXRvcyBkZSBzZWd1cmFuw6dhLCBwcmVzZXJ2YcOnw6NvIChiYWNrdXApIGUgYWNlc3NvOwplKSBEZWNsYXJhIHF1ZSBvIGRvY3VtZW50byBzdWJtZXRpZG8gw6kgbyBzZXUgdHJhYmFsaG8gb3JpZ2luYWwgZSBxdWUgZGV0w6ltIG8gZGlyZWl0byBkZSBjb25jZWRlciBhIHRlcmNlaXJvcyBvcyBkaXJlaXRvcyBjb250aWRvcyBuZXN0YSBsaWNlbsOnYS4gRGVjbGFyYSB0YW1iw6ltIHF1ZSBhIGVudHJlZ2EgZG8gZG9jdW1lbnRvIG7Do28gaW5mcmluZ2Ugb3MgZGlyZWl0b3MgZGUgb3V0cmEgcGVzc29hIG91IGVudGlkYWRlOwpmKSBEZWNsYXJhIHF1ZSwgbm8gY2FzbyBkbyBkb2N1bWVudG8gc3VibWV0aWRvIGNvbnRlciBtYXRlcmlhbCBkbyBxdWFsIG7Do28gZGV0w6ltIG9zIGRpcmVpdG9zIGRlCmF1dG9yLCBvYnRldmUgYSBhdXRvcml6YcOnw6NvIGlycmVzdHJpdGEgZG8gcmVzcGVjdGl2byBkZXRlbnRvciBkZXNzZXMgZGlyZWl0b3MgcGFyYSBjZWRlciDDoApVRlBFIG9zIGRpcmVpdG9zIHJlcXVlcmlkb3MgcG9yIGVzdGEgTGljZW7Dp2EgZSBhdXRvcml6YXIgYSB1bml2ZXJzaWRhZGUgYSB1dGlsaXrDoS1sb3MgbGVnYWxtZW50ZS4gRGVjbGFyYSB0YW1iw6ltIHF1ZSBlc3NlIG1hdGVyaWFsIGN1am9zIGRpcmVpdG9zIHPDo28gZGUgdGVyY2Vpcm9zIGVzdMOhIGNsYXJhbWVudGUgaWRlbnRpZmljYWRvIGUgcmVjb25oZWNpZG8gbm8gdGV4dG8gb3UgY29udGXDumRvIGRvIGRvY3VtZW50byBlbnRyZWd1ZTsKZykgU2UgbyBkb2N1bWVudG8gZW50cmVndWUgw6kgYmFzZWFkbyBlbSB0cmFiYWxobyBmaW5hbmNpYWRvIG91IGFwb2lhZG8gcG9yIG91dHJhIGluc3RpdHVpw6fDo28gcXVlIG7Do28gYSBVRlBFLMKgZGVjbGFyYSBxdWUgY3VtcHJpdSBxdWFpc3F1ZXIgb2JyaWdhw6fDtWVzIGV4aWdpZGFzIHBlbG8gcmVzcGVjdGl2byBjb250cmF0byBvdSBhY29yZG8uCgpBIFVGUEUgaWRlbnRpZmljYXLDoSBjbGFyYW1lbnRlIG8ocykgbm9tZShzKSBkbyhzKSBhdXRvciAoZXMpIGRvcyBkaXJlaXRvcyBkbyBkb2N1bWVudG8gZW50cmVndWUgZSBuw6NvIGZhcsOhIHF1YWxxdWVyIGFsdGVyYcOnw6NvLCBwYXJhIGFsw6ltIGRvIHByZXZpc3RvIG5hIGFsw61uZWEgYykuCg==Repositório InstitucionalPUBhttps://repositorio.ufpe.br/oai/requestattena@ufpe.bropendoar:22212019-10-25T20:24:18Repositório Institucional da UFPE - Universidade Federal de Pernambuco (UFPE)false
dc.title.pt_BR.fl_str_mv Analysis and evaluation of optimization techniques for tracking in augmented reality applications
title Analysis and evaluation of optimization techniques for tracking in augmented reality applications
spellingShingle Analysis and evaluation of optimization techniques for tracking in augmented reality applications
Teixeira, João Marcelo Xavier Natário
Realidade aumentada
Visão computacional
Alto desempenho
Augmented reality
Computer vision
High performance
title_short Analysis and evaluation of optimization techniques for tracking in augmented reality applications
title_full Analysis and evaluation of optimization techniques for tracking in augmented reality applications
title_fullStr Analysis and evaluation of optimization techniques for tracking in augmented reality applications
title_full_unstemmed Analysis and evaluation of optimization techniques for tracking in augmented reality applications
title_sort Analysis and evaluation of optimization techniques for tracking in augmented reality applications
author Teixeira, João Marcelo Xavier Natário
author_facet Teixeira, João Marcelo Xavier Natário
author_role author
dc.contributor.author.fl_str_mv Teixeira, João Marcelo Xavier Natário
dc.contributor.advisor1.fl_str_mv Kelner, Judith
dc.contributor.advisor-co1.fl_str_mv Teichrieb, Veronica
contributor_str_mv Kelner, Judith
Teichrieb, Veronica
dc.subject.por.fl_str_mv Realidade aumentada
Visão computacional
Alto desempenho
Augmented reality
Computer vision
High performance
topic Realidade aumentada
Visão computacional
Alto desempenho
Augmented reality
Computer vision
High performance
description Real-time computer vision applications that run on the field and make frequent use of wearable computers have a critical restriction on the amount of processing they can perform, because of the fact that most (if not all) of the application runs on the wearable platform. A balancing scheme capable of allowing the application to use more processing power is fundamental both when input scenarios present more visual restrictions regarding, for example, the object to be tracked, and also to reduce processing in order to save battery and CPU time for other applications when the captured video is better controlled (more accessible). The fact that computer vision applications may run on a variety of platforms justifies the need for defining a model that automatically adjusts the tracker being used in applications with hard performance constraints. Performance degradation in wearable platforms can be greater than expected, as desktop and mobile platforms present different levels of hardware capabilities, and consequently, different performance restrictions. This doctoral thesis addresses the object tracking problem using a decision model, in such a way that prioritizes using the least computationally intensive algorithm whenever possible. It has the following specific objectives: to investigate and implement different tracking techniques, to choose/define a reference metric that can be used to detect image interference (occlusion, image noise, etc.), to propose a decision model that allows automatic switching of different trackers in order to balance the application's performance, and to reduce the application's workload without compromising tracking quality. The effectiveness of the system will be verified by synthetic case studies that comprise different object classes that can be tracked, focusing on augmented reality applications that can run on wearable platforms. Different tracking algorithms will be part of the proposed decision model. It will be shown that by switching among these algorithms, it is possible to reach a performance improvement of a factor of three, while keeping a minimum quality defined by a reprojection error of 10 pixels when compared to the use of only the best algorithm independent of its computational cost. This work results in better performance of applications with memory and battery restrictions.
publishDate 2013
dc.date.issued.fl_str_mv 2013-03-01
dc.date.accessioned.fl_str_mv 2015-03-12T19:02:48Z
dc.date.available.fl_str_mv 2015-03-12T19:02:48Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/doctoralThesis
format doctoralThesis
status_str publishedVersion
dc.identifier.citation.fl_str_mv TEIXEIRA, João Marcelo Xavier Natário. Analysis and evaluation of optmization techniques for tracking in augmentes reality applications. Recife, 2013. 93 f. Tese (doutorado) - UFPE, Centro de Informática, Programa de Pós-graduação em Ciência da Computação, 2013..
dc.identifier.uri.fl_str_mv https://repositorio.ufpe.br/handle/123456789/12268
identifier_str_mv TEIXEIRA, João Marcelo Xavier Natário. Analysis and evaluation of optmization techniques for tracking in augmentes reality applications. Recife, 2013. 93 f. Tese (doutorado) - UFPE, Centro de Informática, Programa de Pós-graduação em Ciência da Computação, 2013..
url https://repositorio.ufpe.br/handle/123456789/12268
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv Attribution-NonCommercial-NoDerivs 3.0 Brazil
http://creativecommons.org/licenses/by-nc-nd/3.0/br/
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Attribution-NonCommercial-NoDerivs 3.0 Brazil
http://creativecommons.org/licenses/by-nc-nd/3.0/br/
eu_rights_str_mv openAccess
dc.publisher.none.fl_str_mv Universidade Federal de Pernambuco
publisher.none.fl_str_mv Universidade Federal de Pernambuco
dc.source.none.fl_str_mv reponame:Repositório Institucional da UFPE
instname:Universidade Federal de Pernambuco (UFPE)
instacron:UFPE
instname_str Universidade Federal de Pernambuco (UFPE)
instacron_str UFPE
institution UFPE
reponame_str Repositório Institucional da UFPE
collection Repositório Institucional da UFPE
bitstream.url.fl_str_mv https://repositorio.ufpe.br/bitstream/123456789/12268/5/Tese%20Joao%20Teixeira.pdf.jpg
https://repositorio.ufpe.br/bitstream/123456789/12268/1/Tese%20Joao%20Teixeira.pdf
https://repositorio.ufpe.br/bitstream/123456789/12268/2/license_rdf
https://repositorio.ufpe.br/bitstream/123456789/12268/3/license.txt
https://repositorio.ufpe.br/bitstream/123456789/12268/4/Tese%20Joao%20Teixeira.pdf.txt
bitstream.checksum.fl_str_mv d2ecc3e6b33b599ed250f229ffedd425
85ed76e5022129077b181bca61f92678
66e71c371cc565284e70f40736c94386
4b8a02c7f2818eaf00dcf2260dd5eb08
dc5bae23f0330fb3b051965d607e2873
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
MD5
MD5
MD5
repository.name.fl_str_mv Repositório Institucional da UFPE - Universidade Federal de Pernambuco (UFPE)
repository.mail.fl_str_mv attena@ufpe.br
_version_ 1802310848501252096