Rastreamento de objetos 3D em imagens RGB-D usando otimização por enxame de partículas

Detalhes bibliográficos
Autor(a) principal: SANTOS JÚNIOR, José Guedes dos
Data de Publicação: 2018
Tipo de documento: Dissertação
Idioma: por
Título da fonte: Biblioteca Digital de Teses e Dissertações da UFRPE
Texto Completo: http://www.tede2.ufrpe.br:8080/tede2/handle/tede2/7865
Resumo: The term Augmented Reality is used to specify the systems that have a technology of inserting virtual objects in real scenes, allowing an increase in the amount of information present in the former real environment. In the final result of an Augmented Reality scene footage, the degree of naturalness of this insertion is related not only to the rendering quality of the virtual objects, but also to the accuracy with which the pose of the real objects in relation to the camera is known during the footage, that is, it also depends on the quality of the tracking of these objects. Artificial markers can facilitate and increase the quality of object tracking, however in some situations it is not always possible or desirable to manually insert markers in the scene to be tracked. The solution adopted has been to use features present naturally in the objects belonging to the scene, this type of tracking is called markerless tracking. Some markerless tracking techniques use prior knowledge of the objects to be tracked, this is done by obtaining virtual models of those objects in advance. There are several model-based tracking methods, some of which use search and optimization algorithms such as particle filter or particle swarm optimization to evaluate sets of candidate poses during tracking, these methods have shown very good results. When capturing a scene with a common digital camera, there is always an information loss, since – besides point sampling and quantization – the geometric representation of a real object in the camera image plane in each captured frame is always in 2D. However, by using RGB-D sensors it is possible to build 3D point clouds of a scene, allowing to obtain a more accurate representation of the points that belong to real world objects. This way, new 3D object tracking techniques that use features extracted from 3D points clouds, previously inaccessible in 2D images, have been developed, allowing more precise 6 degree of freedom markerless 3D tracking algorithms. In order to contribute with current research related to 6 degree of freedom markerless 3D generic object tracking algorithms, this work proposes the use of particle swarm optimization to handle multiple pose hypotheses during top-down model-based tracking from RGB-D images. GPU processing was utilized with the aim of improving execution time. A series of experiments were performed, which revealed an improvement in accuracy obtained by the proposed tracking method in comparison to other state of the art optimization-based techniques.
id URPE_528863ec0a415846182b93cda9798404
oai_identifier_str oai:tede2:tede2/7865
network_acronym_str URPE
network_name_str Biblioteca Digital de Teses e Dissertações da UFRPE
repository_id_str
spelling OLIVEIRA JUNIOR, Wilson Rosa deLIMA, João Paulo Silva do MonteOLIVEIRA JUNIOR, Wilson Rosa deMIRANDA, Péricles Barbosa Cunha deTEIXEIRA, João Marcelo Xavier Natáriohttp://lattes.cnpq.br/3964331367512869SANTOS JÚNIOR, José Guedes dos2019-02-26T13:40:02Z2018-02-27SANTOS JÚNIOR, José Guedes dos. Rastreamento de objetos 3D em imagens RGB-D usando otimização por enxame de partículas. 2018. 78 f. Dissertação (Programa de Pós-Graduação em Informática Aplicada) - Universidade Federal Rural de Pernambuco, Recife.http://www.tede2.ufrpe.br:8080/tede2/handle/tede2/7865The term Augmented Reality is used to specify the systems that have a technology of inserting virtual objects in real scenes, allowing an increase in the amount of information present in the former real environment. In the final result of an Augmented Reality scene footage, the degree of naturalness of this insertion is related not only to the rendering quality of the virtual objects, but also to the accuracy with which the pose of the real objects in relation to the camera is known during the footage, that is, it also depends on the quality of the tracking of these objects. Artificial markers can facilitate and increase the quality of object tracking, however in some situations it is not always possible or desirable to manually insert markers in the scene to be tracked. The solution adopted has been to use features present naturally in the objects belonging to the scene, this type of tracking is called markerless tracking. Some markerless tracking techniques use prior knowledge of the objects to be tracked, this is done by obtaining virtual models of those objects in advance. There are several model-based tracking methods, some of which use search and optimization algorithms such as particle filter or particle swarm optimization to evaluate sets of candidate poses during tracking, these methods have shown very good results. When capturing a scene with a common digital camera, there is always an information loss, since – besides point sampling and quantization – the geometric representation of a real object in the camera image plane in each captured frame is always in 2D. However, by using RGB-D sensors it is possible to build 3D point clouds of a scene, allowing to obtain a more accurate representation of the points that belong to real world objects. This way, new 3D object tracking techniques that use features extracted from 3D points clouds, previously inaccessible in 2D images, have been developed, allowing more precise 6 degree of freedom markerless 3D tracking algorithms. In order to contribute with current research related to 6 degree of freedom markerless 3D generic object tracking algorithms, this work proposes the use of particle swarm optimization to handle multiple pose hypotheses during top-down model-based tracking from RGB-D images. GPU processing was utilized with the aim of improving execution time. A series of experiments were performed, which revealed an improvement in accuracy obtained by the proposed tracking method in comparison to other state of the art optimization-based techniques.O termo Realidade Aumentada é usado para especificar os sistemas que possuem a tecnologia de inserir objetos virtuais em cenas reais, permitindo assim aumentar a quantidade de informações presentes no ambiente real original. No resultado final de uma cena filmada com Realidade Aumentada, o grau de naturalidade dessa inserção não está relacionado apenas com a qualidade da renderização dos objetos virtuais, mas também com a precisão com que se conhece a pose dos objetos reais em relação à câmera ao longo da filmagem, isto é, depende também da qualidade do rastreamento desses objetos. Marcadores artificiais, além de facilitar, podem aumentar a qualidade do rastreamento de objetos, porém em algumas situações nem sempre é possível ou desejável inserir manualmente marcadores na cena que vai ser rastreada. A solução adotada tem sido usar características presentes naturalmente nos objetos pertencentes à cena, esse tipo de rastreamento é chamado de rastreamento sem marcadores. Algumas técnicas de rastreamento sem marcadores usam o conhecimento prévio dos objetos que serão rastreados, isso é feito a partir da obtenção antecipada de modelos virtuais desses objetos. Existem diversos métodos de rastreamento a partir de modelos, alguns deles usam algoritmos de busca e otimização como o filtro de partículas ou a otimização por enxame de partículas para avaliar conjuntos de poses candidatas durante o rastreamento, estes métodos têm mostrado resultados muito bons. Ao filmar uma cena com uma câmera digital comum, há sempre a perda de informações, pois, além da amostragem e quantização dos pontos, a representação geométrica de um objeto real no plano de imagem da câmera a cada quadro capturado é sempre em 2D. Contudo, a partir de sensores RGB-D é possível construir nuvens de pontos 3D de uma cena, permitindo assim obter uma representação mais fiel dos pontos pertencentes aos objetos do mundo real. Dessa forma, novas técnicas de rastreamento de objetos 3D que usam características extraídas de nuvens de pontos 3D, antes inacessíveis em imagens 2D, têm sido desenvolvidas, proporcionando algoritmos de rastreamento sem marcadores e com 6 graus de liberdade mais precisos. Com o objetivo de contribuir com as pesquisas atuais relacionadas ao rastreamento sem marcadores de objetos 3D genéricos e com 6 graus de liberdade, este trabalho propõe o uso de otimização por enxame de partículas para lidar com múltiplas hipóteses de pose durante o rastreamento top-down a partir de imagens RGB-D e baseado em modelos. O processamento em GPU foi utilizado no intuito de aprimorar o tempo de execução. A realização de uma série de experimentos revelou uma melhora na precisão obtida pelo método de rastreamento proposto em comparação com outras técnicas baseadas em otimização do estado da arte.Submitted by Mario BC (mario@bc.ufrpe.br) on 2019-02-26T13:40:02Z No. of bitstreams: 1 Jose Guedes dos Santos Junior.pdf: 2344381 bytes, checksum: 6cc5d3b70f76df0f49cc0ecfbe593e0a (MD5)Made available in DSpace on 2019-02-26T13:40:02Z (GMT). No. of bitstreams: 1 Jose Guedes dos Santos Junior.pdf: 2344381 bytes, checksum: 6cc5d3b70f76df0f49cc0ecfbe593e0a (MD5) Previous issue date: 2018-02-27application/pdfporUniversidade Federal Rural de PernambucoPrograma de Pós-Graduação em Informática AplicadaUFRPEBrasilDepartamento de Estatística e InformáticaRastreamento 3DImagens RGB-DProcessamento em GPUCIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAORastreamento de objetos 3D em imagens RGB-D usando otimização por enxame de partículasinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesis-8268485641417162699600600600-67745551403961205013671711205811204509info:eu-repo/semantics/openAccessreponame:Biblioteca Digital de Teses e Dissertações da UFRPEinstname:Universidade Federal Rural de Pernambuco (UFRPE)instacron:UFRPEORIGINALJose Guedes dos Santos Junior.pdfJose Guedes dos Santos Junior.pdfapplication/pdf2344381http://www.tede2.ufrpe.br:8080/tede2/bitstream/tede2/7865/2/Jose+Guedes+dos+Santos+Junior.pdf6cc5d3b70f76df0f49cc0ecfbe593e0aMD52LICENSElicense.txtlicense.txttext/plain; charset=utf-82165http://www.tede2.ufrpe.br:8080/tede2/bitstream/tede2/7865/1/license.txtbd3efa91386c1718a7f26a329fdcb468MD51tede2/78652022-11-08 09:00:08.363oai:tede2:tede2/7865Tk9UQTogQ09MT1FVRSBBUVVJIEEgU1VBIFBSw5NQUklBIExJQ0VOw4dBCkVzdGEgbGljZW7Dp2EgZGUgZXhlbXBsbyDDqSBmb3JuZWNpZGEgYXBlbmFzIHBhcmEgZmlucyBpbmZvcm1hdGl2b3MuCgpMSUNFTsOHQSBERSBESVNUUklCVUnDh8ODTyBOw4NPLUVYQ0xVU0lWQQoKQ29tIGEgYXByZXNlbnRhw6fDo28gZGVzdGEgbGljZW7Dp2EsIHZvY8OqIChvIGF1dG9yIChlcykgb3UgbyB0aXR1bGFyIGRvcyBkaXJlaXRvcyBkZSBhdXRvcikgY29uY2VkZSDDoCBVbml2ZXJzaWRhZGUgClhYWCAoU2lnbGEgZGEgVW5pdmVyc2lkYWRlKSBvIGRpcmVpdG8gbsOjby1leGNsdXNpdm8gZGUgcmVwcm9kdXppciwgIHRyYWR1emlyIChjb25mb3JtZSBkZWZpbmlkbyBhYmFpeG8pLCBlL291IApkaXN0cmlidWlyIGEgc3VhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbyAoaW5jbHVpbmRvIG8gcmVzdW1vKSBwb3IgdG9kbyBvIG11bmRvIG5vIGZvcm1hdG8gaW1wcmVzc28gZSBlbGV0csO0bmljbyBlIAplbSBxdWFscXVlciBtZWlvLCBpbmNsdWluZG8gb3MgZm9ybWF0b3Mgw6F1ZGlvIG91IHbDrWRlby4KClZvY8OqIGNvbmNvcmRhIHF1ZSBhIFNpZ2xhIGRlIFVuaXZlcnNpZGFkZSBwb2RlLCBzZW0gYWx0ZXJhciBvIGNvbnRlw7pkbywgdHJhbnNwb3IgYSBzdWEgdGVzZSBvdSBkaXNzZXJ0YcOnw6NvIApwYXJhIHF1YWxxdWVyIG1laW8gb3UgZm9ybWF0byBwYXJhIGZpbnMgZGUgcHJlc2VydmHDp8Ojby4KClZvY8OqIHRhbWLDqW0gY29uY29yZGEgcXVlIGEgU2lnbGEgZGUgVW5pdmVyc2lkYWRlIHBvZGUgbWFudGVyIG1haXMgZGUgdW1hIGPDs3BpYSBhIHN1YSB0ZXNlIG91IApkaXNzZXJ0YcOnw6NvIHBhcmEgZmlucyBkZSBzZWd1cmFuw6dhLCBiYWNrLXVwIGUgcHJlc2VydmHDp8Ojby4KClZvY8OqIGRlY2xhcmEgcXVlIGEgc3VhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbyDDqSBvcmlnaW5hbCBlIHF1ZSB2b2PDqiB0ZW0gbyBwb2RlciBkZSBjb25jZWRlciBvcyBkaXJlaXRvcyBjb250aWRvcyAKbmVzdGEgbGljZW7Dp2EuIFZvY8OqIHRhbWLDqW0gZGVjbGFyYSBxdWUgbyBkZXDDs3NpdG8gZGEgc3VhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbyBuw6NvLCBxdWUgc2VqYSBkZSBzZXUgCmNvbmhlY2ltZW50bywgaW5mcmluZ2UgZGlyZWl0b3MgYXV0b3JhaXMgZGUgbmluZ3XDqW0uCgpDYXNvIGEgc3VhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbyBjb250ZW5oYSBtYXRlcmlhbCBxdWUgdm9jw6ogbsOjbyBwb3NzdWkgYSB0aXR1bGFyaWRhZGUgZG9zIGRpcmVpdG9zIGF1dG9yYWlzLCB2b2PDqiAKZGVjbGFyYSBxdWUgb2J0ZXZlIGEgcGVybWlzc8OjbyBpcnJlc3RyaXRhIGRvIGRldGVudG9yIGRvcyBkaXJlaXRvcyBhdXRvcmFpcyBwYXJhIGNvbmNlZGVyIMOgIFNpZ2xhIGRlIFVuaXZlcnNpZGFkZSAKb3MgZGlyZWl0b3MgYXByZXNlbnRhZG9zIG5lc3RhIGxpY2Vuw6dhLCBlIHF1ZSBlc3NlIG1hdGVyaWFsIGRlIHByb3ByaWVkYWRlIGRlIHRlcmNlaXJvcyBlc3TDoSBjbGFyYW1lbnRlIAppZGVudGlmaWNhZG8gZSByZWNvbmhlY2lkbyBubyB0ZXh0byBvdSBubyBjb250ZcO6ZG8gZGEgdGVzZSBvdSBkaXNzZXJ0YcOnw6NvIG9yYSBkZXBvc2l0YWRhLgoKQ0FTTyBBIFRFU0UgT1UgRElTU0VSVEHDh8ODTyBPUkEgREVQT1NJVEFEQSBURU5IQSBTSURPIFJFU1VMVEFETyBERSBVTSBQQVRST0PDjU5JTyBPVSAKQVBPSU8gREUgVU1BIEFHw4pOQ0lBIERFIEZPTUVOVE8gT1UgT1VUUk8gT1JHQU5JU01PIFFVRSBOw4NPIFNFSkEgQSBTSUdMQSBERSAKVU5JVkVSU0lEQURFLCBWT0PDiiBERUNMQVJBIFFVRSBSRVNQRUlUT1UgVE9ET1MgRSBRVUFJU1FVRVIgRElSRUlUT1MgREUgUkVWSVPDg08gQ09NTyAKVEFNQsOJTSBBUyBERU1BSVMgT0JSSUdBw4fDlUVTIEVYSUdJREFTIFBPUiBDT05UUkFUTyBPVSBBQ09SRE8uCgpBIFNpZ2xhIGRlIFVuaXZlcnNpZGFkZSBzZSBjb21wcm9tZXRlIGEgaWRlbnRpZmljYXIgY2xhcmFtZW50ZSBvIHNldSBub21lIChzKSBvdSBvKHMpIG5vbWUocykgZG8ocykgCmRldGVudG9yKGVzKSBkb3MgZGlyZWl0b3MgYXV0b3JhaXMgZGEgdGVzZSBvdSBkaXNzZXJ0YcOnw6NvLCBlIG7Do28gZmFyw6EgcXVhbHF1ZXIgYWx0ZXJhw6fDo28sIGFsw6ltIGRhcXVlbGFzIApjb25jZWRpZGFzIHBvciBlc3RhIGxpY2Vuw6dhLgo=Biblioteca Digital de Teses e Dissertaçõeshttp://www.tede2.ufrpe.br:8080/tede/PUBhttp://www.tede2.ufrpe.br:8080/oai/requestbdtd@ufrpe.br ||bdtd@ufrpe.bropendoar:2022-11-08T12:00:08Biblioteca Digital de Teses e Dissertações da UFRPE - Universidade Federal Rural de Pernambuco (UFRPE)false
dc.title.por.fl_str_mv Rastreamento de objetos 3D em imagens RGB-D usando otimização por enxame de partículas
title Rastreamento de objetos 3D em imagens RGB-D usando otimização por enxame de partículas
spellingShingle Rastreamento de objetos 3D em imagens RGB-D usando otimização por enxame de partículas
SANTOS JÚNIOR, José Guedes dos
Rastreamento 3D
Imagens RGB-D
Processamento em GPU
CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO
title_short Rastreamento de objetos 3D em imagens RGB-D usando otimização por enxame de partículas
title_full Rastreamento de objetos 3D em imagens RGB-D usando otimização por enxame de partículas
title_fullStr Rastreamento de objetos 3D em imagens RGB-D usando otimização por enxame de partículas
title_full_unstemmed Rastreamento de objetos 3D em imagens RGB-D usando otimização por enxame de partículas
title_sort Rastreamento de objetos 3D em imagens RGB-D usando otimização por enxame de partículas
author SANTOS JÚNIOR, José Guedes dos
author_facet SANTOS JÚNIOR, José Guedes dos
author_role author
dc.contributor.advisor1.fl_str_mv OLIVEIRA JUNIOR, Wilson Rosa de
dc.contributor.advisor-co1.fl_str_mv LIMA, João Paulo Silva do Monte
dc.contributor.referee1.fl_str_mv OLIVEIRA JUNIOR, Wilson Rosa de
dc.contributor.referee2.fl_str_mv MIRANDA, Péricles Barbosa Cunha de
dc.contributor.referee3.fl_str_mv TEIXEIRA, João Marcelo Xavier Natário
dc.contributor.authorLattes.fl_str_mv http://lattes.cnpq.br/3964331367512869
dc.contributor.author.fl_str_mv SANTOS JÚNIOR, José Guedes dos
contributor_str_mv OLIVEIRA JUNIOR, Wilson Rosa de
LIMA, João Paulo Silva do Monte
OLIVEIRA JUNIOR, Wilson Rosa de
MIRANDA, Péricles Barbosa Cunha de
TEIXEIRA, João Marcelo Xavier Natário
dc.subject.por.fl_str_mv Rastreamento 3D
Imagens RGB-D
Processamento em GPU
topic Rastreamento 3D
Imagens RGB-D
Processamento em GPU
CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO
dc.subject.cnpq.fl_str_mv CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO
description The term Augmented Reality is used to specify the systems that have a technology of inserting virtual objects in real scenes, allowing an increase in the amount of information present in the former real environment. In the final result of an Augmented Reality scene footage, the degree of naturalness of this insertion is related not only to the rendering quality of the virtual objects, but also to the accuracy with which the pose of the real objects in relation to the camera is known during the footage, that is, it also depends on the quality of the tracking of these objects. Artificial markers can facilitate and increase the quality of object tracking, however in some situations it is not always possible or desirable to manually insert markers in the scene to be tracked. The solution adopted has been to use features present naturally in the objects belonging to the scene, this type of tracking is called markerless tracking. Some markerless tracking techniques use prior knowledge of the objects to be tracked, this is done by obtaining virtual models of those objects in advance. There are several model-based tracking methods, some of which use search and optimization algorithms such as particle filter or particle swarm optimization to evaluate sets of candidate poses during tracking, these methods have shown very good results. When capturing a scene with a common digital camera, there is always an information loss, since – besides point sampling and quantization – the geometric representation of a real object in the camera image plane in each captured frame is always in 2D. However, by using RGB-D sensors it is possible to build 3D point clouds of a scene, allowing to obtain a more accurate representation of the points that belong to real world objects. This way, new 3D object tracking techniques that use features extracted from 3D points clouds, previously inaccessible in 2D images, have been developed, allowing more precise 6 degree of freedom markerless 3D tracking algorithms. In order to contribute with current research related to 6 degree of freedom markerless 3D generic object tracking algorithms, this work proposes the use of particle swarm optimization to handle multiple pose hypotheses during top-down model-based tracking from RGB-D images. GPU processing was utilized with the aim of improving execution time. A series of experiments were performed, which revealed an improvement in accuracy obtained by the proposed tracking method in comparison to other state of the art optimization-based techniques.
publishDate 2018
dc.date.issued.fl_str_mv 2018-02-27
dc.date.accessioned.fl_str_mv 2019-02-26T13:40:02Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.citation.fl_str_mv SANTOS JÚNIOR, José Guedes dos. Rastreamento de objetos 3D em imagens RGB-D usando otimização por enxame de partículas. 2018. 78 f. Dissertação (Programa de Pós-Graduação em Informática Aplicada) - Universidade Federal Rural de Pernambuco, Recife.
dc.identifier.uri.fl_str_mv http://www.tede2.ufrpe.br:8080/tede2/handle/tede2/7865
identifier_str_mv SANTOS JÚNIOR, José Guedes dos. Rastreamento de objetos 3D em imagens RGB-D usando otimização por enxame de partículas. 2018. 78 f. Dissertação (Programa de Pós-Graduação em Informática Aplicada) - Universidade Federal Rural de Pernambuco, Recife.
url http://www.tede2.ufrpe.br:8080/tede2/handle/tede2/7865
dc.language.iso.fl_str_mv por
language por
dc.relation.program.fl_str_mv -8268485641417162699
dc.relation.confidence.fl_str_mv 600
600
600
dc.relation.department.fl_str_mv -6774555140396120501
dc.relation.cnpq.fl_str_mv 3671711205811204509
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Universidade Federal Rural de Pernambuco
dc.publisher.program.fl_str_mv Programa de Pós-Graduação em Informática Aplicada
dc.publisher.initials.fl_str_mv UFRPE
dc.publisher.country.fl_str_mv Brasil
dc.publisher.department.fl_str_mv Departamento de Estatística e Informática
publisher.none.fl_str_mv Universidade Federal Rural de Pernambuco
dc.source.none.fl_str_mv reponame:Biblioteca Digital de Teses e Dissertações da UFRPE
instname:Universidade Federal Rural de Pernambuco (UFRPE)
instacron:UFRPE
instname_str Universidade Federal Rural de Pernambuco (UFRPE)
instacron_str UFRPE
institution UFRPE
reponame_str Biblioteca Digital de Teses e Dissertações da UFRPE
collection Biblioteca Digital de Teses e Dissertações da UFRPE
bitstream.url.fl_str_mv http://www.tede2.ufrpe.br:8080/tede2/bitstream/tede2/7865/2/Jose+Guedes+dos+Santos+Junior.pdf
http://www.tede2.ufrpe.br:8080/tede2/bitstream/tede2/7865/1/license.txt
bitstream.checksum.fl_str_mv 6cc5d3b70f76df0f49cc0ecfbe593e0a
bd3efa91386c1718a7f26a329fdcb468
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
repository.name.fl_str_mv Biblioteca Digital de Teses e Dissertações da UFRPE - Universidade Federal Rural de Pernambuco (UFRPE)
repository.mail.fl_str_mv bdtd@ufrpe.br ||bdtd@ufrpe.br
_version_ 1800311489497661440