ATLASCAR2 sensors calibration by global optimization

Detalhes bibliográficos
Autor(a) principal: Costa, Filipe Oliveira
Data de Publicação: 2018
Tipo de documento: Dissertação
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: http://hdl.handle.net/10773/29353
Resumo: In autonomous vehicles, it is often necessary to install a large number of sensors on board. Thus, the extrinsic calibration of these multi-sensory systems is a problem of high relevance for the development algorithms of autonomous driving or of assistance to the driving. This work proposes a tool to automatically calibrate simultaneously multiple cameras. In the process, aruco markers are used, which allows establishing a graph from which the geometric transformations between the various cameras and a global reference are extracted. Initially, markers are detected in the images using an OpenCV tool. Subsequently, the graph is established where the nodes are cameras or markers and the edges are the transformations between them. Then an initial estimate of the extrinsic parameters of all cameras is calculated based on the detections of the markers and the paths obtained from the graph. In the end, an optimization of the parameters is done, where the reprojection error is minimized. In order to demonstrate the process, several datasets were created in order to validate the obtained results.
id RCAP_b9d92e9b97b45e0311c44e980a06fa01
oai_identifier_str oai:ria.ua.pt:10773/29353
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling ATLASCAR2 sensors calibration by global optimizationCamera calibrationSensor fusionExtrinsic calibrationComputational visionAruco markersOptimizationIn autonomous vehicles, it is often necessary to install a large number of sensors on board. Thus, the extrinsic calibration of these multi-sensory systems is a problem of high relevance for the development algorithms of autonomous driving or of assistance to the driving. This work proposes a tool to automatically calibrate simultaneously multiple cameras. In the process, aruco markers are used, which allows establishing a graph from which the geometric transformations between the various cameras and a global reference are extracted. Initially, markers are detected in the images using an OpenCV tool. Subsequently, the graph is established where the nodes are cameras or markers and the edges are the transformations between them. Then an initial estimate of the extrinsic parameters of all cameras is calculated based on the detections of the markers and the paths obtained from the graph. In the end, an optimization of the parameters is done, where the reprojection error is minimized. In order to demonstrate the process, several datasets were created in order to validate the obtained results.Em veículos autónomos é frequente a necessidade de instalar um grande número de sensores a bordo. Assim, a calibração extrínseca destes sistemas multi-sensoriais é um problema de grande relevância para o desenvolvimento de algoritmos de condução autónoma ou de apoio á condução. Este trabalho propõe um mecanismo capaz de fazer uma calibração automática em simultaâneo de várias câmaras. No processo são usados marcadores aruco, o que permite estabelecer um grafo de onde se extraem as transformações geométricas entre as várias câmaras e um referencial global. Inicialmente, os marcadores são detetados nas imagens usando uma ferramenta do OpenCV. Posteriormente é construido o grafo em que os nós são câmaras ou marcadores, e as ligações entre nós são transformações geométricas em pares câmara aruco. Em seguida é calculada uma estimativa inicial dos parâmetros extrínsecos de todas as câmaras, baseada nas deteções dos marcadores e nos caminhos obtidos do grafo. No fim, é feita uma otimização dos parâmetros, onde é minimizado o erro de reprojeção. Para demonstrar o processo foram criados vários "datasets", de modo a validar os resultados obtidos.2020-10-01T13:10:22Z2018-07-25T00:00:00Z2018-07-25info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisapplication/pdfhttp://hdl.handle.net/10773/29353TID:202238237engCosta, Filipe Oliveirainfo:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2024-02-22T11:56:48Zoai:ria.ua.pt:10773/29353Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-20T03:01:43.391259Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv ATLASCAR2 sensors calibration by global optimization
title ATLASCAR2 sensors calibration by global optimization
spellingShingle ATLASCAR2 sensors calibration by global optimization
Costa, Filipe Oliveira
Camera calibration
Sensor fusion
Extrinsic calibration
Computational vision
Aruco markers
Optimization
title_short ATLASCAR2 sensors calibration by global optimization
title_full ATLASCAR2 sensors calibration by global optimization
title_fullStr ATLASCAR2 sensors calibration by global optimization
title_full_unstemmed ATLASCAR2 sensors calibration by global optimization
title_sort ATLASCAR2 sensors calibration by global optimization
author Costa, Filipe Oliveira
author_facet Costa, Filipe Oliveira
author_role author
dc.contributor.author.fl_str_mv Costa, Filipe Oliveira
dc.subject.por.fl_str_mv Camera calibration
Sensor fusion
Extrinsic calibration
Computational vision
Aruco markers
Optimization
topic Camera calibration
Sensor fusion
Extrinsic calibration
Computational vision
Aruco markers
Optimization
description In autonomous vehicles, it is often necessary to install a large number of sensors on board. Thus, the extrinsic calibration of these multi-sensory systems is a problem of high relevance for the development algorithms of autonomous driving or of assistance to the driving. This work proposes a tool to automatically calibrate simultaneously multiple cameras. In the process, aruco markers are used, which allows establishing a graph from which the geometric transformations between the various cameras and a global reference are extracted. Initially, markers are detected in the images using an OpenCV tool. Subsequently, the graph is established where the nodes are cameras or markers and the edges are the transformations between them. Then an initial estimate of the extrinsic parameters of all cameras is calculated based on the detections of the markers and the paths obtained from the graph. In the end, an optimization of the parameters is done, where the reprojection error is minimized. In order to demonstrate the process, several datasets were created in order to validate the obtained results.
publishDate 2018
dc.date.none.fl_str_mv 2018-07-25T00:00:00Z
2018-07-25
2020-10-01T13:10:22Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10773/29353
TID:202238237
url http://hdl.handle.net/10773/29353
identifier_str_mv TID:202238237
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799137672695906304