AtalaIA : uso de Deep Learning para reconhecimento automático de placas de licença automotiva em dispositivos com recursos limitados

Detalhes bibliográficos
Autor(a) principal: Silva, José Vitor Santos
Data de Publicação: 2022
Tipo de documento: Trabalho de conclusão de curso
Idioma: por
Título da fonte: Repositório Institucional da UFS
Texto Completo: http://ri.ufs.br/jspui/handle/riufs/16257
Resumo: The use of deep learning based solutions is increasingly present in people’s daily lives. These solutions are the key component of applications from different domains. In computer vision, the use of convolutional neural networks has assumed a prominent role, achieving significant success in tasks such as image classification, semantic segmentation, and object detection. However, solutions based on deep models often require a significant amount of computational resources, for example GPUs, to operate at acceptable levels of latency. This makes them expensive and restricts their deployment in some real-world scenarios. In addition, the advent of 5G and the growing demand for intelligent devices and embedded systems, whose processing power is limited, encourage the creation of neural networks adapted to devices with limited memory, processor, or battery. The combination of deep learning models and resource-constrained systems paves the way for cheaper commercial products, democratizing the access to technology and expanding its impact on society. In this context, this work presents the development of an automatic license plate recognition system (ALPR) suitable for real-world scenarios. The ALPR plays an important role in many practical applications. It can be used by government agencies to find cars involved in crime, traffic law enforcement, border control, and road traffic monitoring, and it can also be used by private companies for commercial purposes such as automatic toll collection and access control to private zones. The ALPR system developed in this work was based on specific object detection models for each of the recognition steps: vehicle detection, license plate detection, and character detection. For the development of the system, we built an original database of 5029 images of 326 different vehicles, which we named UFS-ALPR. Using the built database, we performed experiments with five different architectures: YOLOv4 Tiny, YOLOv5 Nano, YOLOv5 Small, SSD and CenterNet. Subsequently, we analyzed the performance of the trained models and embedded the proposed system in two limited processing devices: Raspberry Pi 4 and NVIDIA Jetson Nano. The conventional version of the proposed ALPR system was able to correctly recognize 87.58% of the license plates in the UFS-ALPR database. The embedded version in the Raspberry Pi 4 and Jetson Nano correctly recognized 77.05% and 77.51%, with 0.53 FPS and 5.66 FPS, respectively.
id UFS-2_60f5d202290df270ee92df823b185aa6
oai_identifier_str oai:ufs.br:riufs/16257
network_acronym_str UFS-2
network_name_str Repositório Institucional da UFS
repository_id_str
spelling Silva, José Vitor SantosMatos, Leonardo NogueiraPrado, Bruno Otávio PiedadeSantos, Flávio2022-09-05T12:53:28Z2022-09-05T12:53:28Z2022-08-08Silva, José Vitor Santos. AtalaIA : uso de Deep Learning para reconhecimento automático de placas de licença automotiva em dispositivos com recursos limitados. São Cristóvão, 2022. Monografia (Graduação em Engenharia da Computação) – Departamento de Computação, Centro de Ciências Exatas e Tecnologia, Universidade Federal de Sergipe, São Cristóvão, SE, 2022http://ri.ufs.br/jspui/handle/riufs/16257The use of deep learning based solutions is increasingly present in people’s daily lives. These solutions are the key component of applications from different domains. In computer vision, the use of convolutional neural networks has assumed a prominent role, achieving significant success in tasks such as image classification, semantic segmentation, and object detection. However, solutions based on deep models often require a significant amount of computational resources, for example GPUs, to operate at acceptable levels of latency. This makes them expensive and restricts their deployment in some real-world scenarios. In addition, the advent of 5G and the growing demand for intelligent devices and embedded systems, whose processing power is limited, encourage the creation of neural networks adapted to devices with limited memory, processor, or battery. The combination of deep learning models and resource-constrained systems paves the way for cheaper commercial products, democratizing the access to technology and expanding its impact on society. In this context, this work presents the development of an automatic license plate recognition system (ALPR) suitable for real-world scenarios. The ALPR plays an important role in many practical applications. It can be used by government agencies to find cars involved in crime, traffic law enforcement, border control, and road traffic monitoring, and it can also be used by private companies for commercial purposes such as automatic toll collection and access control to private zones. The ALPR system developed in this work was based on specific object detection models for each of the recognition steps: vehicle detection, license plate detection, and character detection. For the development of the system, we built an original database of 5029 images of 326 different vehicles, which we named UFS-ALPR. Using the built database, we performed experiments with five different architectures: YOLOv4 Tiny, YOLOv5 Nano, YOLOv5 Small, SSD and CenterNet. Subsequently, we analyzed the performance of the trained models and embedded the proposed system in two limited processing devices: Raspberry Pi 4 and NVIDIA Jetson Nano. The conventional version of the proposed ALPR system was able to correctly recognize 87.58% of the license plates in the UFS-ALPR database. The embedded version in the Raspberry Pi 4 and Jetson Nano correctly recognized 77.05% and 77.51%, with 0.53 FPS and 5.66 FPS, respectively.O uso de soluções baseadas em deep learning está cada vez mais presente no cotidiano das pessoas. Essas soluções são o componente principal em aplicações de diferentes domínios. Na visão computacional, o emprego das redes neurais convolucionais vem assumindo um papel de destaque, alcançando significativo sucesso em tarefas como classificação de imagens, segmentação semântica e detecção de objetos. Contudo, soluções baseadas em modelos profundos muitas vezes necessitam de uma quantidade significativa de recursos computacionais, por exemplo GPUs, para operar em níveis aceitáveis de latência. Isso encarece e restringe sua implantação em alguns cenários do mundo real. Além disso, o advento do 5G e a crescente demanda por dispositivos inteligentes e sistemas embarcados cujo poder de processamento é limitado, incentivam a criação de redes neurais adaptadas a dispositivos com limitação de memória, processador ou bateria. A combinação de modelos de aprendizagem profunda e sistemas com recursos limitados abre caminho para o surgimento de produtos comerciais mais baratos, democratizando o acesso à tecnologia e expandindo o impacto dela na sociedade. O presente trabalho apresenta o desenvolvimento de um sistema de reconhecimento automático de placas de licença automotiva (ALPR - Automatic License Plate Recognition) adequado a cenários do mundo real. O ALPR desempenha um importante papel em diversas aplicações práticas. Ele pode ser usado por agências governamentais para encontrar carros envolvidos em crimes, aplicação das leis de trânsito, controle de fronteira e monitoramento do tráfego rodoviário, também podendo ser usado por empresas privadas para fins comerciais, como cobrança automática de pedágio e controle de acesso a zonas privadas. O sistema ALPR desenvolvido neste trabalho utilizou como base modelos de detecção de objetos específicos para cada uma das etapas de reconhecimento: detecção do veículo, detecção da placa e detecção dos caracteres. Para o desenvolvimento do sistema, construímos uma base de dados original de 5029 imagens de 326 veículos distintos, a qual intitulamos UFS-ALPR. Utilizando a base de dados construída, realizamos experimentos com cinco diferentes arquiteturas: YOLOv4 Tiny, YOLOv5 Nano, YOLOv5 Small, SSD e CenterNet. Posteriormente, analisamos o desempenho dos modelos treinados e embarcamos o sistema proposto em dois dispositivos de processamento limitado: Raspberry Pi 4 e NVIDIA Jetson Nano. A versão convencional do sistema ALPR proposto foi capaz de reconhecer corretamente 87,58% das placas da base de dados UFS-ALPR. Já a versão embarcada no Raspberry Pi 4 e no Jetson Nano reconheceu corretamente 77,05% e 77,51%, há uma taxa de 0,53 FPS e 5,66 FPS, respectivamente.São Cristóvão, SEporEngenharia da ComputaçãoEnsino de engenharia da computaçãoALPRDeep learningEdge computingObject detectionALPRDeep learningEdge computingObject detectionCIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO::METODOLOGIA E TECNICAS DA COMPUTACAO::ENGENHARIA DE SOFTWAREAtalaIA : uso de Deep Learning para reconhecimento automático de placas de licença automotiva em dispositivos com recursos limitadosinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/bachelorThesisUniversidade Federal de SergipeDCOMP - Departamento de Computação – Engenharia de Computação – São Cristóvão - Presencialreponame:Repositório Institucional da UFSinstname:Universidade Federal de Sergipe (UFS)instacron:UFSinfo:eu-repo/semantics/openAccessTEXTJose_Vitor_Santos_Silva.pdf.txtJose_Vitor_Santos_Silva.pdf.txtExtracted texttext/plain182466https://ri.ufs.br/jspui/bitstream/riufs/16257/3/Jose_Vitor_Santos_Silva.pdf.txt84d169d69cbd96fe7b57d5f2b521d5b7MD53THUMBNAILJose_Vitor_Santos_Silva.pdf.jpgJose_Vitor_Santos_Silva.pdf.jpgGenerated Thumbnailimage/jpeg1348https://ri.ufs.br/jspui/bitstream/riufs/16257/4/Jose_Vitor_Santos_Silva.pdf.jpg5b727d3bf4b26dcb6425109e86d57522MD54LICENSElicense.txtlicense.txttext/plain; charset=utf-81475https://ri.ufs.br/jspui/bitstream/riufs/16257/1/license.txt098cbbf65c2c15e1fb2e49c5d306a44cMD51ORIGINALJose_Vitor_Santos_Silva.pdfJose_Vitor_Santos_Silva.pdfapplication/pdf14026622https://ri.ufs.br/jspui/bitstream/riufs/16257/2/Jose_Vitor_Santos_Silva.pdfffe3d188c6bc2d4786c3977d39420426MD52riufs/162572022-09-05 09:53:29.034oai:ufs.br:riufs/16257TElDRU7Dh0EgREUgRElTVFJJQlVJw4fDg08gTsODTy1FWENMVVNJVkEKCkNvbSBhIGFwcmVzZW50YcOnw6NvIGRlc3RhIGxpY2Vuw6dhLCB2b2PDqiAobyBhdXRvcihlcykgb3UgbyB0aXR1bGFyIGRvcyBkaXJlaXRvcyBkZSBhdXRvcikgY29uY2VkZSDDoCBVbml2ZXJzaWRhZGUgRmVkZXJhbCBkZSBTZXJnaXBlIG8gZGlyZWl0byBuw6NvLWV4Y2x1c2l2byBkZSByZXByb2R1emlyIHNldSB0cmFiYWxobyBubyBmb3JtYXRvIGVsZXRyw7RuaWNvLCBpbmNsdWluZG8gb3MgZm9ybWF0b3Mgw6F1ZGlvIG91IHbDrWRlby4KClZvY8OqIGNvbmNvcmRhIHF1ZSBhIFVuaXZlcnNpZGFkZSBGZWRlcmFsIGRlIFNlcmdpcGUgcG9kZSwgc2VtIGFsdGVyYXIgbyBjb250ZcO6ZG8sIHRyYW5zcG9yIHNldSB0cmFiYWxobyBwYXJhIHF1YWxxdWVyIG1laW8gb3UgZm9ybWF0byBwYXJhIGZpbnMgZGUgcHJlc2VydmHDp8Ojby4KClZvY8OqIHRhbWLDqW0gY29uY29yZGEgcXVlIGEgVW5pdmVyc2lkYWRlIEZlZGVyYWwgZGUgU2VyZ2lwZSBwb2RlIG1hbnRlciBtYWlzIGRlIHVtYSBjw7NwaWEgZGUgc2V1IHRyYWJhbGhvIHBhcmEgZmlucyBkZSBzZWd1cmFuw6dhLCBiYWNrLXVwIGUgcHJlc2VydmHDp8Ojby4KClZvY8OqIGRlY2xhcmEgcXVlIHNldSB0cmFiYWxobyDDqSBvcmlnaW5hbCBlIHF1ZSB2b2PDqiB0ZW0gbyBwb2RlciBkZSBjb25jZWRlciBvcyBkaXJlaXRvcyBjb250aWRvcyBuZXN0YSBsaWNlbsOnYS4gVm9jw6ogdGFtYsOpbSBkZWNsYXJhIHF1ZSBvIGRlcMOzc2l0bywgcXVlIHNlamEgZGUgc2V1IGNvbmhlY2ltZW50bywgbsOjbyBpbmZyaW5nZSBkaXJlaXRvcyBhdXRvcmFpcyBkZSBuaW5ndcOpbS4KCkNhc28gbyB0cmFiYWxobyBjb250ZW5oYSBtYXRlcmlhbCBxdWUgdm9jw6ogbsOjbyBwb3NzdWkgYSB0aXR1bGFyaWRhZGUgZG9zIGRpcmVpdG9zIGF1dG9yYWlzLCB2b2PDqiBkZWNsYXJhIHF1ZSBvYnRldmUgYSBwZXJtaXNzw6NvIGlycmVzdHJpdGEgZG8gZGV0ZW50b3IgZG9zIGRpcmVpdG9zIGF1dG9yYWlzIHBhcmEgY29uY2VkZXIgw6AgVW5pdmVyc2lkYWRlIEZlZGVyYWwgZGUgU2VyZ2lwZSBvcyBkaXJlaXRvcyBhcHJlc2VudGFkb3MgbmVzdGEgbGljZW7Dp2EsIGUgcXVlIGVzc2UgbWF0ZXJpYWwgZGUgcHJvcHJpZWRhZGUgZGUgdGVyY2Vpcm9zIGVzdMOhIGNsYXJhbWVudGUgaWRlbnRpZmljYWRvIGUgcmVjb25oZWNpZG8gbm8gdGV4dG8gb3Ugbm8gY29udGXDumRvLgoKQSBVbml2ZXJzaWRhZGUgRmVkZXJhbCBkZSBTZXJnaXBlIHNlIGNvbXByb21ldGUgYSBpZGVudGlmaWNhciBjbGFyYW1lbnRlIG8gc2V1IG5vbWUocykgb3UgbyhzKSBub21lKHMpIGRvKHMpIApkZXRlbnRvcihlcykgZG9zIGRpcmVpdG9zIGF1dG9yYWlzIGRvIHRyYWJhbGhvLCBlIG7Do28gZmFyw6EgcXVhbHF1ZXIgYWx0ZXJhw6fDo28sIGFsw6ltIGRhcXVlbGFzIGNvbmNlZGlkYXMgcG9yIGVzdGEgbGljZW7Dp2EuIAo=Repositório InstitucionalPUBhttps://ri.ufs.br/oai/requestrepositorio@academico.ufs.bropendoar:2022-09-05T12:53:29Repositório Institucional da UFS - Universidade Federal de Sergipe (UFS)false
dc.title.pt_BR.fl_str_mv AtalaIA : uso de Deep Learning para reconhecimento automático de placas de licença automotiva em dispositivos com recursos limitados
title AtalaIA : uso de Deep Learning para reconhecimento automático de placas de licença automotiva em dispositivos com recursos limitados
spellingShingle AtalaIA : uso de Deep Learning para reconhecimento automático de placas de licença automotiva em dispositivos com recursos limitados
Silva, José Vitor Santos
Engenharia da Computação
Ensino de engenharia da computação
ALPR
Deep learning
Edge computing
Object detection
ALPR
Deep learning
Edge computing
Object detection
CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO::METODOLOGIA E TECNICAS DA COMPUTACAO::ENGENHARIA DE SOFTWARE
title_short AtalaIA : uso de Deep Learning para reconhecimento automático de placas de licença automotiva em dispositivos com recursos limitados
title_full AtalaIA : uso de Deep Learning para reconhecimento automático de placas de licença automotiva em dispositivos com recursos limitados
title_fullStr AtalaIA : uso de Deep Learning para reconhecimento automático de placas de licença automotiva em dispositivos com recursos limitados
title_full_unstemmed AtalaIA : uso de Deep Learning para reconhecimento automático de placas de licença automotiva em dispositivos com recursos limitados
title_sort AtalaIA : uso de Deep Learning para reconhecimento automático de placas de licença automotiva em dispositivos com recursos limitados
author Silva, José Vitor Santos
author_facet Silva, José Vitor Santos
author_role author
dc.contributor.author.fl_str_mv Silva, José Vitor Santos
dc.contributor.advisor1.fl_str_mv Matos, Leonardo Nogueira
dc.contributor.advisor-co1.fl_str_mv Prado, Bruno Otávio Piedade
Santos, Flávio
contributor_str_mv Matos, Leonardo Nogueira
Prado, Bruno Otávio Piedade
Santos, Flávio
dc.subject.por.fl_str_mv Engenharia da Computação
Ensino de engenharia da computação
ALPR
Deep learning
Edge computing
Object detection
topic Engenharia da Computação
Ensino de engenharia da computação
ALPR
Deep learning
Edge computing
Object detection
ALPR
Deep learning
Edge computing
Object detection
CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO::METODOLOGIA E TECNICAS DA COMPUTACAO::ENGENHARIA DE SOFTWARE
dc.subject.eng.fl_str_mv ALPR
Deep learning
Edge computing
Object detection
dc.subject.cnpq.fl_str_mv CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO::METODOLOGIA E TECNICAS DA COMPUTACAO::ENGENHARIA DE SOFTWARE
description The use of deep learning based solutions is increasingly present in people’s daily lives. These solutions are the key component of applications from different domains. In computer vision, the use of convolutional neural networks has assumed a prominent role, achieving significant success in tasks such as image classification, semantic segmentation, and object detection. However, solutions based on deep models often require a significant amount of computational resources, for example GPUs, to operate at acceptable levels of latency. This makes them expensive and restricts their deployment in some real-world scenarios. In addition, the advent of 5G and the growing demand for intelligent devices and embedded systems, whose processing power is limited, encourage the creation of neural networks adapted to devices with limited memory, processor, or battery. The combination of deep learning models and resource-constrained systems paves the way for cheaper commercial products, democratizing the access to technology and expanding its impact on society. In this context, this work presents the development of an automatic license plate recognition system (ALPR) suitable for real-world scenarios. The ALPR plays an important role in many practical applications. It can be used by government agencies to find cars involved in crime, traffic law enforcement, border control, and road traffic monitoring, and it can also be used by private companies for commercial purposes such as automatic toll collection and access control to private zones. The ALPR system developed in this work was based on specific object detection models for each of the recognition steps: vehicle detection, license plate detection, and character detection. For the development of the system, we built an original database of 5029 images of 326 different vehicles, which we named UFS-ALPR. Using the built database, we performed experiments with five different architectures: YOLOv4 Tiny, YOLOv5 Nano, YOLOv5 Small, SSD and CenterNet. Subsequently, we analyzed the performance of the trained models and embedded the proposed system in two limited processing devices: Raspberry Pi 4 and NVIDIA Jetson Nano. The conventional version of the proposed ALPR system was able to correctly recognize 87.58% of the license plates in the UFS-ALPR database. The embedded version in the Raspberry Pi 4 and Jetson Nano correctly recognized 77.05% and 77.51%, with 0.53 FPS and 5.66 FPS, respectively.
publishDate 2022
dc.date.accessioned.fl_str_mv 2022-09-05T12:53:28Z
dc.date.available.fl_str_mv 2022-09-05T12:53:28Z
dc.date.issued.fl_str_mv 2022-08-08
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/bachelorThesis
format bachelorThesis
status_str publishedVersion
dc.identifier.citation.fl_str_mv Silva, José Vitor Santos. AtalaIA : uso de Deep Learning para reconhecimento automático de placas de licença automotiva em dispositivos com recursos limitados. São Cristóvão, 2022. Monografia (Graduação em Engenharia da Computação) – Departamento de Computação, Centro de Ciências Exatas e Tecnologia, Universidade Federal de Sergipe, São Cristóvão, SE, 2022
dc.identifier.uri.fl_str_mv http://ri.ufs.br/jspui/handle/riufs/16257
identifier_str_mv Silva, José Vitor Santos. AtalaIA : uso de Deep Learning para reconhecimento automático de placas de licença automotiva em dispositivos com recursos limitados. São Cristóvão, 2022. Monografia (Graduação em Engenharia da Computação) – Departamento de Computação, Centro de Ciências Exatas e Tecnologia, Universidade Federal de Sergipe, São Cristóvão, SE, 2022
url http://ri.ufs.br/jspui/handle/riufs/16257
dc.language.iso.fl_str_mv por
language por
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.publisher.initials.fl_str_mv Universidade Federal de Sergipe
dc.publisher.department.fl_str_mv DCOMP - Departamento de Computação – Engenharia de Computação – São Cristóvão - Presencial
dc.source.none.fl_str_mv reponame:Repositório Institucional da UFS
instname:Universidade Federal de Sergipe (UFS)
instacron:UFS
instname_str Universidade Federal de Sergipe (UFS)
instacron_str UFS
institution UFS
reponame_str Repositório Institucional da UFS
collection Repositório Institucional da UFS
bitstream.url.fl_str_mv https://ri.ufs.br/jspui/bitstream/riufs/16257/3/Jose_Vitor_Santos_Silva.pdf.txt
https://ri.ufs.br/jspui/bitstream/riufs/16257/4/Jose_Vitor_Santos_Silva.pdf.jpg
https://ri.ufs.br/jspui/bitstream/riufs/16257/1/license.txt
https://ri.ufs.br/jspui/bitstream/riufs/16257/2/Jose_Vitor_Santos_Silva.pdf
bitstream.checksum.fl_str_mv 84d169d69cbd96fe7b57d5f2b521d5b7
5b727d3bf4b26dcb6425109e86d57522
098cbbf65c2c15e1fb2e49c5d306a44c
ffe3d188c6bc2d4786c3977d39420426
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
MD5
MD5
repository.name.fl_str_mv Repositório Institucional da UFS - Universidade Federal de Sergipe (UFS)
repository.mail.fl_str_mv repositorio@academico.ufs.br
_version_ 1802110805824503808