Embedded real-time speed limit sign recognition using image processing and machine learning techniques

Detalhes bibliográficos
Autor(a) principal: Gomes, Samuel L.
Data de Publicação: 2017
Outros Autores: Reboucas, Elizangela de S., Neto, Edson Cavalcanti, Papa, Joao P. [UNESP], Albuquerque, Victor H. C. de, Reboucas Filho, Pedro P., Tavares, Joao Manuel R. S.
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Institucional da UNESP
Texto Completo: http://dx.doi.org/10.1007/s00521-016-2388-3
http://hdl.handle.net/11449/165920
Resumo: The number of traffic accidents in Brazil has reached alarming levels and is currently one of the leading causes of death in the country. With the number of vehicles on the roads increasing rapidly, these problems will tend to worsen. Consequently, huge investments in resources to increase road safety will be required. The vertical R-19 system for optical character recognition of regulatory traffic signs (maximum speed limits) according to Brazilian Standards developed in this work uses a camera positioned at the front of the vehicle, facing forward. This is so that images of traffic signs can be captured, enabling the use of image processing and analysis techniques for sign detection. This paper proposes the detection and recognition of speed limit signs based on a cascade of boosted classifiers working with haar-like features. The recognition of the sign detected is achieved based on the optimum-path forest classifier (OPF), support vector machines (SVM), multilayer perceptron, k-nearest neighbor (kNN), extreme learning machine, least mean squares, and least squares machine learning techniques. The SVM, OPF and kNN classifiers had average accuracies higher than 99.5 %; the OPF classifier with a linear kernel took an average time of 87 mu s to recognize a sign, while kNN took 11,721 ls and SVM 12,595 ls. This sign detection approach found and recognized successfully 11,320 road signs from a set of 12,520 images, leading to an overall accuracy of 90.41 %. Analyzing the system globally recognition accuracy was 89.19 %, as 11,167 road signs from a database with 12,520 signs were correctly recognized. The processing speed of the embedded system varied between 20 and 30 frames per second. Therefore, based on these results, the proposed system can be considered a promising tool with high commercial potential.
id UNSP_687aa9fe3b62a723527a552e51729565
oai_identifier_str oai:repositorio.unesp.br:11449/165920
network_acronym_str UNSP
network_name_str Repositório Institucional da UNESP
repository_id_str 2946
spelling Embedded real-time speed limit sign recognition using image processing and machine learning techniquesCascade haar-like featuresPattern recognitionComputer visionAutomotive applicationsThe number of traffic accidents in Brazil has reached alarming levels and is currently one of the leading causes of death in the country. With the number of vehicles on the roads increasing rapidly, these problems will tend to worsen. Consequently, huge investments in resources to increase road safety will be required. The vertical R-19 system for optical character recognition of regulatory traffic signs (maximum speed limits) according to Brazilian Standards developed in this work uses a camera positioned at the front of the vehicle, facing forward. This is so that images of traffic signs can be captured, enabling the use of image processing and analysis techniques for sign detection. This paper proposes the detection and recognition of speed limit signs based on a cascade of boosted classifiers working with haar-like features. The recognition of the sign detected is achieved based on the optimum-path forest classifier (OPF), support vector machines (SVM), multilayer perceptron, k-nearest neighbor (kNN), extreme learning machine, least mean squares, and least squares machine learning techniques. The SVM, OPF and kNN classifiers had average accuracies higher than 99.5 %; the OPF classifier with a linear kernel took an average time of 87 mu s to recognize a sign, while kNN took 11,721 ls and SVM 12,595 ls. This sign detection approach found and recognized successfully 11,320 road signs from a set of 12,520 images, leading to an overall accuracy of 90.41 %. Analyzing the system globally recognition accuracy was 89.19 %, as 11,167 road signs from a database with 12,520 signs were correctly recognized. The processing speed of the embedded system varied between 20 and 30 frames per second. Therefore, based on these results, the proposed system can be considered a promising tool with high commercial potential.Instituto Federal do Ceara (IFCE)Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)Programa Operacional Regional do Norte (NORTE2020) through Fundo Europeu de Desenvolvimento Regional (FEDER)Inst Fed Fed Educ Ciencia & Tecnol Ceara IFCE, Lab Proc Digital Imagens & Simulacao Computac, Juazeiro Do Norte, Ceara, BrazilUniv Estadual Paulista, Dept Ciencia Comp, Bauru, SP, BrazilUniv Fortaleza, Programa Posgrad Informat Aplicada, Lab Bioinformat, Fortaleza, CE, BrazilUniv Porto, Fac Engn, Inst Ciencia & Inovacao Engn Mecan & Engn Ind, Dept Engn Mecan, Oporto, PortugalUniv Estadual Paulista, Dept Ciencia Comp, Bauru, SP, BrazilInstituto Federal do Ceara (IFCE): PROINFRA/2013Instituto Federal do Ceara (IFCE): PROAPP/2014Instituto Federal do Ceara (IFCE): PROINFRA/2015CNPq: 470501/2013-8CNPq: 301928/2014-2: NORTE-01-0145-FEDER-000022SpringerInst Fed Fed Educ Ciencia & Tecnol Ceara IFCEUniversidade Estadual Paulista (Unesp)Univ FortalezaUniv PortoGomes, Samuel L.Reboucas, Elizangela de S.Neto, Edson CavalcantiPapa, Joao P. [UNESP]Albuquerque, Victor H. C. deReboucas Filho, Pedro P.Tavares, Joao Manuel R. S.2018-11-29T04:54:17Z2018-11-29T04:54:17Z2017-12-01info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleS573-S584application/pdfhttp://dx.doi.org/10.1007/s00521-016-2388-3Neural Computing & Applications. New York: Springer, v. 28, p. S573-S584, 2017.0941-0643http://hdl.handle.net/11449/16592010.1007/s00521-016-2388-3WOS:000417319700047WOS000417319700047.pdfWeb of Sciencereponame:Repositório Institucional da UNESPinstname:Universidade Estadual Paulista (UNESP)instacron:UNESPengNeural Computing & Applications0,700info:eu-repo/semantics/openAccess2024-04-23T16:11:00Zoai:repositorio.unesp.br:11449/165920Repositório InstitucionalPUBhttp://repositorio.unesp.br/oai/requestopendoar:29462024-08-05T23:23:31.616358Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)false
dc.title.none.fl_str_mv Embedded real-time speed limit sign recognition using image processing and machine learning techniques
title Embedded real-time speed limit sign recognition using image processing and machine learning techniques
spellingShingle Embedded real-time speed limit sign recognition using image processing and machine learning techniques
Gomes, Samuel L.
Cascade haar-like features
Pattern recognition
Computer vision
Automotive applications
title_short Embedded real-time speed limit sign recognition using image processing and machine learning techniques
title_full Embedded real-time speed limit sign recognition using image processing and machine learning techniques
title_fullStr Embedded real-time speed limit sign recognition using image processing and machine learning techniques
title_full_unstemmed Embedded real-time speed limit sign recognition using image processing and machine learning techniques
title_sort Embedded real-time speed limit sign recognition using image processing and machine learning techniques
author Gomes, Samuel L.
author_facet Gomes, Samuel L.
Reboucas, Elizangela de S.
Neto, Edson Cavalcanti
Papa, Joao P. [UNESP]
Albuquerque, Victor H. C. de
Reboucas Filho, Pedro P.
Tavares, Joao Manuel R. S.
author_role author
author2 Reboucas, Elizangela de S.
Neto, Edson Cavalcanti
Papa, Joao P. [UNESP]
Albuquerque, Victor H. C. de
Reboucas Filho, Pedro P.
Tavares, Joao Manuel R. S.
author2_role author
author
author
author
author
author
dc.contributor.none.fl_str_mv Inst Fed Fed Educ Ciencia & Tecnol Ceara IFCE
Universidade Estadual Paulista (Unesp)
Univ Fortaleza
Univ Porto
dc.contributor.author.fl_str_mv Gomes, Samuel L.
Reboucas, Elizangela de S.
Neto, Edson Cavalcanti
Papa, Joao P. [UNESP]
Albuquerque, Victor H. C. de
Reboucas Filho, Pedro P.
Tavares, Joao Manuel R. S.
dc.subject.por.fl_str_mv Cascade haar-like features
Pattern recognition
Computer vision
Automotive applications
topic Cascade haar-like features
Pattern recognition
Computer vision
Automotive applications
description The number of traffic accidents in Brazil has reached alarming levels and is currently one of the leading causes of death in the country. With the number of vehicles on the roads increasing rapidly, these problems will tend to worsen. Consequently, huge investments in resources to increase road safety will be required. The vertical R-19 system for optical character recognition of regulatory traffic signs (maximum speed limits) according to Brazilian Standards developed in this work uses a camera positioned at the front of the vehicle, facing forward. This is so that images of traffic signs can be captured, enabling the use of image processing and analysis techniques for sign detection. This paper proposes the detection and recognition of speed limit signs based on a cascade of boosted classifiers working with haar-like features. The recognition of the sign detected is achieved based on the optimum-path forest classifier (OPF), support vector machines (SVM), multilayer perceptron, k-nearest neighbor (kNN), extreme learning machine, least mean squares, and least squares machine learning techniques. The SVM, OPF and kNN classifiers had average accuracies higher than 99.5 %; the OPF classifier with a linear kernel took an average time of 87 mu s to recognize a sign, while kNN took 11,721 ls and SVM 12,595 ls. This sign detection approach found and recognized successfully 11,320 road signs from a set of 12,520 images, leading to an overall accuracy of 90.41 %. Analyzing the system globally recognition accuracy was 89.19 %, as 11,167 road signs from a database with 12,520 signs were correctly recognized. The processing speed of the embedded system varied between 20 and 30 frames per second. Therefore, based on these results, the proposed system can be considered a promising tool with high commercial potential.
publishDate 2017
dc.date.none.fl_str_mv 2017-12-01
2018-11-29T04:54:17Z
2018-11-29T04:54:17Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://dx.doi.org/10.1007/s00521-016-2388-3
Neural Computing & Applications. New York: Springer, v. 28, p. S573-S584, 2017.
0941-0643
http://hdl.handle.net/11449/165920
10.1007/s00521-016-2388-3
WOS:000417319700047
WOS000417319700047.pdf
url http://dx.doi.org/10.1007/s00521-016-2388-3
http://hdl.handle.net/11449/165920
identifier_str_mv Neural Computing & Applications. New York: Springer, v. 28, p. S573-S584, 2017.
0941-0643
10.1007/s00521-016-2388-3
WOS:000417319700047
WOS000417319700047.pdf
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv Neural Computing & Applications
0,700
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv S573-S584
application/pdf
dc.publisher.none.fl_str_mv Springer
publisher.none.fl_str_mv Springer
dc.source.none.fl_str_mv Web of Science
reponame:Repositório Institucional da UNESP
instname:Universidade Estadual Paulista (UNESP)
instacron:UNESP
instname_str Universidade Estadual Paulista (UNESP)
instacron_str UNESP
institution UNESP
reponame_str Repositório Institucional da UNESP
collection Repositório Institucional da UNESP
repository.name.fl_str_mv Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)
repository.mail.fl_str_mv
_version_ 1808129515255234560