Recommendations for evaluating the performance of background subtraction algorithms for surveillance systems

Detalhes bibliográficos
Autor(a) principal: Sanches, Silvio Ricardo Rodrigues
Data de Publicação: 2020
Outros Autores: Sementille, Antonio Carlos [UNESP], Aguilar, Ivan Abdo, Freire, Valdinei
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Institucional da UNESP
Texto Completo: http://dx.doi.org/10.1007/s11042-020-09838-x
http://hdl.handle.net/11449/210466
Resumo: Background subtraction is a prerequisite for a wide range of applications, including video surveillance systems. A significant number of algorithms are often developed and published in different publication mediums in the area, such as workshops, symposiums, conferences, and journals. An important task in presenting a new background subtraction algorithms is to clearly show that its performance outperforms the performance of the state-of-the-art algorithms. In this paper, we present recommendations on how to evaluate the performance of background subtraction algorithms for surveillance systems. We identified, through a systematic mapping, the key steps and components of this evaluation process - procedures, methods, and tools - most used by the authors in each of these steps. Considering this statistical analysis, we perform a theoretical analysis of the most used key components to identify their pros and cons. Then, we define a set of recommendations that aim to standardize and clarify the performance evaluation process of a new background subtraction algorithm.
id UNSP_47b8d7d0333e8bf6c345810a157856d5
oai_identifier_str oai:repositorio.unesp.br:11449/210466
network_acronym_str UNSP
network_name_str Repositório Institucional da UNESP
repository_id_str 2946
spelling Recommendations for evaluating the performance of background subtraction algorithms for surveillance systemsBackground subtractionPerformance assessmentRecommendationsSurveillance systemsBackground subtraction is a prerequisite for a wide range of applications, including video surveillance systems. A significant number of algorithms are often developed and published in different publication mediums in the area, such as workshops, symposiums, conferences, and journals. An important task in presenting a new background subtraction algorithms is to clearly show that its performance outperforms the performance of the state-of-the-art algorithms. In this paper, we present recommendations on how to evaluate the performance of background subtraction algorithms for surveillance systems. We identified, through a systematic mapping, the key steps and components of this evaluation process - procedures, methods, and tools - most used by the authors in each of these steps. Considering this statistical analysis, we perform a theoretical analysis of the most used key components to identify their pros and cons. Then, we define a set of recommendations that aim to standardize and clarify the performance evaluation process of a new background subtraction algorithm.Univ Tecnol Fed Parana, Cornelio Procopio, BrazilUniv Estadual Paulista, Bauru, SP, BrazilSimon Fraser Univ, Burnaby, BC, CanadaUniv Sao Paulo, Elect Engn, Sao Paulo, BrazilUniv Estadual Paulista, Bauru, SP, BrazilSpringerUniv Tecnol Fed ParanaUniversidade Estadual Paulista (Unesp)Simon Fraser UnivUniversidade de São Paulo (USP)Sanches, Silvio Ricardo RodriguesSementille, Antonio Carlos [UNESP]Aguilar, Ivan AbdoFreire, Valdinei2021-06-25T16:33:28Z2021-06-25T16:33:28Z2020-09-29info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/article4421-4454http://dx.doi.org/10.1007/s11042-020-09838-xMultimedia Tools And Applications. Dordrecht: Springer, v. 80, n. 3, p. 4421-4454, 2021.1380-7501http://hdl.handle.net/11449/21046610.1007/s11042-020-09838-xWOS:000573766700004Web of Sciencereponame:Repositório Institucional da UNESPinstname:Universidade Estadual Paulista (UNESP)instacron:UNESPengMultimedia Tools And Applicationsinfo:eu-repo/semantics/openAccess2024-04-23T16:11:00Zoai:repositorio.unesp.br:11449/210466Repositório InstitucionalPUBhttp://repositorio.unesp.br/oai/requestopendoar:29462024-08-05T22:58:58.881587Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)false
dc.title.none.fl_str_mv Recommendations for evaluating the performance of background subtraction algorithms for surveillance systems
title Recommendations for evaluating the performance of background subtraction algorithms for surveillance systems
spellingShingle Recommendations for evaluating the performance of background subtraction algorithms for surveillance systems
Sanches, Silvio Ricardo Rodrigues
Background subtraction
Performance assessment
Recommendations
Surveillance systems
title_short Recommendations for evaluating the performance of background subtraction algorithms for surveillance systems
title_full Recommendations for evaluating the performance of background subtraction algorithms for surveillance systems
title_fullStr Recommendations for evaluating the performance of background subtraction algorithms for surveillance systems
title_full_unstemmed Recommendations for evaluating the performance of background subtraction algorithms for surveillance systems
title_sort Recommendations for evaluating the performance of background subtraction algorithms for surveillance systems
author Sanches, Silvio Ricardo Rodrigues
author_facet Sanches, Silvio Ricardo Rodrigues
Sementille, Antonio Carlos [UNESP]
Aguilar, Ivan Abdo
Freire, Valdinei
author_role author
author2 Sementille, Antonio Carlos [UNESP]
Aguilar, Ivan Abdo
Freire, Valdinei
author2_role author
author
author
dc.contributor.none.fl_str_mv Univ Tecnol Fed Parana
Universidade Estadual Paulista (Unesp)
Simon Fraser Univ
Universidade de São Paulo (USP)
dc.contributor.author.fl_str_mv Sanches, Silvio Ricardo Rodrigues
Sementille, Antonio Carlos [UNESP]
Aguilar, Ivan Abdo
Freire, Valdinei
dc.subject.por.fl_str_mv Background subtraction
Performance assessment
Recommendations
Surveillance systems
topic Background subtraction
Performance assessment
Recommendations
Surveillance systems
description Background subtraction is a prerequisite for a wide range of applications, including video surveillance systems. A significant number of algorithms are often developed and published in different publication mediums in the area, such as workshops, symposiums, conferences, and journals. An important task in presenting a new background subtraction algorithms is to clearly show that its performance outperforms the performance of the state-of-the-art algorithms. In this paper, we present recommendations on how to evaluate the performance of background subtraction algorithms for surveillance systems. We identified, through a systematic mapping, the key steps and components of this evaluation process - procedures, methods, and tools - most used by the authors in each of these steps. Considering this statistical analysis, we perform a theoretical analysis of the most used key components to identify their pros and cons. Then, we define a set of recommendations that aim to standardize and clarify the performance evaluation process of a new background subtraction algorithm.
publishDate 2020
dc.date.none.fl_str_mv 2020-09-29
2021-06-25T16:33:28Z
2021-06-25T16:33:28Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://dx.doi.org/10.1007/s11042-020-09838-x
Multimedia Tools And Applications. Dordrecht: Springer, v. 80, n. 3, p. 4421-4454, 2021.
1380-7501
http://hdl.handle.net/11449/210466
10.1007/s11042-020-09838-x
WOS:000573766700004
url http://dx.doi.org/10.1007/s11042-020-09838-x
http://hdl.handle.net/11449/210466
identifier_str_mv Multimedia Tools And Applications. Dordrecht: Springer, v. 80, n. 3, p. 4421-4454, 2021.
1380-7501
10.1007/s11042-020-09838-x
WOS:000573766700004
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv Multimedia Tools And Applications
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv 4421-4454
dc.publisher.none.fl_str_mv Springer
publisher.none.fl_str_mv Springer
dc.source.none.fl_str_mv Web of Science
reponame:Repositório Institucional da UNESP
instname:Universidade Estadual Paulista (UNESP)
instacron:UNESP
instname_str Universidade Estadual Paulista (UNESP)
instacron_str UNESP
institution UNESP
reponame_str Repositório Institucional da UNESP
collection Repositório Institucional da UNESP
repository.name.fl_str_mv Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)
repository.mail.fl_str_mv
_version_ 1808129478972407808