People counting and tracking with FMCW radar for augmented video surveillance systems

Detalhes bibliográficos
Autor(a) principal: Santos, Bruno Miguel Silva
Data de Publicação: 2021
Tipo de documento: Dissertação
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: http://hdl.handle.net/10773/33916
Resumo: The present dissertation describes how a frequency-modulated continuous-wave (FMCW) Radar can be employed to count and locate persons inside a room. Apart from counting, it is also performed the spatial person tracking through processing of the Radar point cloud. A theoretical study is done, detailing how the Radar can compute fundamental parameters like distance, velocity, and angle of arrival of an object present in the field of view (FoV) and the signal processing computations done with the selected Radar evaluation kit. The application developed in the scope of this dissertation contemplates topics such as, noise mitigation, clustering algorithms and association with detected persons and/or objects. It also uses digital signal processing (DSP) algorithms capable of movement prediction in noisy environments with data extracted from the Radar and approaches the projection of Cartesian coordinates into a video surveillance camera located at a different place. This project was intended for security and safety systems, wherein the Radar would be integrated in a video surveillance camera, complementing people detection capabilities achieved via image processing algorithms, which fail in certain atmospheric or lightning conditions while the Radar is less affected. The graphical user interface (GUI) application developed in this dissertation was tested in scenarios where people would walk in regular patterns or are seated in their workplace and constructed in a way that allows it to work in real-time without major losses on the video acquisition performance. Practical results of diverse person detection and tracking use cases are demonstrated with an interesting performance.
id RCAP_66eb3aee8a8a91016668be7152060af7
oai_identifier_str oai:ria.ua.pt:10773/33916
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling People counting and tracking with FMCW radar for augmented video surveillance systemsRadarPeople detectionSensor fusionTrackingThe present dissertation describes how a frequency-modulated continuous-wave (FMCW) Radar can be employed to count and locate persons inside a room. Apart from counting, it is also performed the spatial person tracking through processing of the Radar point cloud. A theoretical study is done, detailing how the Radar can compute fundamental parameters like distance, velocity, and angle of arrival of an object present in the field of view (FoV) and the signal processing computations done with the selected Radar evaluation kit. The application developed in the scope of this dissertation contemplates topics such as, noise mitigation, clustering algorithms and association with detected persons and/or objects. It also uses digital signal processing (DSP) algorithms capable of movement prediction in noisy environments with data extracted from the Radar and approaches the projection of Cartesian coordinates into a video surveillance camera located at a different place. This project was intended for security and safety systems, wherein the Radar would be integrated in a video surveillance camera, complementing people detection capabilities achieved via image processing algorithms, which fail in certain atmospheric or lightning conditions while the Radar is less affected. The graphical user interface (GUI) application developed in this dissertation was tested in scenarios where people would walk in regular patterns or are seated in their workplace and constructed in a way that allows it to work in real-time without major losses on the video acquisition performance. Practical results of diverse person detection and tracking use cases are demonstrated with an interesting performance.Esta dissertação descreve como um Radar de onda contínua modulada em frequência (FMCW) pode ser utilizado na contagem e localização de pessoas dentro de uma sala. Para além da contagem de pessoas, também é realizado o rastreamento espacial da pessoa através de métodos de processamento da nuvem de pontos provenientes do Radar. É feito um estudo teórico, detalhando como o Radar é capaz de calcular parâmetros fundamentais como a distância, velocidade e ângulo de chegada de um objeto presente no campo de visão (FoV), assim como os cálculos de processamento de sinal efetuados com o kit de avaliação do Radar selecionado. A aplicação desenvolvida no âmbito da dissertação contempla tópicos como, técnicas de redução de ruído, algoritmos de segmentação de dados e associação destes a pessoas e/ou objetos, utilizando algoritmos de processamento digital de sinal (DSP) capazes de predição de movimento em ambientes ruidosos com dados extraídos do Radar, abordando ainda a projeção de coordenadas cartesianas numa câmara de videovigilância localizada num ponto distinto da sala. Este projeto foi pensado para sistemas de segurança e proteção, onde o Radar seria integrado numa câmara de videovigilância, complementado as capacidades de deteção de pessoas obtidas por meio de algoritmos de processamento de imagem, os quais tendencialmente falham em determinadas condições atmosféricas ou de iluminação enquanto o Radar é menos afetado. A aplicação de interface gráfica de utilizador (GUI) desenvolvida nesta dissertação, foi testada em cenários onde as pessoas percorrem movimentos normais como caminhar ou estão sentadas no seu local de trabalho e construído de forma a ser capaz de funcionar em tempo real sem grandes perdas na aquisição de vídeo. São apresentados alguns resultados práticos focando diversos casos de uso de deteção e rastreamento de pessoas, atingindo um desempenho interessante.2023-12-22T00:00:00Z2021-12-16T00:00:00Z2021-12-16info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisapplication/pdfhttp://hdl.handle.net/10773/33916engSantos, Bruno Miguel Silvainfo:eu-repo/semantics/embargoedAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2024-02-22T12:05:15Zoai:ria.ua.pt:10773/33916Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-20T03:05:16.061899Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv People counting and tracking with FMCW radar for augmented video surveillance systems
title People counting and tracking with FMCW radar for augmented video surveillance systems
spellingShingle People counting and tracking with FMCW radar for augmented video surveillance systems
Santos, Bruno Miguel Silva
Radar
People detection
Sensor fusion
Tracking
title_short People counting and tracking with FMCW radar for augmented video surveillance systems
title_full People counting and tracking with FMCW radar for augmented video surveillance systems
title_fullStr People counting and tracking with FMCW radar for augmented video surveillance systems
title_full_unstemmed People counting and tracking with FMCW radar for augmented video surveillance systems
title_sort People counting and tracking with FMCW radar for augmented video surveillance systems
author Santos, Bruno Miguel Silva
author_facet Santos, Bruno Miguel Silva
author_role author
dc.contributor.author.fl_str_mv Santos, Bruno Miguel Silva
dc.subject.por.fl_str_mv Radar
People detection
Sensor fusion
Tracking
topic Radar
People detection
Sensor fusion
Tracking
description The present dissertation describes how a frequency-modulated continuous-wave (FMCW) Radar can be employed to count and locate persons inside a room. Apart from counting, it is also performed the spatial person tracking through processing of the Radar point cloud. A theoretical study is done, detailing how the Radar can compute fundamental parameters like distance, velocity, and angle of arrival of an object present in the field of view (FoV) and the signal processing computations done with the selected Radar evaluation kit. The application developed in the scope of this dissertation contemplates topics such as, noise mitigation, clustering algorithms and association with detected persons and/or objects. It also uses digital signal processing (DSP) algorithms capable of movement prediction in noisy environments with data extracted from the Radar and approaches the projection of Cartesian coordinates into a video surveillance camera located at a different place. This project was intended for security and safety systems, wherein the Radar would be integrated in a video surveillance camera, complementing people detection capabilities achieved via image processing algorithms, which fail in certain atmospheric or lightning conditions while the Radar is less affected. The graphical user interface (GUI) application developed in this dissertation was tested in scenarios where people would walk in regular patterns or are seated in their workplace and constructed in a way that allows it to work in real-time without major losses on the video acquisition performance. Practical results of diverse person detection and tracking use cases are demonstrated with an interesting performance.
publishDate 2021
dc.date.none.fl_str_mv 2021-12-16T00:00:00Z
2021-12-16
2023-12-22T00:00:00Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10773/33916
url http://hdl.handle.net/10773/33916
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv info:eu-repo/semantics/embargoedAccess
eu_rights_str_mv embargoedAccess
dc.format.none.fl_str_mv application/pdf
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799137707784404992