AI based monitoring of different risk levels in COVID-19 context

Detalhes bibliográficos
Autor(a) principal: Melo, César
Data de Publicação: 2022
Outros Autores: Dixe, Sandra Manuela Gonçalves, Fonseca, Jaime C., Moreira, António H. J., Borges, João
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: https://hdl.handle.net/1822/75893
Resumo: COVID-19 was responsible for devastating social, economic, and political effects all over the world. Although the health authorities imposed restrictions provided relief and assisted with trying to return society to normal life, it is imperative to monitor people’s behavior and risk factors to keep virus transmission levels as low as possible. This article focuses on the application of deep learning algorithms to detect the presence of masks on people in public spaces (using RGB cameras), as well as the detection of the caruncle in the human eye area to make an accurate measurement of body temperature (using thermal cameras). For this task, synthetic data generation techniques were used to create hybrid datasets from public ones to train state-of-the-art algorithms, such as YOLOv5 object detector and a keypoint detector based on Resnet-50. For RGB mask detection, YOLOv5 achieved an average precision of 82.4%. For thermal masks, glasses, and caruncle detection, YOLOv5 and keypoint detector achieved an average precision of 96.65% and 78.7%, respectively. Moreover, RGB and thermal datasets were made publicly available.
id RCAP_9d6cb5f824e361876d9f30199eb464ae
oai_identifier_str oai:repositorium.sdum.uminho.pt:1822/75893
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling AI based monitoring of different risk levels in COVID-19 contextCOVID-19Deep learningSupervised learningObject detectionKeypoint detectionScience & TechnologyCOVID-19 was responsible for devastating social, economic, and political effects all over the world. Although the health authorities imposed restrictions provided relief and assisted with trying to return society to normal life, it is imperative to monitor people’s behavior and risk factors to keep virus transmission levels as low as possible. This article focuses on the application of deep learning algorithms to detect the presence of masks on people in public spaces (using RGB cameras), as well as the detection of the caruncle in the human eye area to make an accurate measurement of body temperature (using thermal cameras). For this task, synthetic data generation techniques were used to create hybrid datasets from public ones to train state-of-the-art algorithms, such as YOLOv5 object detector and a keypoint detector based on Resnet-50. For RGB mask detection, YOLOv5 achieved an average precision of 82.4%. For thermal masks, glasses, and caruncle detection, YOLOv5 and keypoint detector achieved an average precision of 96.65% and 78.7%, respectively. Moreover, RGB and thermal datasets were made publicly available.R&D Project funded by P2020 & mdash;COVID19, with number 70289.Multidisciplinary Digital Publishing Institute (MDPI)Universidade do MinhoMelo, CésarDixe, Sandra Manuela GonçalvesFonseca, Jaime C.Moreira, António H. J.Borges, João20222022-01-01T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttps://hdl.handle.net/1822/75893engMelo, C.; Dixe, S.; Fonseca, J.C.; Moreira, A.H.J.; Borges, J. AI Based Monitoring of Different Risk Levels in COVID-19 Context. Sensors 2022, 22, 298. https://doi.org/10.3390/s220102981424-822010.3390/s2201029835009846298https://www.mdpi.com/1424-8220/22/1/298info:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2023-07-21T12:46:08Zoai:repositorium.sdum.uminho.pt:1822/75893Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-19T19:44:07.496262Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv AI based monitoring of different risk levels in COVID-19 context
title AI based monitoring of different risk levels in COVID-19 context
spellingShingle AI based monitoring of different risk levels in COVID-19 context
Melo, César
COVID-19
Deep learning
Supervised learning
Object detection
Keypoint detection
Science & Technology
title_short AI based monitoring of different risk levels in COVID-19 context
title_full AI based monitoring of different risk levels in COVID-19 context
title_fullStr AI based monitoring of different risk levels in COVID-19 context
title_full_unstemmed AI based monitoring of different risk levels in COVID-19 context
title_sort AI based monitoring of different risk levels in COVID-19 context
author Melo, César
author_facet Melo, César
Dixe, Sandra Manuela Gonçalves
Fonseca, Jaime C.
Moreira, António H. J.
Borges, João
author_role author
author2 Dixe, Sandra Manuela Gonçalves
Fonseca, Jaime C.
Moreira, António H. J.
Borges, João
author2_role author
author
author
author
dc.contributor.none.fl_str_mv Universidade do Minho
dc.contributor.author.fl_str_mv Melo, César
Dixe, Sandra Manuela Gonçalves
Fonseca, Jaime C.
Moreira, António H. J.
Borges, João
dc.subject.por.fl_str_mv COVID-19
Deep learning
Supervised learning
Object detection
Keypoint detection
Science & Technology
topic COVID-19
Deep learning
Supervised learning
Object detection
Keypoint detection
Science & Technology
description COVID-19 was responsible for devastating social, economic, and political effects all over the world. Although the health authorities imposed restrictions provided relief and assisted with trying to return society to normal life, it is imperative to monitor people’s behavior and risk factors to keep virus transmission levels as low as possible. This article focuses on the application of deep learning algorithms to detect the presence of masks on people in public spaces (using RGB cameras), as well as the detection of the caruncle in the human eye area to make an accurate measurement of body temperature (using thermal cameras). For this task, synthetic data generation techniques were used to create hybrid datasets from public ones to train state-of-the-art algorithms, such as YOLOv5 object detector and a keypoint detector based on Resnet-50. For RGB mask detection, YOLOv5 achieved an average precision of 82.4%. For thermal masks, glasses, and caruncle detection, YOLOv5 and keypoint detector achieved an average precision of 96.65% and 78.7%, respectively. Moreover, RGB and thermal datasets were made publicly available.
publishDate 2022
dc.date.none.fl_str_mv 2022
2022-01-01T00:00:00Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://hdl.handle.net/1822/75893
url https://hdl.handle.net/1822/75893
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv Melo, C.; Dixe, S.; Fonseca, J.C.; Moreira, A.H.J.; Borges, J. AI Based Monitoring of Different Risk Levels in COVID-19 Context. Sensors 2022, 22, 298. https://doi.org/10.3390/s22010298
1424-8220
10.3390/s22010298
35009846
298
https://www.mdpi.com/1424-8220/22/1/298
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Multidisciplinary Digital Publishing Institute (MDPI)
publisher.none.fl_str_mv Multidisciplinary Digital Publishing Institute (MDPI)
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799133000426848256