AI based monitoring of different risk levels in COVID-19 context
Autor(a) principal: | |
---|---|
Data de Publicação: | 2022 |
Outros Autores: | , , , |
Tipo de documento: | Artigo |
Idioma: | eng |
Título da fonte: | Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
Texto Completo: | https://hdl.handle.net/1822/75893 |
Resumo: | COVID-19 was responsible for devastating social, economic, and political effects all over the world. Although the health authorities imposed restrictions provided relief and assisted with trying to return society to normal life, it is imperative to monitor people’s behavior and risk factors to keep virus transmission levels as low as possible. This article focuses on the application of deep learning algorithms to detect the presence of masks on people in public spaces (using RGB cameras), as well as the detection of the caruncle in the human eye area to make an accurate measurement of body temperature (using thermal cameras). For this task, synthetic data generation techniques were used to create hybrid datasets from public ones to train state-of-the-art algorithms, such as YOLOv5 object detector and a keypoint detector based on Resnet-50. For RGB mask detection, YOLOv5 achieved an average precision of 82.4%. For thermal masks, glasses, and caruncle detection, YOLOv5 and keypoint detector achieved an average precision of 96.65% and 78.7%, respectively. Moreover, RGB and thermal datasets were made publicly available. |
id |
RCAP_9d6cb5f824e361876d9f30199eb464ae |
---|---|
oai_identifier_str |
oai:repositorium.sdum.uminho.pt:1822/75893 |
network_acronym_str |
RCAP |
network_name_str |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
repository_id_str |
7160 |
spelling |
AI based monitoring of different risk levels in COVID-19 contextCOVID-19Deep learningSupervised learningObject detectionKeypoint detectionScience & TechnologyCOVID-19 was responsible for devastating social, economic, and political effects all over the world. Although the health authorities imposed restrictions provided relief and assisted with trying to return society to normal life, it is imperative to monitor people’s behavior and risk factors to keep virus transmission levels as low as possible. This article focuses on the application of deep learning algorithms to detect the presence of masks on people in public spaces (using RGB cameras), as well as the detection of the caruncle in the human eye area to make an accurate measurement of body temperature (using thermal cameras). For this task, synthetic data generation techniques were used to create hybrid datasets from public ones to train state-of-the-art algorithms, such as YOLOv5 object detector and a keypoint detector based on Resnet-50. For RGB mask detection, YOLOv5 achieved an average precision of 82.4%. For thermal masks, glasses, and caruncle detection, YOLOv5 and keypoint detector achieved an average precision of 96.65% and 78.7%, respectively. Moreover, RGB and thermal datasets were made publicly available.R&D Project funded by P2020 & mdash;COVID19, with number 70289.Multidisciplinary Digital Publishing Institute (MDPI)Universidade do MinhoMelo, CésarDixe, Sandra Manuela GonçalvesFonseca, Jaime C.Moreira, António H. J.Borges, João20222022-01-01T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttps://hdl.handle.net/1822/75893engMelo, C.; Dixe, S.; Fonseca, J.C.; Moreira, A.H.J.; Borges, J. AI Based Monitoring of Different Risk Levels in COVID-19 Context. Sensors 2022, 22, 298. https://doi.org/10.3390/s220102981424-822010.3390/s2201029835009846298https://www.mdpi.com/1424-8220/22/1/298info:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2023-07-21T12:46:08Zoai:repositorium.sdum.uminho.pt:1822/75893Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-19T19:44:07.496262Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse |
dc.title.none.fl_str_mv |
AI based monitoring of different risk levels in COVID-19 context |
title |
AI based monitoring of different risk levels in COVID-19 context |
spellingShingle |
AI based monitoring of different risk levels in COVID-19 context Melo, César COVID-19 Deep learning Supervised learning Object detection Keypoint detection Science & Technology |
title_short |
AI based monitoring of different risk levels in COVID-19 context |
title_full |
AI based monitoring of different risk levels in COVID-19 context |
title_fullStr |
AI based monitoring of different risk levels in COVID-19 context |
title_full_unstemmed |
AI based monitoring of different risk levels in COVID-19 context |
title_sort |
AI based monitoring of different risk levels in COVID-19 context |
author |
Melo, César |
author_facet |
Melo, César Dixe, Sandra Manuela Gonçalves Fonseca, Jaime C. Moreira, António H. J. Borges, João |
author_role |
author |
author2 |
Dixe, Sandra Manuela Gonçalves Fonseca, Jaime C. Moreira, António H. J. Borges, João |
author2_role |
author author author author |
dc.contributor.none.fl_str_mv |
Universidade do Minho |
dc.contributor.author.fl_str_mv |
Melo, César Dixe, Sandra Manuela Gonçalves Fonseca, Jaime C. Moreira, António H. J. Borges, João |
dc.subject.por.fl_str_mv |
COVID-19 Deep learning Supervised learning Object detection Keypoint detection Science & Technology |
topic |
COVID-19 Deep learning Supervised learning Object detection Keypoint detection Science & Technology |
description |
COVID-19 was responsible for devastating social, economic, and political effects all over the world. Although the health authorities imposed restrictions provided relief and assisted with trying to return society to normal life, it is imperative to monitor people’s behavior and risk factors to keep virus transmission levels as low as possible. This article focuses on the application of deep learning algorithms to detect the presence of masks on people in public spaces (using RGB cameras), as well as the detection of the caruncle in the human eye area to make an accurate measurement of body temperature (using thermal cameras). For this task, synthetic data generation techniques were used to create hybrid datasets from public ones to train state-of-the-art algorithms, such as YOLOv5 object detector and a keypoint detector based on Resnet-50. For RGB mask detection, YOLOv5 achieved an average precision of 82.4%. For thermal masks, glasses, and caruncle detection, YOLOv5 and keypoint detector achieved an average precision of 96.65% and 78.7%, respectively. Moreover, RGB and thermal datasets were made publicly available. |
publishDate |
2022 |
dc.date.none.fl_str_mv |
2022 2022-01-01T00:00:00Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/article |
format |
article |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
https://hdl.handle.net/1822/75893 |
url |
https://hdl.handle.net/1822/75893 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.relation.none.fl_str_mv |
Melo, C.; Dixe, S.; Fonseca, J.C.; Moreira, A.H.J.; Borges, J. AI Based Monitoring of Different Risk Levels in COVID-19 Context. Sensors 2022, 22, 298. https://doi.org/10.3390/s22010298 1424-8220 10.3390/s22010298 35009846 298 https://www.mdpi.com/1424-8220/22/1/298 |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
application/pdf |
dc.publisher.none.fl_str_mv |
Multidisciplinary Digital Publishing Institute (MDPI) |
publisher.none.fl_str_mv |
Multidisciplinary Digital Publishing Institute (MDPI) |
dc.source.none.fl_str_mv |
reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação instacron:RCAAP |
instname_str |
Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação |
instacron_str |
RCAAP |
institution |
RCAAP |
reponame_str |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
collection |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
repository.name.fl_str_mv |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação |
repository.mail.fl_str_mv |
|
_version_ |
1799133000426848256 |