Using object detection technology to identify defects in clothing for blind people

Detalhes bibliográficos
Autor(a) principal: Rocha, Daniel
Data de Publicação: 2023
Outros Autores: Pinto, Leandro, Machado, José, Soares, Filomena, Carvalho, Vítor
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: https://hdl.handle.net/1822/85618
Resumo: Blind people often encounter challenges in managing their clothing, specifically in identifying defects such as stains or holes. With the progress of the computer vision field, it is crucial to minimize these limitations as much as possible to assist blind people with selecting appropriate clothing. Therefore, the objective of this paper is to use object detection technology to categorize and detect stains on garments. The defect detection system proposed in this study relies on the You Only Look Once (YOLO) architecture, which is a single-stage object detector that is well-suited for automated inspection tasks. The authors collected a dataset of clothing with defects and used it to train and evaluate the proposed system. The methodology used for the optimization of the defect detection system was based on three main components: (i) increasing the dataset with new defects, illumination conditions, and backgrounds, (ii) introducing data augmentation, and (iii) introducing defect classification. The authors compared and evaluated three different YOLOv5 models. The results of this study demonstrate that the proposed approach is effective and suitable for different challenging defect detection conditions, showing high average precision (AP) values, and paving the way for a mobile application to be accessible for the blind community.
id RCAP_49d2c1b0b8a5f0348bd560928aa4d5b5
oai_identifier_str oai:repositorium.sdum.uminho.pt:1822/85618
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling Using object detection technology to identify defects in clothing for blind peopleBlind peopleClothing defect detectionObject detectionDeep learningYOLOv5Science & TechnologyBlind people often encounter challenges in managing their clothing, specifically in identifying defects such as stains or holes. With the progress of the computer vision field, it is crucial to minimize these limitations as much as possible to assist blind people with selecting appropriate clothing. Therefore, the objective of this paper is to use object detection technology to categorize and detect stains on garments. The defect detection system proposed in this study relies on the You Only Look Once (YOLO) architecture, which is a single-stage object detector that is well-suited for automated inspection tasks. The authors collected a dataset of clothing with defects and used it to train and evaluate the proposed system. The methodology used for the optimization of the defect detection system was based on three main components: (i) increasing the dataset with new defects, illumination conditions, and backgrounds, (ii) introducing data augmentation, and (iii) introducing defect classification. The authors compared and evaluated three different YOLOv5 models. The results of this study demonstrate that the proposed approach is effective and suitable for different challenging defect detection conditions, showing high average precision (AP) values, and paving the way for a mobile application to be accessible for the blind community.This work has been supported by national funds through FCT—Fundacão para a Ciência e Tecnologia, within the Projects Scope: UIDB/00319/2020, UIDB/05549/2020, UIDP/05549/2020, UIDP/04077/2020, and UIDB/04077/2020.Multidisciplinary Digital Publishing Institute (MDPI)Universidade do MinhoRocha, DanielPinto, LeandroMachado, JoséSoares, FilomenaCarvalho, Vítor2023-04-282023-04-28T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttps://hdl.handle.net/1822/85618engRocha, D.; Pinto, L.; Machado, J.; Soares, F.; Carvalho, V. Using Object Detection Technology to Identify Defects in Clothing for Blind People. Sensors 2023, 23, 4381. https://doi.org/10.3390/s230943811424-82201424-822010.3390/s23094381371775844381https://www.mdpi.com/1424-8220/23/9/4381info:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2023-08-12T01:17:58Zoai:repositorium.sdum.uminho.pt:1822/85618Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-19T19:54:20.434015Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv Using object detection technology to identify defects in clothing for blind people
title Using object detection technology to identify defects in clothing for blind people
spellingShingle Using object detection technology to identify defects in clothing for blind people
Rocha, Daniel
Blind people
Clothing defect detection
Object detection
Deep learning
YOLOv5
Science & Technology
title_short Using object detection technology to identify defects in clothing for blind people
title_full Using object detection technology to identify defects in clothing for blind people
title_fullStr Using object detection technology to identify defects in clothing for blind people
title_full_unstemmed Using object detection technology to identify defects in clothing for blind people
title_sort Using object detection technology to identify defects in clothing for blind people
author Rocha, Daniel
author_facet Rocha, Daniel
Pinto, Leandro
Machado, José
Soares, Filomena
Carvalho, Vítor
author_role author
author2 Pinto, Leandro
Machado, José
Soares, Filomena
Carvalho, Vítor
author2_role author
author
author
author
dc.contributor.none.fl_str_mv Universidade do Minho
dc.contributor.author.fl_str_mv Rocha, Daniel
Pinto, Leandro
Machado, José
Soares, Filomena
Carvalho, Vítor
dc.subject.por.fl_str_mv Blind people
Clothing defect detection
Object detection
Deep learning
YOLOv5
Science & Technology
topic Blind people
Clothing defect detection
Object detection
Deep learning
YOLOv5
Science & Technology
description Blind people often encounter challenges in managing their clothing, specifically in identifying defects such as stains or holes. With the progress of the computer vision field, it is crucial to minimize these limitations as much as possible to assist blind people with selecting appropriate clothing. Therefore, the objective of this paper is to use object detection technology to categorize and detect stains on garments. The defect detection system proposed in this study relies on the You Only Look Once (YOLO) architecture, which is a single-stage object detector that is well-suited for automated inspection tasks. The authors collected a dataset of clothing with defects and used it to train and evaluate the proposed system. The methodology used for the optimization of the defect detection system was based on three main components: (i) increasing the dataset with new defects, illumination conditions, and backgrounds, (ii) introducing data augmentation, and (iii) introducing defect classification. The authors compared and evaluated three different YOLOv5 models. The results of this study demonstrate that the proposed approach is effective and suitable for different challenging defect detection conditions, showing high average precision (AP) values, and paving the way for a mobile application to be accessible for the blind community.
publishDate 2023
dc.date.none.fl_str_mv 2023-04-28
2023-04-28T00:00:00Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://hdl.handle.net/1822/85618
url https://hdl.handle.net/1822/85618
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv Rocha, D.; Pinto, L.; Machado, J.; Soares, F.; Carvalho, V. Using Object Detection Technology to Identify Defects in Clothing for Blind People. Sensors 2023, 23, 4381. https://doi.org/10.3390/s23094381
1424-8220
1424-8220
10.3390/s23094381
37177584
4381
https://www.mdpi.com/1424-8220/23/9/4381
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Multidisciplinary Digital Publishing Institute (MDPI)
publisher.none.fl_str_mv Multidisciplinary Digital Publishing Institute (MDPI)
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799133142283452416