A study of transfer learning for skin lesion classification

Detalhes bibliográficos
Autor(a) principal: Maia, Fábio
Data de Publicação: 2019
Tipo de documento: Dissertação
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: http://hdl.handle.net/10773/29408
Resumo: Transfer learning is a popular solution to the common problem in deep learning that is the lack of data or the computational resources to train large models from scratch, which skin lesion classification is a prime candidate for because high quality medical imaging data in this domain is scarce. This dissertation studies transfer learning in the domain of skin lesion classification by exploring pre-trained models of the VGG16 architecture (originally trained on ImageNet) and repurposing them for skin lesion classification on the ISIC 2018 dataset. Specifically, models of VGG16 are tested by exhaustively testing the layers at which weights are extracted from and up to which they are frozen from further training, concluding that extracting all layers from VGG16 and fine-tuning the last two convolutional blocks to the ISIC 2018 dataset is the most performant configuration. However different choices of optimizer and learning rates could unveil better models. For comparison, two custom CNN architectures are explored and trained from scratch in a typical endto- end learning scheme, from which it can be seen that end-to-end learning of CNN is much harder due to the many different hyperparameters that need to be cross-validated on a wide range of values which is computationally intensive to do thoroughly. In conclusion, transfer learning is a much more practical strategy for skin lesion classification and most other computer vision problems.
id RCAP_eb34472f34d5cb915cccb394f45a2b4b
oai_identifier_str oai:ria.ua.pt:10773/29408
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling A study of transfer learning for skin lesion classificationMedical imagingDeep learningConvolutional neural networkTransfer learningSkin lesion diagnosisBinary classificationTransfer learning is a popular solution to the common problem in deep learning that is the lack of data or the computational resources to train large models from scratch, which skin lesion classification is a prime candidate for because high quality medical imaging data in this domain is scarce. This dissertation studies transfer learning in the domain of skin lesion classification by exploring pre-trained models of the VGG16 architecture (originally trained on ImageNet) and repurposing them for skin lesion classification on the ISIC 2018 dataset. Specifically, models of VGG16 are tested by exhaustively testing the layers at which weights are extracted from and up to which they are frozen from further training, concluding that extracting all layers from VGG16 and fine-tuning the last two convolutional blocks to the ISIC 2018 dataset is the most performant configuration. However different choices of optimizer and learning rates could unveil better models. For comparison, two custom CNN architectures are explored and trained from scratch in a typical endto- end learning scheme, from which it can be seen that end-to-end learning of CNN is much harder due to the many different hyperparameters that need to be cross-validated on a wide range of values which is computationally intensive to do thoroughly. In conclusion, transfer learning is a much more practical strategy for skin lesion classification and most other computer vision problems.A aprendizagem por transferência (transfer learning) é uma solução popular para o problema comum na aprendizagem profunda (deep learning) que é a falta de dados ou de recursos computacionais para treinar grandes modelos a partir do zero, para a qual a classificação de lesões na pele é uma candidata pois os dados de imagens médicas de alta qualidade neste domínio são escassos. Esta dissertação estuda a aprendizagem por transferência no domínio da classificação de lesões na pele, explorando modelos pré-treinados da arquitetura VGG16 (originalmente treinados no ImageNet) e adaptando-os novamente para a classificação de lesões na pele no conjunto de dados ISIC 2018. Especificamente, os modelos de VGG16 são testados exaustivamente variando as camadas nas quais os pesos são extraídos e até as camadas que são congeladas de treino adicional, resultando na conclusão que extrair todas as camadas do modelo e ajustar os dois últimos blocos ao ISIC 2018 é a solução que oferece mais desempenho. No entanto diferentes escolhas de otimizadores e taxas de aprendizagem pode desvendar modelos com melhor desempenho. Para comparação, duas arquiteturas originais de CNN são exploradas e treinadas do zero num esquema típico de aprendizagem, de onde se conclui que o treino de CNN é particularmente difícil dado os vários hiperparâmetros que devem ser validados cruzadamente numa vasta gama de valores, o que é computacionalmente intensivo de fazer completamente. Em conclusão, a aprendizagem por transferência é uma estratégia muito mais prática para classificação binária de lesões na pele e a maior parte de problemas de visão por computador.2020-10-12T14:12:37Z2019-12-01T00:00:00Z2019-12info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisapplication/pdfhttp://hdl.handle.net/10773/29408engMaia, Fábioinfo:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2024-02-22T11:56:53Zoai:ria.ua.pt:10773/29408Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-20T03:01:45.426792Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv A study of transfer learning for skin lesion classification
title A study of transfer learning for skin lesion classification
spellingShingle A study of transfer learning for skin lesion classification
Maia, Fábio
Medical imaging
Deep learning
Convolutional neural network
Transfer learning
Skin lesion diagnosis
Binary classification
title_short A study of transfer learning for skin lesion classification
title_full A study of transfer learning for skin lesion classification
title_fullStr A study of transfer learning for skin lesion classification
title_full_unstemmed A study of transfer learning for skin lesion classification
title_sort A study of transfer learning for skin lesion classification
author Maia, Fábio
author_facet Maia, Fábio
author_role author
dc.contributor.author.fl_str_mv Maia, Fábio
dc.subject.por.fl_str_mv Medical imaging
Deep learning
Convolutional neural network
Transfer learning
Skin lesion diagnosis
Binary classification
topic Medical imaging
Deep learning
Convolutional neural network
Transfer learning
Skin lesion diagnosis
Binary classification
description Transfer learning is a popular solution to the common problem in deep learning that is the lack of data or the computational resources to train large models from scratch, which skin lesion classification is a prime candidate for because high quality medical imaging data in this domain is scarce. This dissertation studies transfer learning in the domain of skin lesion classification by exploring pre-trained models of the VGG16 architecture (originally trained on ImageNet) and repurposing them for skin lesion classification on the ISIC 2018 dataset. Specifically, models of VGG16 are tested by exhaustively testing the layers at which weights are extracted from and up to which they are frozen from further training, concluding that extracting all layers from VGG16 and fine-tuning the last two convolutional blocks to the ISIC 2018 dataset is the most performant configuration. However different choices of optimizer and learning rates could unveil better models. For comparison, two custom CNN architectures are explored and trained from scratch in a typical endto- end learning scheme, from which it can be seen that end-to-end learning of CNN is much harder due to the many different hyperparameters that need to be cross-validated on a wide range of values which is computationally intensive to do thoroughly. In conclusion, transfer learning is a much more practical strategy for skin lesion classification and most other computer vision problems.
publishDate 2019
dc.date.none.fl_str_mv 2019-12-01T00:00:00Z
2019-12
2020-10-12T14:12:37Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10773/29408
url http://hdl.handle.net/10773/29408
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799137673312468992