Fine-tuning pre-trained neural networks for medical image classification in small clinical datasets

Detalhes bibliográficos
Autor(a) principal: Spolaôr, Newton
Data de Publicação: 2023
Outros Autores: Lee, Huei Diana, Mendes, Ana Isabel, Nogueira, Conceição, Parmezan, Antonio Rafael Sabino, Takaki, Weber Shoity Resende, Coy, Claudio Saddy Rodrigues, Wu, Feng Chung, Fonseca-Pinto, Rui
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: http://hdl.handle.net/10400.8/9194
Resumo: Funding We would like to acknowledge eurekaSD: Enhancing University Research and Education in Areas Useful for Sustainable Development - grants EK14AC0037 and EK15AC0264. We thank Araucária Foundation for the Support of the Scientific and Technological Development of Paraná through a Research and Technological Productivity Scholarship for H. D. Lee (grant 028/2019). We also thank the Brazilian National Council for Scientific and Technological Development (CNPq) through the grant number 142050/2019-9 for A. R. S. Parmezan. The Portuguese team was partially supported by Fundação para a Ciência e a Tecnologia (FCT). R. Fonseca-Pinto was financed by the projects UIDB/50008/2020, UIDP/50008/2020, UIDB/05704/2020 and UIDP/05704/2020 and C. V. Nogueira was financed by the projects UIDB/00013/2020 and UIDP/00013/2020. The funding agencies did not have any further involvement in this paper.
id RCAP_e979fb38e35cfa58959ebafbebcd8b7d
oai_identifier_str oai:iconline.ipleiria.pt:10400.8/9194
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling Fine-tuning pre-trained neural networks for medical image classification in small clinical datasetsFeature learningFew-shot learningRMSpropShallow learningStatistical testVGGFunding We would like to acknowledge eurekaSD: Enhancing University Research and Education in Areas Useful for Sustainable Development - grants EK14AC0037 and EK15AC0264. We thank Araucária Foundation for the Support of the Scientific and Technological Development of Paraná through a Research and Technological Productivity Scholarship for H. D. Lee (grant 028/2019). We also thank the Brazilian National Council for Scientific and Technological Development (CNPq) through the grant number 142050/2019-9 for A. R. S. Parmezan. The Portuguese team was partially supported by Fundação para a Ciência e a Tecnologia (FCT). R. Fonseca-Pinto was financed by the projects UIDB/50008/2020, UIDP/50008/2020, UIDB/05704/2020 and UIDP/05704/2020 and C. V. Nogueira was financed by the projects UIDB/00013/2020 and UIDP/00013/2020. The funding agencies did not have any further involvement in this paper.Convolutional neural networks have been effective in several applications, arising as a promising supporting tool in a relevant Dermatology problem: skin cancer diagnosis. However, generalizing well can be difficult when little training data is available. The fine-tuning transfer learning strategy has been employed to differentiate properly malignant from non-malignant lesions in dermoscopic images. Fine-tuning a pre-trained network allows one to classify data in the target domain, occasionally with few images, using knowledge acquired in another domain. This work proposes eight fine-tuning settings based on convolutional networks previously trained on ImageNet that can be employed mainly in limited data samples to reduce overfitting risk. They differ on the architecture, the learning rate and the number of unfrozen layer blocks. We evaluated the settings in two public datasets with 104 and 200 dermoscopic images. By finding competitive configurations in small datasets, this paper illustrates that deep learning can be effective if one has only a few dozen malignant and non-malignant lesion images to study and differentiate in Dermatology. The proposal is also flexible and potentially useful for other domains. In fact, it performed satisfactorily in an assessment conducted in a larger dataset with 746 computerized tomographic images associated with the coronavirus disease.SpringerIC-OnlineSpolaôr, NewtonLee, Huei DianaMendes, Ana IsabelNogueira, ConceiçãoParmezan, Antonio Rafael SabinoTakaki, Weber Shoity ResendeCoy, Claudio Saddy RodriguesWu, Feng ChungFonseca-Pinto, Rui2024-01-05T18:07:05Z2023-08-312023-08-31T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/10400.8/9194engSpolaôr, N., Lee, H.D., Mendes, A.I. et al. Fine-tuning pre-trained neural networks for medical image classification in small clinical datasets. Multimed Tools Appl (2023). https://doi.org/10.1007/s11042-023-16529-w1380-7501https://doi.org/10.1007/s11042-023-16529-w1573-7721info:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2024-09-26T18:27:38Zoai:iconline.ipleiria.pt:10400.8/9194Portal AgregadorONGhttps://www.rcaap.pt/oai/openairemluisa.alvim@gmail.comopendoar:71602024-09-26T18:27:38Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv Fine-tuning pre-trained neural networks for medical image classification in small clinical datasets
title Fine-tuning pre-trained neural networks for medical image classification in small clinical datasets
spellingShingle Fine-tuning pre-trained neural networks for medical image classification in small clinical datasets
Spolaôr, Newton
Feature learning
Few-shot learning
RMSprop
Shallow learning
Statistical test
VGG
title_short Fine-tuning pre-trained neural networks for medical image classification in small clinical datasets
title_full Fine-tuning pre-trained neural networks for medical image classification in small clinical datasets
title_fullStr Fine-tuning pre-trained neural networks for medical image classification in small clinical datasets
title_full_unstemmed Fine-tuning pre-trained neural networks for medical image classification in small clinical datasets
title_sort Fine-tuning pre-trained neural networks for medical image classification in small clinical datasets
author Spolaôr, Newton
author_facet Spolaôr, Newton
Lee, Huei Diana
Mendes, Ana Isabel
Nogueira, Conceição
Parmezan, Antonio Rafael Sabino
Takaki, Weber Shoity Resende
Coy, Claudio Saddy Rodrigues
Wu, Feng Chung
Fonseca-Pinto, Rui
author_role author
author2 Lee, Huei Diana
Mendes, Ana Isabel
Nogueira, Conceição
Parmezan, Antonio Rafael Sabino
Takaki, Weber Shoity Resende
Coy, Claudio Saddy Rodrigues
Wu, Feng Chung
Fonseca-Pinto, Rui
author2_role author
author
author
author
author
author
author
author
dc.contributor.none.fl_str_mv IC-Online
dc.contributor.author.fl_str_mv Spolaôr, Newton
Lee, Huei Diana
Mendes, Ana Isabel
Nogueira, Conceição
Parmezan, Antonio Rafael Sabino
Takaki, Weber Shoity Resende
Coy, Claudio Saddy Rodrigues
Wu, Feng Chung
Fonseca-Pinto, Rui
dc.subject.por.fl_str_mv Feature learning
Few-shot learning
RMSprop
Shallow learning
Statistical test
VGG
topic Feature learning
Few-shot learning
RMSprop
Shallow learning
Statistical test
VGG
description Funding We would like to acknowledge eurekaSD: Enhancing University Research and Education in Areas Useful for Sustainable Development - grants EK14AC0037 and EK15AC0264. We thank Araucária Foundation for the Support of the Scientific and Technological Development of Paraná through a Research and Technological Productivity Scholarship for H. D. Lee (grant 028/2019). We also thank the Brazilian National Council for Scientific and Technological Development (CNPq) through the grant number 142050/2019-9 for A. R. S. Parmezan. The Portuguese team was partially supported by Fundação para a Ciência e a Tecnologia (FCT). R. Fonseca-Pinto was financed by the projects UIDB/50008/2020, UIDP/50008/2020, UIDB/05704/2020 and UIDP/05704/2020 and C. V. Nogueira was financed by the projects UIDB/00013/2020 and UIDP/00013/2020. The funding agencies did not have any further involvement in this paper.
publishDate 2023
dc.date.none.fl_str_mv 2023-08-31
2023-08-31T00:00:00Z
2024-01-05T18:07:05Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10400.8/9194
url http://hdl.handle.net/10400.8/9194
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv Spolaôr, N., Lee, H.D., Mendes, A.I. et al. Fine-tuning pre-trained neural networks for medical image classification in small clinical datasets. Multimed Tools Appl (2023). https://doi.org/10.1007/s11042-023-16529-w
1380-7501
https://doi.org/10.1007/s11042-023-16529-w
1573-7721
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Springer
publisher.none.fl_str_mv Springer
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv mluisa.alvim@gmail.com
_version_ 1817547299381837824