Segmentation of dental restorations on panoramic radiographs using deep learning

Detalhes bibliográficos
Autor(a) principal: Rohrer, Csaba
Data de Publicação: 2022
Outros Autores: Krois, Joachim, Patel, Jay, Meyer-Lueckel, Hendrik, Rodrigues, Jonas de Almeida, Schwendicke, Falk
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Institucional da UFRGS
Texto Completo: http://hdl.handle.net/10183/242609
Resumo: Convolutional Neural Networks (CNNs) such as U-Net have been widely used for medical image segmentation. Dental restorations are prominent features of dental radiographs. Applying U-Net on the panoramic image is challenging, as the shape, size and frequency of different restoration types vary. We hypothesized that models trained on smaller, equally spaced rectangular image crops (tiles) of the panoramic would outperform models trained on the full image. A total of 1781 panoramic radiographs were annotated pixelwise for fillings, crowns, and root canal fillings by dental experts. We used different numbers of tiles for our experiments. Five-times-repeated three-fold cross-validation was used for model evaluation. Training with more tiles improved model performance and accelerated convergence. The F1-score for the full panoramic image was 0.7, compared to 0.83, 0.92 and 0.95 for 6, 10 and 20 tiles, respectively. For root canals fillings, which are small, cone-shaped features that appear less frequently on the radiographs, the performance improvement was even higher (+294%). Training on tiles and pooling the results thereafter improved pixelwise classification performance and reduced the time to model convergence for segmenting dental restorations. Segmentation of panoramic radiographs is biased towards more frequent and extended classes. Tiling may help to overcome this bias and increase accuracy.
id UFRGS-2_cd12fd1c093f2b963b72210335c74b16
oai_identifier_str oai:www.lume.ufrgs.br:10183/242609
network_acronym_str UFRGS-2
network_name_str Repositório Institucional da UFRGS
repository_id_str
spelling Rohrer, CsabaKrois, JoachimPatel, JayMeyer-Lueckel, HendrikRodrigues, Jonas de AlmeidaSchwendicke, Falk2022-07-15T04:49:46Z20222075-4418http://hdl.handle.net/10183/242609001144826Convolutional Neural Networks (CNNs) such as U-Net have been widely used for medical image segmentation. Dental restorations are prominent features of dental radiographs. Applying U-Net on the panoramic image is challenging, as the shape, size and frequency of different restoration types vary. We hypothesized that models trained on smaller, equally spaced rectangular image crops (tiles) of the panoramic would outperform models trained on the full image. A total of 1781 panoramic radiographs were annotated pixelwise for fillings, crowns, and root canal fillings by dental experts. We used different numbers of tiles for our experiments. Five-times-repeated three-fold cross-validation was used for model evaluation. Training with more tiles improved model performance and accelerated convergence. The F1-score for the full panoramic image was 0.7, compared to 0.83, 0.92 and 0.95 for 6, 10 and 20 tiles, respectively. For root canals fillings, which are small, cone-shaped features that appear less frequently on the radiographs, the performance improvement was even higher (+294%). Training on tiles and pooling the results thereafter improved pixelwise classification performance and reduced the time to model convergence for segmenting dental restorations. Segmentation of panoramic radiographs is biased towards more frequent and extended classes. Tiling may help to overcome this bias and increase accuracy.application/pdfengDiagnostics. Basel. Vol. 12, no. 6 (2022), 1316, 8 p.Aprendizado de máquinaMachine learningDeep learningImage segmentationDental restorationsSegmentation of dental restorations on panoramic radiographs using deep learningEstrangeiroinfo:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/openAccessreponame:Repositório Institucional da UFRGSinstname:Universidade Federal do Rio Grande do Sul (UFRGS)instacron:UFRGSTEXT001144826.pdf.txt001144826.pdf.txtExtracted Texttext/plain28751http://www.lume.ufrgs.br/bitstream/10183/242609/2/001144826.pdf.txteab241d6121ef86e020ba4cea3666f3dMD52ORIGINAL001144826.pdfTexto completo (inglês)application/pdf1732769http://www.lume.ufrgs.br/bitstream/10183/242609/1/001144826.pdf1322b22cbd47aa757bcd44a8b4687892MD5110183/2426092022-07-16 05:05:48.530952oai:www.lume.ufrgs.br:10183/242609Repositório de PublicaçõesPUBhttps://lume.ufrgs.br/oai/requestopendoar:2022-07-16T08:05:48Repositório Institucional da UFRGS - Universidade Federal do Rio Grande do Sul (UFRGS)false
dc.title.pt_BR.fl_str_mv Segmentation of dental restorations on panoramic radiographs using deep learning
title Segmentation of dental restorations on panoramic radiographs using deep learning
spellingShingle Segmentation of dental restorations on panoramic radiographs using deep learning
Rohrer, Csaba
Aprendizado de máquina
Machine learning
Deep learning
Image segmentation
Dental restorations
title_short Segmentation of dental restorations on panoramic radiographs using deep learning
title_full Segmentation of dental restorations on panoramic radiographs using deep learning
title_fullStr Segmentation of dental restorations on panoramic radiographs using deep learning
title_full_unstemmed Segmentation of dental restorations on panoramic radiographs using deep learning
title_sort Segmentation of dental restorations on panoramic radiographs using deep learning
author Rohrer, Csaba
author_facet Rohrer, Csaba
Krois, Joachim
Patel, Jay
Meyer-Lueckel, Hendrik
Rodrigues, Jonas de Almeida
Schwendicke, Falk
author_role author
author2 Krois, Joachim
Patel, Jay
Meyer-Lueckel, Hendrik
Rodrigues, Jonas de Almeida
Schwendicke, Falk
author2_role author
author
author
author
author
dc.contributor.author.fl_str_mv Rohrer, Csaba
Krois, Joachim
Patel, Jay
Meyer-Lueckel, Hendrik
Rodrigues, Jonas de Almeida
Schwendicke, Falk
dc.subject.por.fl_str_mv Aprendizado de máquina
topic Aprendizado de máquina
Machine learning
Deep learning
Image segmentation
Dental restorations
dc.subject.eng.fl_str_mv Machine learning
Deep learning
Image segmentation
Dental restorations
description Convolutional Neural Networks (CNNs) such as U-Net have been widely used for medical image segmentation. Dental restorations are prominent features of dental radiographs. Applying U-Net on the panoramic image is challenging, as the shape, size and frequency of different restoration types vary. We hypothesized that models trained on smaller, equally spaced rectangular image crops (tiles) of the panoramic would outperform models trained on the full image. A total of 1781 panoramic radiographs were annotated pixelwise for fillings, crowns, and root canal fillings by dental experts. We used different numbers of tiles for our experiments. Five-times-repeated three-fold cross-validation was used for model evaluation. Training with more tiles improved model performance and accelerated convergence. The F1-score for the full panoramic image was 0.7, compared to 0.83, 0.92 and 0.95 for 6, 10 and 20 tiles, respectively. For root canals fillings, which are small, cone-shaped features that appear less frequently on the radiographs, the performance improvement was even higher (+294%). Training on tiles and pooling the results thereafter improved pixelwise classification performance and reduced the time to model convergence for segmenting dental restorations. Segmentation of panoramic radiographs is biased towards more frequent and extended classes. Tiling may help to overcome this bias and increase accuracy.
publishDate 2022
dc.date.accessioned.fl_str_mv 2022-07-15T04:49:46Z
dc.date.issued.fl_str_mv 2022
dc.type.driver.fl_str_mv Estrangeiro
info:eu-repo/semantics/article
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10183/242609
dc.identifier.issn.pt_BR.fl_str_mv 2075-4418
dc.identifier.nrb.pt_BR.fl_str_mv 001144826
identifier_str_mv 2075-4418
001144826
url http://hdl.handle.net/10183/242609
dc.language.iso.fl_str_mv eng
language eng
dc.relation.ispartof.pt_BR.fl_str_mv Diagnostics. Basel. Vol. 12, no. 6 (2022), 1316, 8 p.
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.source.none.fl_str_mv reponame:Repositório Institucional da UFRGS
instname:Universidade Federal do Rio Grande do Sul (UFRGS)
instacron:UFRGS
instname_str Universidade Federal do Rio Grande do Sul (UFRGS)
instacron_str UFRGS
institution UFRGS
reponame_str Repositório Institucional da UFRGS
collection Repositório Institucional da UFRGS
bitstream.url.fl_str_mv http://www.lume.ufrgs.br/bitstream/10183/242609/2/001144826.pdf.txt
http://www.lume.ufrgs.br/bitstream/10183/242609/1/001144826.pdf
bitstream.checksum.fl_str_mv eab241d6121ef86e020ba4cea3666f3d
1322b22cbd47aa757bcd44a8b4687892
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
repository.name.fl_str_mv Repositório Institucional da UFRGS - Universidade Federal do Rio Grande do Sul (UFRGS)
repository.mail.fl_str_mv
_version_ 1801225061608194048