Método de reconstrução tomográfica de amostras agrícolas com o emprego de técnicas big data

Detalhes bibliográficos
Autor(a) principal: Alves, Gabriel Marcelino
Data de Publicação: 2020
Tipo de documento: Tese
Idioma: por
Título da fonte: Repositório Institucional da UFSCAR
Texto Completo: https://repositorio.ufscar.br/handle/ufscar/12726
Resumo: A new method of high resolution tomographic reconstruction of agricultural samples is presented, which uses the spectral density of X-ray tomographic projections as a criterion to minimize processing time and obtain good quality digital images, besides being scalable. The use of the spectral density of the tomographic projections made it possible to evaluate the associated energy in each projection and consequently the amount of information that is related to its probabilities. Thus, the tomographic projections were organized into energy classes and those with the most expressive amounts of information were selected. As part of the method, after selecting projections, Filtered Back Projection (FBP) and B-Spline interpolation were considered to obtain 2D and 3D (volumetric) reconstruction, steps that were parallelized considering the Apache Spark environment. For the execution of the developed method was organized a Big Data environment that had a cluster, installed on the Amazon Web Services (AWS) platform and a stack of technologies. The Big Data environment configuration assessment considered four sets of projection matrice of the same plexiglass heterogeneous phantom totalizing 7840 matrice (35.63 GB) which were processed for 12 different configurations totalizing 427.56 GB of processed tomographic data. The cluster configuration was defined after evaluating the Speedup and Efficiency metrics for the method running in the Big Data environment. In addition, a cluster consisting of a heterogeneous plexiglass phantom, a Sheep-Logan phantom and a homogeneous sample plus 33 seed samples was prepared for the purpose of validating and evaluating the quality of cluster reconstruction of selected tomographic projections. In this context, an image dataset containing 66, 642 2D images of seeds (242 GB) has been organized. The Structural Similarity Index (SSIM), Normalized Root Mean Square Error (NRMSE), and Peak Signal-to-Noise Ratio (PSNR) metrics were used in the validation steps. The SSIM metric was calculated for each projection matrix and the median measurement for the SSIM values of each sample was observed. In this sense, the SSIM analysis showed that the tomographic reconstruction of the two-dimensional samples from the selected projections led to the SSIM value exceeding 0.80 for all samples analyzed. The results showed that the method allowed a reduction between 28% and 38% in the number of tomographic projections in each sample analyzed, without compromising the quality of the reconstructed images. Finally, this new method has been shown to be useful for the analysis of large quantities of agricultural samples based on the use of X-ray tomography in order to meet the management based on precision agriculture paradigms, where the increasing number of analyzes required for agricultural samples in the decision-making process is considered a prime factor.
id SCAR_f1b6b6341c130d646bc4f680acb81624
oai_identifier_str oai:repositorio.ufscar.br:ufscar/12726
network_acronym_str SCAR
network_name_str Repositório Institucional da UFSCAR
repository_id_str 4322
spelling Alves, Gabriel MarcelinoCruvinel, Paulo Estevãohttp://lattes.cnpq.br/7924553462118511http://lattes.cnpq.br/5710041471208439290a0133-8553-4dd7-8204-e92a85217ba32020-05-15T23:04:13Z2020-05-15T23:04:13Z2020-01-31ALVES, Gabriel Marcelino. Método de reconstrução tomográfica de amostras agrícolas com o emprego de técnicas big data. 2020. Tese (Doutorado em Ciência da Computação) – Universidade Federal de São Carlos, São Carlos, 2020. Disponível em: https://repositorio.ufscar.br/handle/ufscar/12726.https://repositorio.ufscar.br/handle/ufscar/12726A new method of high resolution tomographic reconstruction of agricultural samples is presented, which uses the spectral density of X-ray tomographic projections as a criterion to minimize processing time and obtain good quality digital images, besides being scalable. The use of the spectral density of the tomographic projections made it possible to evaluate the associated energy in each projection and consequently the amount of information that is related to its probabilities. Thus, the tomographic projections were organized into energy classes and those with the most expressive amounts of information were selected. As part of the method, after selecting projections, Filtered Back Projection (FBP) and B-Spline interpolation were considered to obtain 2D and 3D (volumetric) reconstruction, steps that were parallelized considering the Apache Spark environment. For the execution of the developed method was organized a Big Data environment that had a cluster, installed on the Amazon Web Services (AWS) platform and a stack of technologies. The Big Data environment configuration assessment considered four sets of projection matrice of the same plexiglass heterogeneous phantom totalizing 7840 matrice (35.63 GB) which were processed for 12 different configurations totalizing 427.56 GB of processed tomographic data. The cluster configuration was defined after evaluating the Speedup and Efficiency metrics for the method running in the Big Data environment. In addition, a cluster consisting of a heterogeneous plexiglass phantom, a Sheep-Logan phantom and a homogeneous sample plus 33 seed samples was prepared for the purpose of validating and evaluating the quality of cluster reconstruction of selected tomographic projections. In this context, an image dataset containing 66, 642 2D images of seeds (242 GB) has been organized. The Structural Similarity Index (SSIM), Normalized Root Mean Square Error (NRMSE), and Peak Signal-to-Noise Ratio (PSNR) metrics were used in the validation steps. The SSIM metric was calculated for each projection matrix and the median measurement for the SSIM values of each sample was observed. In this sense, the SSIM analysis showed that the tomographic reconstruction of the two-dimensional samples from the selected projections led to the SSIM value exceeding 0.80 for all samples analyzed. The results showed that the method allowed a reduction between 28% and 38% in the number of tomographic projections in each sample analyzed, without compromising the quality of the reconstructed images. Finally, this new method has been shown to be useful for the analysis of large quantities of agricultural samples based on the use of X-ray tomography in order to meet the management based on precision agriculture paradigms, where the increasing number of analyzes required for agricultural samples in the decision-making process is considered a prime factor.É apresentado um novo método de reconstrução tomográfica de amostras agrícolas em alta resolução, o qual utiliza a densidade espectral das projeções tomográficas de Raios-X como critério para minimizar o tempo de processamento e a obtenção de imagens digitais de boa qualidade, além de ser escalável. O uso da densidade espectral das projeções tomográficas viabilizou avaliar a energia associada em cada projeção e consequentemente a quantidade de informação que está relacionada às suas probabilidades. Desta forma, as projeções tomográficas foram organizadas em classes de energia e aquelas portadoras de quantidades de informações mais expressivas foram selecionadas. Como parte do método, após a seleção de projeções, foi considerado a retroprojeção filtrada (FBP) e a interpolação B-spline para a obtenção das reconstruções 2D e 3D (volumétrica), etapas que foram paralelizadas considerando o ambiente Apache Spark. Para a execução do método desenvolvido foi organizado um ambiente Big Data que contou com um cluster, instalado na plataforma Amazon Web Services (AWS), e uma pilha de tecnologias. A avaliação da configuração do ambiente Big Data considerou quatro conjuntos de matrizes de projeções de um mesmo phantom heterogêneo de plexiglass totalizando 7840 matrizes (35, 63GB) os quais foram processados por 12 diferentes configurações totalizando 427, 56 GB de dados tomográficos processados. A configuração do cluster foi definida após a avaliação das métricas de Speedup e Eficiência para o método em execução no ambiente Big Data. Adicionalmente, um conjunto composto por um phantom heterogêneo de plexiglass, um phantom Sheep-Logan e outro homogêneo além de 33 amostras de sementes agrícolas foi preparado para fins de validar e avaliar a qualidade da reconstrução dos conjuntos de projeções tomográficas selecionadas. Neste contexto, foi organizado um banco de imagem contendo 66.642 imagens 2D de sementes agrícolas (242GB). As métricas SSIM (Structural Similarity Index), NRMSE (Normalized Root Mean Square Error) e PSNR (Peak Signal-to-Noise Ratio) foram utilizadas nas etapas de validação. A métrica SSIM foi calculada para cada matriz de projeções e observou-se a medida da mediana para os valores SSIM de cada amostra. Neste sentido, a análise SSIM mostrou que a reconstrução tomográfica das amostras, em duas dimensões, a partir das projeções selecionadas, levou à obtenção do valor SSIM superior a 0, 80, para todas as amostras analisadas. Os resultados mostraram que o método possibilitou a redução entre 28% e 38% no número de projeções tomográficas em cada amostra analisada, sem comprometer a qualidade das imagens reconstruídas. Finalmente, este novo método se mostrou útil para viabilizar a análise de grandes quantidades de amostras agrícolas tomando por base o uso da tomografia de Raios-X, a fim de atender os manejos baseados nos paradigmas da agricultura de precisão, onde o número crescente de análises requeridas às amostras agrícolas no processo de tomada de decisão é considerado um fator primordial.Não recebi financiamentoporUniversidade Federal de São CarlosCâmpus São CarlosPrograma de Pós-Graduação em Ciência da Computação - PPGCCUFSCarAttribution-NonCommercial-NoDerivs 3.0 Brazilhttp://creativecommons.org/licenses/by-nc-nd/3.0/br/info:eu-repo/semantics/openAccessReconstrução de imagens tomográficasSeleção de projeções tomográficasProcessamento de imagensAgricultura de precisãoTomographic image reconstructionImage processingPrecision agricultureTomographic projections selectionBig DataCIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO::METODOLOGIA E TECNICAS DA COMPUTACAOCIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO::SISTEMAS DE COMPUTACAOCIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAOMétodo de reconstrução tomográfica de amostras agrícolas com o emprego de técnicas big dataTomographic reconstruction method of agricultural samples using big data techniquesinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/doctoralThesis600600d6a8fce8-6aad-4994-aa24-bf1c60ccbaccreponame:Repositório Institucional da UFSCARinstname:Universidade Federal de São Carlos (UFSCAR)instacron:UFSCARORIGINALtese_final_gabriel_marcelino_alves.pdftese_final_gabriel_marcelino_alves.pdfapplication/pdf18636077https://repositorio.ufscar.br/bitstream/ufscar/12726/1/tese_final_gabriel_marcelino_alves.pdf79f52132c1f2d2eb49cbce6da251693dMD51carat-autorizacao-orientador-assinada.pdfcarat-autorizacao-orientador-assinada.pdfapplication/pdf140347https://repositorio.ufscar.br/bitstream/ufscar/12726/3/carat-autorizacao-orientador-assinada.pdf83ee297ea4c95a9271879a02ae81ff69MD53CC-LICENSElicense_rdflicense_rdfapplication/rdf+xml; charset=utf-8811https://repositorio.ufscar.br/bitstream/ufscar/12726/4/license_rdfe39d27027a6cc9cb039ad269a5db8e34MD54TEXTtese_final_gabriel_marcelino_alves.pdf.txttese_final_gabriel_marcelino_alves.pdf.txtExtracted texttext/plain347658https://repositorio.ufscar.br/bitstream/ufscar/12726/5/tese_final_gabriel_marcelino_alves.pdf.txt266b0014136e6cc03d82b9da12a18b4dMD55carat-autorizacao-orientador-assinada.pdf.txtcarat-autorizacao-orientador-assinada.pdf.txtExtracted texttext/plain1444https://repositorio.ufscar.br/bitstream/ufscar/12726/7/carat-autorizacao-orientador-assinada.pdf.txtd5f9ae50bf2596833be3e798e41cab20MD57THUMBNAILtese_final_gabriel_marcelino_alves.pdf.jpgtese_final_gabriel_marcelino_alves.pdf.jpgIM Thumbnailimage/jpeg8968https://repositorio.ufscar.br/bitstream/ufscar/12726/6/tese_final_gabriel_marcelino_alves.pdf.jpga6658f431446f30bcb3d6f9d1d4092bfMD56carat-autorizacao-orientador-assinada.pdf.jpgcarat-autorizacao-orientador-assinada.pdf.jpgIM Thumbnailimage/jpeg11471https://repositorio.ufscar.br/bitstream/ufscar/12726/8/carat-autorizacao-orientador-assinada.pdf.jpga8ea7b006992243d9ccdf5650669b4abMD58ufscar/127262023-09-18 18:31:54.628oai:repositorio.ufscar.br:ufscar/12726Repositório InstitucionalPUBhttps://repositorio.ufscar.br/oai/requestopendoar:43222023-09-18T18:31:54Repositório Institucional da UFSCAR - Universidade Federal de São Carlos (UFSCAR)false
dc.title.por.fl_str_mv Método de reconstrução tomográfica de amostras agrícolas com o emprego de técnicas big data
dc.title.alternative.eng.fl_str_mv Tomographic reconstruction method of agricultural samples using big data techniques
title Método de reconstrução tomográfica de amostras agrícolas com o emprego de técnicas big data
spellingShingle Método de reconstrução tomográfica de amostras agrícolas com o emprego de técnicas big data
Alves, Gabriel Marcelino
Reconstrução de imagens tomográficas
Seleção de projeções tomográficas
Processamento de imagens
Agricultura de precisão
Tomographic image reconstruction
Image processing
Precision agriculture
Tomographic projections selection
Big Data
CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO::METODOLOGIA E TECNICAS DA COMPUTACAO
CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO::SISTEMAS DE COMPUTACAO
CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO
title_short Método de reconstrução tomográfica de amostras agrícolas com o emprego de técnicas big data
title_full Método de reconstrução tomográfica de amostras agrícolas com o emprego de técnicas big data
title_fullStr Método de reconstrução tomográfica de amostras agrícolas com o emprego de técnicas big data
title_full_unstemmed Método de reconstrução tomográfica de amostras agrícolas com o emprego de técnicas big data
title_sort Método de reconstrução tomográfica de amostras agrícolas com o emprego de técnicas big data
author Alves, Gabriel Marcelino
author_facet Alves, Gabriel Marcelino
author_role author
dc.contributor.authorlattes.por.fl_str_mv http://lattes.cnpq.br/5710041471208439
dc.contributor.author.fl_str_mv Alves, Gabriel Marcelino
dc.contributor.advisor1.fl_str_mv Cruvinel, Paulo Estevão
dc.contributor.advisor1Lattes.fl_str_mv http://lattes.cnpq.br/7924553462118511
dc.contributor.authorID.fl_str_mv 290a0133-8553-4dd7-8204-e92a85217ba3
contributor_str_mv Cruvinel, Paulo Estevão
dc.subject.por.fl_str_mv Reconstrução de imagens tomográficas
Seleção de projeções tomográficas
Processamento de imagens
Agricultura de precisão
topic Reconstrução de imagens tomográficas
Seleção de projeções tomográficas
Processamento de imagens
Agricultura de precisão
Tomographic image reconstruction
Image processing
Precision agriculture
Tomographic projections selection
Big Data
CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO::METODOLOGIA E TECNICAS DA COMPUTACAO
CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO::SISTEMAS DE COMPUTACAO
CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO
dc.subject.eng.fl_str_mv Tomographic image reconstruction
Image processing
Precision agriculture
Tomographic projections selection
Big Data
dc.subject.cnpq.fl_str_mv CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO::METODOLOGIA E TECNICAS DA COMPUTACAO
CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO::SISTEMAS DE COMPUTACAO
CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO
description A new method of high resolution tomographic reconstruction of agricultural samples is presented, which uses the spectral density of X-ray tomographic projections as a criterion to minimize processing time and obtain good quality digital images, besides being scalable. The use of the spectral density of the tomographic projections made it possible to evaluate the associated energy in each projection and consequently the amount of information that is related to its probabilities. Thus, the tomographic projections were organized into energy classes and those with the most expressive amounts of information were selected. As part of the method, after selecting projections, Filtered Back Projection (FBP) and B-Spline interpolation were considered to obtain 2D and 3D (volumetric) reconstruction, steps that were parallelized considering the Apache Spark environment. For the execution of the developed method was organized a Big Data environment that had a cluster, installed on the Amazon Web Services (AWS) platform and a stack of technologies. The Big Data environment configuration assessment considered four sets of projection matrice of the same plexiglass heterogeneous phantom totalizing 7840 matrice (35.63 GB) which were processed for 12 different configurations totalizing 427.56 GB of processed tomographic data. The cluster configuration was defined after evaluating the Speedup and Efficiency metrics for the method running in the Big Data environment. In addition, a cluster consisting of a heterogeneous plexiglass phantom, a Sheep-Logan phantom and a homogeneous sample plus 33 seed samples was prepared for the purpose of validating and evaluating the quality of cluster reconstruction of selected tomographic projections. In this context, an image dataset containing 66, 642 2D images of seeds (242 GB) has been organized. The Structural Similarity Index (SSIM), Normalized Root Mean Square Error (NRMSE), and Peak Signal-to-Noise Ratio (PSNR) metrics were used in the validation steps. The SSIM metric was calculated for each projection matrix and the median measurement for the SSIM values of each sample was observed. In this sense, the SSIM analysis showed that the tomographic reconstruction of the two-dimensional samples from the selected projections led to the SSIM value exceeding 0.80 for all samples analyzed. The results showed that the method allowed a reduction between 28% and 38% in the number of tomographic projections in each sample analyzed, without compromising the quality of the reconstructed images. Finally, this new method has been shown to be useful for the analysis of large quantities of agricultural samples based on the use of X-ray tomography in order to meet the management based on precision agriculture paradigms, where the increasing number of analyzes required for agricultural samples in the decision-making process is considered a prime factor.
publishDate 2020
dc.date.accessioned.fl_str_mv 2020-05-15T23:04:13Z
dc.date.available.fl_str_mv 2020-05-15T23:04:13Z
dc.date.issued.fl_str_mv 2020-01-31
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/doctoralThesis
format doctoralThesis
status_str publishedVersion
dc.identifier.citation.fl_str_mv ALVES, Gabriel Marcelino. Método de reconstrução tomográfica de amostras agrícolas com o emprego de técnicas big data. 2020. Tese (Doutorado em Ciência da Computação) – Universidade Federal de São Carlos, São Carlos, 2020. Disponível em: https://repositorio.ufscar.br/handle/ufscar/12726.
dc.identifier.uri.fl_str_mv https://repositorio.ufscar.br/handle/ufscar/12726
identifier_str_mv ALVES, Gabriel Marcelino. Método de reconstrução tomográfica de amostras agrícolas com o emprego de técnicas big data. 2020. Tese (Doutorado em Ciência da Computação) – Universidade Federal de São Carlos, São Carlos, 2020. Disponível em: https://repositorio.ufscar.br/handle/ufscar/12726.
url https://repositorio.ufscar.br/handle/ufscar/12726
dc.language.iso.fl_str_mv por
language por
dc.relation.confidence.fl_str_mv 600
600
dc.relation.authority.fl_str_mv d6a8fce8-6aad-4994-aa24-bf1c60ccbacc
dc.rights.driver.fl_str_mv Attribution-NonCommercial-NoDerivs 3.0 Brazil
http://creativecommons.org/licenses/by-nc-nd/3.0/br/
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Attribution-NonCommercial-NoDerivs 3.0 Brazil
http://creativecommons.org/licenses/by-nc-nd/3.0/br/
eu_rights_str_mv openAccess
dc.publisher.none.fl_str_mv Universidade Federal de São Carlos
Câmpus São Carlos
dc.publisher.program.fl_str_mv Programa de Pós-Graduação em Ciência da Computação - PPGCC
dc.publisher.initials.fl_str_mv UFSCar
publisher.none.fl_str_mv Universidade Federal de São Carlos
Câmpus São Carlos
dc.source.none.fl_str_mv reponame:Repositório Institucional da UFSCAR
instname:Universidade Federal de São Carlos (UFSCAR)
instacron:UFSCAR
instname_str Universidade Federal de São Carlos (UFSCAR)
instacron_str UFSCAR
institution UFSCAR
reponame_str Repositório Institucional da UFSCAR
collection Repositório Institucional da UFSCAR
bitstream.url.fl_str_mv https://repositorio.ufscar.br/bitstream/ufscar/12726/1/tese_final_gabriel_marcelino_alves.pdf
https://repositorio.ufscar.br/bitstream/ufscar/12726/3/carat-autorizacao-orientador-assinada.pdf
https://repositorio.ufscar.br/bitstream/ufscar/12726/4/license_rdf
https://repositorio.ufscar.br/bitstream/ufscar/12726/5/tese_final_gabriel_marcelino_alves.pdf.txt
https://repositorio.ufscar.br/bitstream/ufscar/12726/7/carat-autorizacao-orientador-assinada.pdf.txt
https://repositorio.ufscar.br/bitstream/ufscar/12726/6/tese_final_gabriel_marcelino_alves.pdf.jpg
https://repositorio.ufscar.br/bitstream/ufscar/12726/8/carat-autorizacao-orientador-assinada.pdf.jpg
bitstream.checksum.fl_str_mv 79f52132c1f2d2eb49cbce6da251693d
83ee297ea4c95a9271879a02ae81ff69
e39d27027a6cc9cb039ad269a5db8e34
266b0014136e6cc03d82b9da12a18b4d
d5f9ae50bf2596833be3e798e41cab20
a6658f431446f30bcb3d6f9d1d4092bf
a8ea7b006992243d9ccdf5650669b4ab
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
MD5
MD5
MD5
MD5
MD5
repository.name.fl_str_mv Repositório Institucional da UFSCAR - Universidade Federal de São Carlos (UFSCAR)
repository.mail.fl_str_mv
_version_ 1802136374011232256