Algorithms for super-resolution of images based on Sparse Representation and Manifolds

Detalhes bibliográficos
Autor(a) principal: Ferreira, Júlio César
Data de Publicação: 2016
Tipo de documento: Tese
Idioma: eng
Título da fonte: Repositório Institucional da UFU
Texto Completo: https://repositorio.ufu.br/handle/123456789/17708
https://doi.org/10.14393/ufu.te.2016.100
Resumo: lmage super-resolution is defined as a class of techniques that enhance the spatial resolution of images. Super-resolution methods can be subdivided in single and multi image methods. This thesis focuses on developing algorithms based on mathematical theories for single image super­ resolution problems. lndeed, in arder to estimate an output image, we adopta mixed approach: i.e., we use both a dictionary of patches with sparsity constraints (typical of learning-based methods) and regularization terms (typical of reconstruction-based methods). Although the existing methods already per- form well, they do not take into account the geometry of the data to: regularize the solution, cluster data samples (samples are often clustered using algorithms with the Euclidean distance as a dissimilarity metric), learn dictionaries (they are often learned using PCA or K-SVD). Thus, state-of-the-art methods still suffer from shortcomings. In this work, we proposed three new methods to overcome these deficiencies. First, we developed SE-ASDS (a structure tensor based regularization term) in arder to improve the sharpness of edges. SE-ASDS achieves much better results than many state-of-the- art algorithms. Then, we proposed AGNN and GOC algorithms for determining a local subset of training samples from which a good local model can be computed for recon- structing a given input test sample, where we take into account the underlying geometry of the data. AGNN and GOC methods outperform spectral clustering, soft clustering, and geodesic distance based subset selection in most settings. Next, we proposed aSOB strategy which takes into account the geometry of the data and the dictionary size. The aSOB strategy outperforms both PCA and PGA methods. Finally, we combine all our methods in a unique algorithm, named G2SR. Our proposed G2SR algorithm shows better visual and quantitative results when compared to the results of state-of-the-art methods.
id UFU_656ac1aa9ced3acfc339ca3aaa9b0bd4
oai_identifier_str oai:repositorio.ufu.br:123456789/17708
network_acronym_str UFU
network_name_str Repositório Institucional da UFU
repository_id_str
spelling Algorithms for super-resolution of images based on Sparse Representation and ManifoldsEngenharia elétricaProcessamento de imagensProcessamento de sinaisRepresentação esparsaAprendizagem de DicionáriosClusterizaçãoSuper-Resolução de lmagensSparse representationDictionary learningClusteringlmage super-resolutionCNPQ::ENGENHARIAS::ENGENHARIA ELETRICAlmage super-resolution is defined as a class of techniques that enhance the spatial resolution of images. Super-resolution methods can be subdivided in single and multi image methods. This thesis focuses on developing algorithms based on mathematical theories for single image super­ resolution problems. lndeed, in arder to estimate an output image, we adopta mixed approach: i.e., we use both a dictionary of patches with sparsity constraints (typical of learning-based methods) and regularization terms (typical of reconstruction-based methods). Although the existing methods already per- form well, they do not take into account the geometry of the data to: regularize the solution, cluster data samples (samples are often clustered using algorithms with the Euclidean distance as a dissimilarity metric), learn dictionaries (they are often learned using PCA or K-SVD). Thus, state-of-the-art methods still suffer from shortcomings. In this work, we proposed three new methods to overcome these deficiencies. First, we developed SE-ASDS (a structure tensor based regularization term) in arder to improve the sharpness of edges. SE-ASDS achieves much better results than many state-of-the- art algorithms. Then, we proposed AGNN and GOC algorithms for determining a local subset of training samples from which a good local model can be computed for recon- structing a given input test sample, where we take into account the underlying geometry of the data. AGNN and GOC methods outperform spectral clustering, soft clustering, and geodesic distance based subset selection in most settings. Next, we proposed aSOB strategy which takes into account the geometry of the data and the dictionary size. The aSOB strategy outperforms both PCA and PGA methods. Finally, we combine all our methods in a unique algorithm, named G2SR. Our proposed G2SR algorithm shows better visual and quantitative results when compared to the results of state-of-the-art methods.Coordenação de Aperfeiçoamento de Pessoal de Nível SuperiorTese (Doutorado)Super-resolução de imagens é definido como urna classe de técnicas que melhora a resolução espacial de imagens. Métodos de super-resolução podem ser subdivididos em métodos para urna única imagens e métodos para múltiplas imagens. Esta tese foca no desenvolvimento de algoritmos baseados em teorias matemáticas para problemas de super-resolução de urna única imagem. Com o propósito de estimar urna imagem de saída, nós adotamos urna abordagem mista, ou seja: nós usamos dicionários de patches com restrição de esparsidade (método baseado em aprendizagem) e termos de regularização (método baseado em reconstrução). Embora os métodos existentes sejam eficientes, eles nao levam em consideração a geometria dos dados para: regularizar a solução, clusterizar os dados (dados sao frequentemente clusterizados usando algoritmos com a distancia Euclideana como métrica de dissimilaridade), aprendizado de dicionários (eles sao frequentemente treinados usando PCA ou K-SVD). Portante, os métodos do estado da arte ainda tem algumas deficiencias. Neste trabalho, nós propomos tres métodos originais para superar estas deficiencias. Primeiro, nós desenvolvemos SE-ASDS (um termo de regularização baseado em structure tensor) afim de melhorar a nitidez das bordas das imagens. SE-ASDS alcança resultados muito melhores que os algoritmos do estado da arte. Em seguida, nós propomos os algoritmos AGNN e GOC para determinar um subconjunto de amostras de treinamento a partir das quais um bom modelo local pode ser calculado para reconstruir urna dada amostra de entrada considerando a geometria dos dados. Os métodos AGNN e GOC superamos métodos spectral clustering, soft clustering e os métodos baseados em distancia geodésica na maioria dos casos. Depois, nós propomos o método aSOB que leva em consideração a geometria dos dados e o tamanho do dicionário. O método aSOB supera os métodos PCA e PGA. Finalmente, nós combinamos todos os métodos que propomos em um único algoritmo, a saber, G2SR. Nosso algoritmo G2SR mostra resultados melhores que os métodos do estado da arte em termos de PSRN, SSIM, FSIM e qualidade visual.Universidade Federal de UberlândiaBrasilPrograma de Pós-graduação em Engenharia ElétricaGuillemot, ChristineCarrijo, Gilberto Aranteshttp://buscatextual.cnpq.br/buscatextual/visualizacv.do?id=K4781864Y0Silva, Eduardo Antônio Barros dahttp://buscatextual.cnpq.br/buscatextual/visualizacv.do?id=K4728057U4Yamanaka, Keijihttp://buscatextual.cnpq.br/buscatextual/visualizacv.do?id=K4798494D8Farrugia, Reuben A.Vural, ElifFerreira, Júlio César2016-09-14T11:31:43Z2016-09-14T11:31:43Z2016-07-06info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/doctoralThesisapplication/pdfFERREIRA, Júlio César. Algorithms for super-resolution of images based on Sparse Representation and Manifolds. 2016. 155 f. Tese (Doutorado em Ciências) - Universidade Federal de Uberlândia, Uberlândia, 2016.https://repositorio.ufu.br/handle/123456789/17708https://doi.org/10.14393/ufu.te.2016.100info:eu-repo/semantics/openAccessengreponame:Repositório Institucional da UFUinstname:Universidade Federal de Uberlândia (UFU)instacron:UFU2020-09-17T18:33:02Zoai:repositorio.ufu.br:123456789/17708Repositório InstitucionalONGhttp://repositorio.ufu.br/oai/requestdiinf@dirbi.ufu.bropendoar:2020-09-17T18:33:02Repositório Institucional da UFU - Universidade Federal de Uberlândia (UFU)false
dc.title.none.fl_str_mv Algorithms for super-resolution of images based on Sparse Representation and Manifolds
title Algorithms for super-resolution of images based on Sparse Representation and Manifolds
spellingShingle Algorithms for super-resolution of images based on Sparse Representation and Manifolds
Ferreira, Júlio César
Engenharia elétrica
Processamento de imagens
Processamento de sinais
Representação esparsa
Aprendizagem de Dicionários
Clusterização
Super-Resolução de lmagens
Sparse representation
Dictionary learning
Clustering
lmage super-resolution
CNPQ::ENGENHARIAS::ENGENHARIA ELETRICA
title_short Algorithms for super-resolution of images based on Sparse Representation and Manifolds
title_full Algorithms for super-resolution of images based on Sparse Representation and Manifolds
title_fullStr Algorithms for super-resolution of images based on Sparse Representation and Manifolds
title_full_unstemmed Algorithms for super-resolution of images based on Sparse Representation and Manifolds
title_sort Algorithms for super-resolution of images based on Sparse Representation and Manifolds
author Ferreira, Júlio César
author_facet Ferreira, Júlio César
author_role author
dc.contributor.none.fl_str_mv Guillemot, Christine
Carrijo, Gilberto Arantes
http://buscatextual.cnpq.br/buscatextual/visualizacv.do?id=K4781864Y0
Silva, Eduardo Antônio Barros da
http://buscatextual.cnpq.br/buscatextual/visualizacv.do?id=K4728057U4
Yamanaka, Keiji
http://buscatextual.cnpq.br/buscatextual/visualizacv.do?id=K4798494D8
Farrugia, Reuben A.
Vural, Elif
dc.contributor.author.fl_str_mv Ferreira, Júlio César
dc.subject.por.fl_str_mv Engenharia elétrica
Processamento de imagens
Processamento de sinais
Representação esparsa
Aprendizagem de Dicionários
Clusterização
Super-Resolução de lmagens
Sparse representation
Dictionary learning
Clustering
lmage super-resolution
CNPQ::ENGENHARIAS::ENGENHARIA ELETRICA
topic Engenharia elétrica
Processamento de imagens
Processamento de sinais
Representação esparsa
Aprendizagem de Dicionários
Clusterização
Super-Resolução de lmagens
Sparse representation
Dictionary learning
Clustering
lmage super-resolution
CNPQ::ENGENHARIAS::ENGENHARIA ELETRICA
description lmage super-resolution is defined as a class of techniques that enhance the spatial resolution of images. Super-resolution methods can be subdivided in single and multi image methods. This thesis focuses on developing algorithms based on mathematical theories for single image super­ resolution problems. lndeed, in arder to estimate an output image, we adopta mixed approach: i.e., we use both a dictionary of patches with sparsity constraints (typical of learning-based methods) and regularization terms (typical of reconstruction-based methods). Although the existing methods already per- form well, they do not take into account the geometry of the data to: regularize the solution, cluster data samples (samples are often clustered using algorithms with the Euclidean distance as a dissimilarity metric), learn dictionaries (they are often learned using PCA or K-SVD). Thus, state-of-the-art methods still suffer from shortcomings. In this work, we proposed three new methods to overcome these deficiencies. First, we developed SE-ASDS (a structure tensor based regularization term) in arder to improve the sharpness of edges. SE-ASDS achieves much better results than many state-of-the- art algorithms. Then, we proposed AGNN and GOC algorithms for determining a local subset of training samples from which a good local model can be computed for recon- structing a given input test sample, where we take into account the underlying geometry of the data. AGNN and GOC methods outperform spectral clustering, soft clustering, and geodesic distance based subset selection in most settings. Next, we proposed aSOB strategy which takes into account the geometry of the data and the dictionary size. The aSOB strategy outperforms both PCA and PGA methods. Finally, we combine all our methods in a unique algorithm, named G2SR. Our proposed G2SR algorithm shows better visual and quantitative results when compared to the results of state-of-the-art methods.
publishDate 2016
dc.date.none.fl_str_mv 2016-09-14T11:31:43Z
2016-09-14T11:31:43Z
2016-07-06
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/doctoralThesis
format doctoralThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv FERREIRA, Júlio César. Algorithms for super-resolution of images based on Sparse Representation and Manifolds. 2016. 155 f. Tese (Doutorado em Ciências) - Universidade Federal de Uberlândia, Uberlândia, 2016.
https://repositorio.ufu.br/handle/123456789/17708
https://doi.org/10.14393/ufu.te.2016.100
identifier_str_mv FERREIRA, Júlio César. Algorithms for super-resolution of images based on Sparse Representation and Manifolds. 2016. 155 f. Tese (Doutorado em Ciências) - Universidade Federal de Uberlândia, Uberlândia, 2016.
url https://repositorio.ufu.br/handle/123456789/17708
https://doi.org/10.14393/ufu.te.2016.100
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Universidade Federal de Uberlândia
Brasil
Programa de Pós-graduação em Engenharia Elétrica
publisher.none.fl_str_mv Universidade Federal de Uberlândia
Brasil
Programa de Pós-graduação em Engenharia Elétrica
dc.source.none.fl_str_mv reponame:Repositório Institucional da UFU
instname:Universidade Federal de Uberlândia (UFU)
instacron:UFU
instname_str Universidade Federal de Uberlândia (UFU)
instacron_str UFU
institution UFU
reponame_str Repositório Institucional da UFU
collection Repositório Institucional da UFU
repository.name.fl_str_mv Repositório Institucional da UFU - Universidade Federal de Uberlândia (UFU)
repository.mail.fl_str_mv diinf@dirbi.ufu.br
_version_ 1813711442814173184