Algorithms for super-resolution of images based on Sparse Representation and Manifolds
Autor(a) principal: | |
---|---|
Data de Publicação: | 2016 |
Tipo de documento: | Tese |
Idioma: | eng |
Título da fonte: | Repositório Institucional da UFU |
Texto Completo: | https://repositorio.ufu.br/handle/123456789/17708 https://doi.org/10.14393/ufu.te.2016.100 |
Resumo: | lmage super-resolution is defined as a class of techniques that enhance the spatial resolution of images. Super-resolution methods can be subdivided in single and multi image methods. This thesis focuses on developing algorithms based on mathematical theories for single image super resolution problems. lndeed, in arder to estimate an output image, we adopta mixed approach: i.e., we use both a dictionary of patches with sparsity constraints (typical of learning-based methods) and regularization terms (typical of reconstruction-based methods). Although the existing methods already per- form well, they do not take into account the geometry of the data to: regularize the solution, cluster data samples (samples are often clustered using algorithms with the Euclidean distance as a dissimilarity metric), learn dictionaries (they are often learned using PCA or K-SVD). Thus, state-of-the-art methods still suffer from shortcomings. In this work, we proposed three new methods to overcome these deficiencies. First, we developed SE-ASDS (a structure tensor based regularization term) in arder to improve the sharpness of edges. SE-ASDS achieves much better results than many state-of-the- art algorithms. Then, we proposed AGNN and GOC algorithms for determining a local subset of training samples from which a good local model can be computed for recon- structing a given input test sample, where we take into account the underlying geometry of the data. AGNN and GOC methods outperform spectral clustering, soft clustering, and geodesic distance based subset selection in most settings. Next, we proposed aSOB strategy which takes into account the geometry of the data and the dictionary size. The aSOB strategy outperforms both PCA and PGA methods. Finally, we combine all our methods in a unique algorithm, named G2SR. Our proposed G2SR algorithm shows better visual and quantitative results when compared to the results of state-of-the-art methods. |
id |
UFU_656ac1aa9ced3acfc339ca3aaa9b0bd4 |
---|---|
oai_identifier_str |
oai:repositorio.ufu.br:123456789/17708 |
network_acronym_str |
UFU |
network_name_str |
Repositório Institucional da UFU |
repository_id_str |
|
spelling |
Algorithms for super-resolution of images based on Sparse Representation and ManifoldsEngenharia elétricaProcessamento de imagensProcessamento de sinaisRepresentação esparsaAprendizagem de DicionáriosClusterizaçãoSuper-Resolução de lmagensSparse representationDictionary learningClusteringlmage super-resolutionCNPQ::ENGENHARIAS::ENGENHARIA ELETRICAlmage super-resolution is defined as a class of techniques that enhance the spatial resolution of images. Super-resolution methods can be subdivided in single and multi image methods. This thesis focuses on developing algorithms based on mathematical theories for single image super resolution problems. lndeed, in arder to estimate an output image, we adopta mixed approach: i.e., we use both a dictionary of patches with sparsity constraints (typical of learning-based methods) and regularization terms (typical of reconstruction-based methods). Although the existing methods already per- form well, they do not take into account the geometry of the data to: regularize the solution, cluster data samples (samples are often clustered using algorithms with the Euclidean distance as a dissimilarity metric), learn dictionaries (they are often learned using PCA or K-SVD). Thus, state-of-the-art methods still suffer from shortcomings. In this work, we proposed three new methods to overcome these deficiencies. First, we developed SE-ASDS (a structure tensor based regularization term) in arder to improve the sharpness of edges. SE-ASDS achieves much better results than many state-of-the- art algorithms. Then, we proposed AGNN and GOC algorithms for determining a local subset of training samples from which a good local model can be computed for recon- structing a given input test sample, where we take into account the underlying geometry of the data. AGNN and GOC methods outperform spectral clustering, soft clustering, and geodesic distance based subset selection in most settings. Next, we proposed aSOB strategy which takes into account the geometry of the data and the dictionary size. The aSOB strategy outperforms both PCA and PGA methods. Finally, we combine all our methods in a unique algorithm, named G2SR. Our proposed G2SR algorithm shows better visual and quantitative results when compared to the results of state-of-the-art methods.Coordenação de Aperfeiçoamento de Pessoal de Nível SuperiorTese (Doutorado)Super-resolução de imagens é definido como urna classe de técnicas que melhora a resolução espacial de imagens. Métodos de super-resolução podem ser subdivididos em métodos para urna única imagens e métodos para múltiplas imagens. Esta tese foca no desenvolvimento de algoritmos baseados em teorias matemáticas para problemas de super-resolução de urna única imagem. Com o propósito de estimar urna imagem de saída, nós adotamos urna abordagem mista, ou seja: nós usamos dicionários de patches com restrição de esparsidade (método baseado em aprendizagem) e termos de regularização (método baseado em reconstrução). Embora os métodos existentes sejam eficientes, eles nao levam em consideração a geometria dos dados para: regularizar a solução, clusterizar os dados (dados sao frequentemente clusterizados usando algoritmos com a distancia Euclideana como métrica de dissimilaridade), aprendizado de dicionários (eles sao frequentemente treinados usando PCA ou K-SVD). Portante, os métodos do estado da arte ainda tem algumas deficiencias. Neste trabalho, nós propomos tres métodos originais para superar estas deficiencias. Primeiro, nós desenvolvemos SE-ASDS (um termo de regularização baseado em structure tensor) afim de melhorar a nitidez das bordas das imagens. SE-ASDS alcança resultados muito melhores que os algoritmos do estado da arte. Em seguida, nós propomos os algoritmos AGNN e GOC para determinar um subconjunto de amostras de treinamento a partir das quais um bom modelo local pode ser calculado para reconstruir urna dada amostra de entrada considerando a geometria dos dados. Os métodos AGNN e GOC superamos métodos spectral clustering, soft clustering e os métodos baseados em distancia geodésica na maioria dos casos. Depois, nós propomos o método aSOB que leva em consideração a geometria dos dados e o tamanho do dicionário. O método aSOB supera os métodos PCA e PGA. Finalmente, nós combinamos todos os métodos que propomos em um único algoritmo, a saber, G2SR. Nosso algoritmo G2SR mostra resultados melhores que os métodos do estado da arte em termos de PSRN, SSIM, FSIM e qualidade visual.Universidade Federal de UberlândiaBrasilPrograma de Pós-graduação em Engenharia ElétricaGuillemot, ChristineCarrijo, Gilberto Aranteshttp://buscatextual.cnpq.br/buscatextual/visualizacv.do?id=K4781864Y0Silva, Eduardo Antônio Barros dahttp://buscatextual.cnpq.br/buscatextual/visualizacv.do?id=K4728057U4Yamanaka, Keijihttp://buscatextual.cnpq.br/buscatextual/visualizacv.do?id=K4798494D8Farrugia, Reuben A.Vural, ElifFerreira, Júlio César2016-09-14T11:31:43Z2016-09-14T11:31:43Z2016-07-06info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/doctoralThesisapplication/pdfFERREIRA, Júlio César. Algorithms for super-resolution of images based on Sparse Representation and Manifolds. 2016. 155 f. Tese (Doutorado em Ciências) - Universidade Federal de Uberlândia, Uberlândia, 2016.https://repositorio.ufu.br/handle/123456789/17708https://doi.org/10.14393/ufu.te.2016.100info:eu-repo/semantics/openAccessengreponame:Repositório Institucional da UFUinstname:Universidade Federal de Uberlândia (UFU)instacron:UFU2020-09-17T18:33:02Zoai:repositorio.ufu.br:123456789/17708Repositório InstitucionalONGhttp://repositorio.ufu.br/oai/requestdiinf@dirbi.ufu.bropendoar:2020-09-17T18:33:02Repositório Institucional da UFU - Universidade Federal de Uberlândia (UFU)false |
dc.title.none.fl_str_mv |
Algorithms for super-resolution of images based on Sparse Representation and Manifolds |
title |
Algorithms for super-resolution of images based on Sparse Representation and Manifolds |
spellingShingle |
Algorithms for super-resolution of images based on Sparse Representation and Manifolds Ferreira, Júlio César Engenharia elétrica Processamento de imagens Processamento de sinais Representação esparsa Aprendizagem de Dicionários Clusterização Super-Resolução de lmagens Sparse representation Dictionary learning Clustering lmage super-resolution CNPQ::ENGENHARIAS::ENGENHARIA ELETRICA |
title_short |
Algorithms for super-resolution of images based on Sparse Representation and Manifolds |
title_full |
Algorithms for super-resolution of images based on Sparse Representation and Manifolds |
title_fullStr |
Algorithms for super-resolution of images based on Sparse Representation and Manifolds |
title_full_unstemmed |
Algorithms for super-resolution of images based on Sparse Representation and Manifolds |
title_sort |
Algorithms for super-resolution of images based on Sparse Representation and Manifolds |
author |
Ferreira, Júlio César |
author_facet |
Ferreira, Júlio César |
author_role |
author |
dc.contributor.none.fl_str_mv |
Guillemot, Christine Carrijo, Gilberto Arantes http://buscatextual.cnpq.br/buscatextual/visualizacv.do?id=K4781864Y0 Silva, Eduardo Antônio Barros da http://buscatextual.cnpq.br/buscatextual/visualizacv.do?id=K4728057U4 Yamanaka, Keiji http://buscatextual.cnpq.br/buscatextual/visualizacv.do?id=K4798494D8 Farrugia, Reuben A. Vural, Elif |
dc.contributor.author.fl_str_mv |
Ferreira, Júlio César |
dc.subject.por.fl_str_mv |
Engenharia elétrica Processamento de imagens Processamento de sinais Representação esparsa Aprendizagem de Dicionários Clusterização Super-Resolução de lmagens Sparse representation Dictionary learning Clustering lmage super-resolution CNPQ::ENGENHARIAS::ENGENHARIA ELETRICA |
topic |
Engenharia elétrica Processamento de imagens Processamento de sinais Representação esparsa Aprendizagem de Dicionários Clusterização Super-Resolução de lmagens Sparse representation Dictionary learning Clustering lmage super-resolution CNPQ::ENGENHARIAS::ENGENHARIA ELETRICA |
description |
lmage super-resolution is defined as a class of techniques that enhance the spatial resolution of images. Super-resolution methods can be subdivided in single and multi image methods. This thesis focuses on developing algorithms based on mathematical theories for single image super resolution problems. lndeed, in arder to estimate an output image, we adopta mixed approach: i.e., we use both a dictionary of patches with sparsity constraints (typical of learning-based methods) and regularization terms (typical of reconstruction-based methods). Although the existing methods already per- form well, they do not take into account the geometry of the data to: regularize the solution, cluster data samples (samples are often clustered using algorithms with the Euclidean distance as a dissimilarity metric), learn dictionaries (they are often learned using PCA or K-SVD). Thus, state-of-the-art methods still suffer from shortcomings. In this work, we proposed three new methods to overcome these deficiencies. First, we developed SE-ASDS (a structure tensor based regularization term) in arder to improve the sharpness of edges. SE-ASDS achieves much better results than many state-of-the- art algorithms. Then, we proposed AGNN and GOC algorithms for determining a local subset of training samples from which a good local model can be computed for recon- structing a given input test sample, where we take into account the underlying geometry of the data. AGNN and GOC methods outperform spectral clustering, soft clustering, and geodesic distance based subset selection in most settings. Next, we proposed aSOB strategy which takes into account the geometry of the data and the dictionary size. The aSOB strategy outperforms both PCA and PGA methods. Finally, we combine all our methods in a unique algorithm, named G2SR. Our proposed G2SR algorithm shows better visual and quantitative results when compared to the results of state-of-the-art methods. |
publishDate |
2016 |
dc.date.none.fl_str_mv |
2016-09-14T11:31:43Z 2016-09-14T11:31:43Z 2016-07-06 |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/doctoralThesis |
format |
doctoralThesis |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
FERREIRA, Júlio César. Algorithms for super-resolution of images based on Sparse Representation and Manifolds. 2016. 155 f. Tese (Doutorado em Ciências) - Universidade Federal de Uberlândia, Uberlândia, 2016. https://repositorio.ufu.br/handle/123456789/17708 https://doi.org/10.14393/ufu.te.2016.100 |
identifier_str_mv |
FERREIRA, Júlio César. Algorithms for super-resolution of images based on Sparse Representation and Manifolds. 2016. 155 f. Tese (Doutorado em Ciências) - Universidade Federal de Uberlândia, Uberlândia, 2016. |
url |
https://repositorio.ufu.br/handle/123456789/17708 https://doi.org/10.14393/ufu.te.2016.100 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
application/pdf |
dc.publisher.none.fl_str_mv |
Universidade Federal de Uberlândia Brasil Programa de Pós-graduação em Engenharia Elétrica |
publisher.none.fl_str_mv |
Universidade Federal de Uberlândia Brasil Programa de Pós-graduação em Engenharia Elétrica |
dc.source.none.fl_str_mv |
reponame:Repositório Institucional da UFU instname:Universidade Federal de Uberlândia (UFU) instacron:UFU |
instname_str |
Universidade Federal de Uberlândia (UFU) |
instacron_str |
UFU |
institution |
UFU |
reponame_str |
Repositório Institucional da UFU |
collection |
Repositório Institucional da UFU |
repository.name.fl_str_mv |
Repositório Institucional da UFU - Universidade Federal de Uberlândia (UFU) |
repository.mail.fl_str_mv |
diinf@dirbi.ufu.br |
_version_ |
1813711442814173184 |