Vessel Optimal Transport for Automated Alignment of Retinal Fundus Images

Detalhes bibliográficos
Autor(a) principal: Motta, Danilo
Data de Publicação: 2019
Outros Autores: Casaca, Wallace [UNESP], Paiva, Afonso
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Institucional da UNESP
Texto Completo: http://dx.doi.org/10.1109/TIP.2019.2925287
http://hdl.handle.net/11449/209506
Resumo: Optimal transport has emerged as a promising and useful tool for supporting modern image processing applications such as medical imaging and scientific visualization. Indeed, the optimal transport theory enables great flexibility in modeling problems related to image registration, as different optimization resources can be successfully used as well as the choice of suitable matching models to align the images. In this paper, we introduce an automated framework for fundus image registration which unifies optimal transport theory, image processing tools, and graph matching schemes into a functional and concise methodology. Given two ocular fundus images, we construct representative graphs which embed in their structures spatial and topological information from the eye's blood vessels. The graphs produced are then used as input by our optimal transport model in order to establish a correspondence between their sets of nodes. Finally, geometric transformations are performed between the images so as to accomplish the registration task properly. Our formulation relies on the solid mathematical foundation of optimal transport as a constrained optimization problem, being also robust when dealing with outliers created during the matching stage. We demonstrate the accuracy and effectiveness of the present framework throughout a comprehensive set of qualitative and quantitative comparisons against several influential state-of-the-art methods on various fundus image databases.
id UNSP_1d9ebabbdd5f4a386d838e99137f6c7e
oai_identifier_str oai:repositorio.unesp.br:11449/209506
network_acronym_str UNSP
network_name_str Repositório Institucional da UNESP
repository_id_str 2946
spelling Vessel Optimal Transport for Automated Alignment of Retinal Fundus ImagesRetinal image registrationimage alignmentblood vessel detectionoptimal transportOptimal transport has emerged as a promising and useful tool for supporting modern image processing applications such as medical imaging and scientific visualization. Indeed, the optimal transport theory enables great flexibility in modeling problems related to image registration, as different optimization resources can be successfully used as well as the choice of suitable matching models to align the images. In this paper, we introduce an automated framework for fundus image registration which unifies optimal transport theory, image processing tools, and graph matching schemes into a functional and concise methodology. Given two ocular fundus images, we construct representative graphs which embed in their structures spatial and topological information from the eye's blood vessels. The graphs produced are then used as input by our optimal transport model in order to establish a correspondence between their sets of nodes. Finally, geometric transformations are performed between the images so as to accomplish the registration task properly. Our formulation relies on the solid mathematical foundation of optimal transport as a constrained optimization problem, being also robust when dealing with outliers created during the matching stage. We demonstrate the accuracy and effectiveness of the present framework throughout a comprehensive set of qualitative and quantitative comparisons against several influential state-of-the-art methods on various fundus image databases.Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)Univ Sao Paulo, ICMC, BR-13566590 Sao Carlos, BrazilSao Paulo State Univ, CCEE, BR-16750000 Rosana, BrazilSao Paulo State Univ, CCEE, BR-16750000 Rosana, BrazilCNPq: 301642/2017-6FAPESP: 2019/13165-4FAPESP: 2014/09546-9FAPESP: 2013/07375-0Ieee-inst Electrical Electronics Engineers IncUniversidade de São Paulo (USP)Universidade Estadual Paulista (Unesp)Motta, DaniloCasaca, Wallace [UNESP]Paiva, Afonso2021-06-25T12:20:39Z2021-06-25T12:20:39Z2019-12-01info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/article6154-6168http://dx.doi.org/10.1109/TIP.2019.2925287Ieee Transactions On Image Processing. Piscataway: Ieee-inst Electrical Electronics Engineers Inc, v. 28, n. 12, p. 6154-6168, 2019.1057-7149http://hdl.handle.net/11449/20950610.1109/TIP.2019.2925287WOS:000575374700009Web of Sciencereponame:Repositório Institucional da UNESPinstname:Universidade Estadual Paulista (UNESP)instacron:UNESPengIeee Transactions On Image Processinginfo:eu-repo/semantics/openAccess2021-10-23T19:28:14Zoai:repositorio.unesp.br:11449/209506Repositório InstitucionalPUBhttp://repositorio.unesp.br/oai/requestopendoar:29462024-05-23T11:10:03.517930Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)false
dc.title.none.fl_str_mv Vessel Optimal Transport for Automated Alignment of Retinal Fundus Images
title Vessel Optimal Transport for Automated Alignment of Retinal Fundus Images
spellingShingle Vessel Optimal Transport for Automated Alignment of Retinal Fundus Images
Motta, Danilo
Retinal image registration
image alignment
blood vessel detection
optimal transport
title_short Vessel Optimal Transport for Automated Alignment of Retinal Fundus Images
title_full Vessel Optimal Transport for Automated Alignment of Retinal Fundus Images
title_fullStr Vessel Optimal Transport for Automated Alignment of Retinal Fundus Images
title_full_unstemmed Vessel Optimal Transport for Automated Alignment of Retinal Fundus Images
title_sort Vessel Optimal Transport for Automated Alignment of Retinal Fundus Images
author Motta, Danilo
author_facet Motta, Danilo
Casaca, Wallace [UNESP]
Paiva, Afonso
author_role author
author2 Casaca, Wallace [UNESP]
Paiva, Afonso
author2_role author
author
dc.contributor.none.fl_str_mv Universidade de São Paulo (USP)
Universidade Estadual Paulista (Unesp)
dc.contributor.author.fl_str_mv Motta, Danilo
Casaca, Wallace [UNESP]
Paiva, Afonso
dc.subject.por.fl_str_mv Retinal image registration
image alignment
blood vessel detection
optimal transport
topic Retinal image registration
image alignment
blood vessel detection
optimal transport
description Optimal transport has emerged as a promising and useful tool for supporting modern image processing applications such as medical imaging and scientific visualization. Indeed, the optimal transport theory enables great flexibility in modeling problems related to image registration, as different optimization resources can be successfully used as well as the choice of suitable matching models to align the images. In this paper, we introduce an automated framework for fundus image registration which unifies optimal transport theory, image processing tools, and graph matching schemes into a functional and concise methodology. Given two ocular fundus images, we construct representative graphs which embed in their structures spatial and topological information from the eye's blood vessels. The graphs produced are then used as input by our optimal transport model in order to establish a correspondence between their sets of nodes. Finally, geometric transformations are performed between the images so as to accomplish the registration task properly. Our formulation relies on the solid mathematical foundation of optimal transport as a constrained optimization problem, being also robust when dealing with outliers created during the matching stage. We demonstrate the accuracy and effectiveness of the present framework throughout a comprehensive set of qualitative and quantitative comparisons against several influential state-of-the-art methods on various fundus image databases.
publishDate 2019
dc.date.none.fl_str_mv 2019-12-01
2021-06-25T12:20:39Z
2021-06-25T12:20:39Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://dx.doi.org/10.1109/TIP.2019.2925287
Ieee Transactions On Image Processing. Piscataway: Ieee-inst Electrical Electronics Engineers Inc, v. 28, n. 12, p. 6154-6168, 2019.
1057-7149
http://hdl.handle.net/11449/209506
10.1109/TIP.2019.2925287
WOS:000575374700009
url http://dx.doi.org/10.1109/TIP.2019.2925287
http://hdl.handle.net/11449/209506
identifier_str_mv Ieee Transactions On Image Processing. Piscataway: Ieee-inst Electrical Electronics Engineers Inc, v. 28, n. 12, p. 6154-6168, 2019.
1057-7149
10.1109/TIP.2019.2925287
WOS:000575374700009
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv Ieee Transactions On Image Processing
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv 6154-6168
dc.publisher.none.fl_str_mv Ieee-inst Electrical Electronics Engineers Inc
publisher.none.fl_str_mv Ieee-inst Electrical Electronics Engineers Inc
dc.source.none.fl_str_mv Web of Science
reponame:Repositório Institucional da UNESP
instname:Universidade Estadual Paulista (UNESP)
instacron:UNESP
instname_str Universidade Estadual Paulista (UNESP)
instacron_str UNESP
institution UNESP
reponame_str Repositório Institucional da UNESP
collection Repositório Institucional da UNESP
repository.name.fl_str_mv Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)
repository.mail.fl_str_mv
_version_ 1803045783283433472