Métodos de primeira ordem acelerados

Detalhes bibliográficos
Autor(a) principal: Ribeiro, Douglas Nascimento
Data de Publicação: 2022
Tipo de documento: Dissertação
Idioma: por
Título da fonte: Repositório Institucional da UFG
dARK ID: ark:/38995/0013000004v6m
Texto Completo: http://repositorio.bc.ufg.br/tede/handle/tede/12377
Resumo: The analysis of the efficiency of algorithms to solve optimization problems is fundamental for the improvement and design of algorithms with better computational performances. Such efficiency can be measured, for example, by the “speed” in which the sequence generated by the algorithm converges to a solution of the problem at hand. From the work of Nesterov and Nemirovski in the 80's, the efficiency of an algorithm was also considered through its iteration complexity, that is, the number of iterations necessary to obtain an "approximate solution" for the problem. In this work, we will analyze the iteration complexity of the algorithms: Iterative Shrinkage-Thresholding (ISTA), Fast Iterative Shrinkage-Thresholding (FISTA) and an accelerated Forward-Backward Nesterov type method. This study will be be carried out from a theoretical and computational point of view.
id UFG-2_6ece56bdd00e12a6a7de98831be46f46
oai_identifier_str oai:repositorio.bc.ufg.br:tede/12377
network_acronym_str UFG-2
network_name_str Repositório Institucional da UFG
repository_id_str
spelling Melo, Jefferson Divino Gonçalves dehttp://lattes.cnpq.br/8296171010616435Melo, Jefferson Divino Gonçalves deAlves, Maicon MarquesGonçalves, Max Leandro NobreFerreira, Orizon Pereirahttp://lattes.cnpq.br/7276599246999990Ribeiro, Douglas Nascimento2022-10-18T13:04:16Z2022-10-18T13:04:16Z2022-08-18RIBEIRO, D. N. Métodos de primeira ordem acelerados. 2022. 70 f. Dissertação (Mestrado em Matemática) - Universidade Federal de Goiás, Goiânia, 2022.http://repositorio.bc.ufg.br/tede/handle/tede/12377ark:/38995/0013000004v6mThe analysis of the efficiency of algorithms to solve optimization problems is fundamental for the improvement and design of algorithms with better computational performances. Such efficiency can be measured, for example, by the “speed” in which the sequence generated by the algorithm converges to a solution of the problem at hand. From the work of Nesterov and Nemirovski in the 80's, the efficiency of an algorithm was also considered through its iteration complexity, that is, the number of iterations necessary to obtain an "approximate solution" for the problem. In this work, we will analyze the iteration complexity of the algorithms: Iterative Shrinkage-Thresholding (ISTA), Fast Iterative Shrinkage-Thresholding (FISTA) and an accelerated Forward-Backward Nesterov type method. This study will be be carried out from a theoretical and computational point of view.A análise da eficiência de algoritmos para resolver problemas de otimização é fundamental para o aprimoramento e elaboração de algoritmos com melhor desempenho computacional. Tal eficiência pode ser mensurada, por exemplo, pela “velocidade” com que a sequência gerada pelo algoritmo converge para uma solução do problema em questão, ou seja, a taxa de convergência assintótica (convergência sublinear, linear ou quadrática, etc). A partir dos trabalhos de Nesterov e Nemirovski na década de 80, a eficiência de um algoritmo passou também a ser considerada por meio de sua complexidade por iteração, isto é, o número de iterações necessárias para obter uma “solução aproximada” do problema de interesse. Neste trabalho, iremos analisar a complexidade por iteração dos algoritmos Iterative Shrinkage-Thresholding (ISTA), Fast Iterative Shrinkage-Thresholding (FISTA) e um método acelerado Forward-Backward de Nesterov. Este estudo será feito do ponto de vista teórico e computacional.Submitted by Marlene Santos (marlene.bc.ufg@gmail.com) on 2022-10-17T18:58:58Z No. of bitstreams: 2 Dissertação - Douglas Nascimento Ribeiro - 2022.pdf: 4065145 bytes, checksum: ead4d4137507c781c517227d1fce7470 (MD5) license_rdf: 805 bytes, checksum: 4460e5956bc1d1639be9ae6146a50347 (MD5)Approved for entry into archive by Luciana Ferreira (lucgeral@gmail.com) on 2022-10-18T13:04:16Z (GMT) No. of bitstreams: 2 Dissertação - Douglas Nascimento Ribeiro - 2022.pdf: 4065145 bytes, checksum: ead4d4137507c781c517227d1fce7470 (MD5) license_rdf: 805 bytes, checksum: 4460e5956bc1d1639be9ae6146a50347 (MD5)Made available in DSpace on 2022-10-18T13:04:16Z (GMT). No. of bitstreams: 2 Dissertação - Douglas Nascimento Ribeiro - 2022.pdf: 4065145 bytes, checksum: ead4d4137507c781c517227d1fce7470 (MD5) license_rdf: 805 bytes, checksum: 4460e5956bc1d1639be9ae6146a50347 (MD5) Previous issue date: 2022-08-18OutroporUniversidade Federal de GoiásPrograma de Pós-graduação em Matemática (IME)UFGBrasilInstituto de Matemática e Estatística - IME (RG)Attribution-NonCommercial-NoDerivatives 4.0 Internationalhttp://creativecommons.org/licenses/by-nc-nd/4.0/info:eu-repo/semantics/openAccessISTAFISTAMétodo acelerado forward – backwardComplexidade por iteraçãoAccelerated forward – backwardIteration complexityCIENCIAS EXATAS E DA TERRA::MATEMATICA::MATEMATICA APLICADAMétodos de primeira ordem aceleradosAccelerated first oder methodsinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesis70500500500500277955reponame:Repositório Institucional da UFGinstname:Universidade Federal de Goiás (UFG)instacron:UFGLICENSElicense.txtlicense.txttext/plain; charset=utf-81748http://repositorio.bc.ufg.br/tede/bitstreams/84a519f6-5339-4063-a887-00a47812cbd6/download8a4605be74aa9ea9d79846c1fba20a33MD51CC-LICENSElicense_rdflicense_rdfapplication/rdf+xml; charset=utf-8805http://repositorio.bc.ufg.br/tede/bitstreams/b3b32e12-bd1a-4630-abef-7357e5cdeb00/download4460e5956bc1d1639be9ae6146a50347MD52ORIGINALDissertação - Douglas Nascimento Ribeiro - 2022.pdfDissertação - Douglas Nascimento Ribeiro - 2022.pdfapplication/pdf4065145http://repositorio.bc.ufg.br/tede/bitstreams/969f871f-c039-4795-9b49-4dea68c509fc/downloadead4d4137507c781c517227d1fce7470MD53tede/123772022-10-18 10:04:16.552http://creativecommons.org/licenses/by-nc-nd/4.0/Attribution-NonCommercial-NoDerivatives 4.0 Internationalopen.accessoai:repositorio.bc.ufg.br:tede/12377http://repositorio.bc.ufg.br/tedeRepositório InstitucionalPUBhttp://repositorio.bc.ufg.br/oai/requesttasesdissertacoes.bc@ufg.bropendoar:2022-10-18T13:04:16Repositório Institucional da UFG - Universidade Federal de Goiás (UFG)falseTk9URTogUExBQ0UgWU9VUiBPV04gTElDRU5TRSBIRVJFClRoaXMgc2FtcGxlIGxpY2Vuc2UgaXMgcHJvdmlkZWQgZm9yIGluZm9ybWF0aW9uYWwgcHVycG9zZXMgb25seS4KCk5PTi1FWENMVVNJVkUgRElTVFJJQlVUSU9OIExJQ0VOU0UKCkJ5IHNpZ25pbmcgYW5kIHN1Ym1pdHRpbmcgdGhpcyBsaWNlbnNlLCB5b3UgKHRoZSBhdXRob3Iocykgb3IgY29weXJpZ2h0Cm93bmVyKSBncmFudHMgdG8gRFNwYWNlIFVuaXZlcnNpdHkgKERTVSkgdGhlIG5vbi1leGNsdXNpdmUgcmlnaHQgdG8gcmVwcm9kdWNlLAp0cmFuc2xhdGUgKGFzIGRlZmluZWQgYmVsb3cpLCBhbmQvb3IgZGlzdHJpYnV0ZSB5b3VyIHN1Ym1pc3Npb24gKGluY2x1ZGluZwp0aGUgYWJzdHJhY3QpIHdvcmxkd2lkZSBpbiBwcmludCBhbmQgZWxlY3Ryb25pYyBmb3JtYXQgYW5kIGluIGFueSBtZWRpdW0sCmluY2x1ZGluZyBidXQgbm90IGxpbWl0ZWQgdG8gYXVkaW8gb3IgdmlkZW8uCgpZb3UgYWdyZWUgdGhhdCBEU1UgbWF5LCB3aXRob3V0IGNoYW5naW5nIHRoZSBjb250ZW50LCB0cmFuc2xhdGUgdGhlCnN1Ym1pc3Npb24gdG8gYW55IG1lZGl1bSBvciBmb3JtYXQgZm9yIHRoZSBwdXJwb3NlIG9mIHByZXNlcnZhdGlvbi4KCllvdSBhbHNvIGFncmVlIHRoYXQgRFNVIG1heSBrZWVwIG1vcmUgdGhhbiBvbmUgY29weSBvZiB0aGlzIHN1Ym1pc3Npb24gZm9yCnB1cnBvc2VzIG9mIHNlY3VyaXR5LCBiYWNrLXVwIGFuZCBwcmVzZXJ2YXRpb24uCgpZb3UgcmVwcmVzZW50IHRoYXQgdGhlIHN1Ym1pc3Npb24gaXMgeW91ciBvcmlnaW5hbCB3b3JrLCBhbmQgdGhhdCB5b3UgaGF2ZQp0aGUgcmlnaHQgdG8gZ3JhbnQgdGhlIHJpZ2h0cyBjb250YWluZWQgaW4gdGhpcyBsaWNlbnNlLiBZb3UgYWxzbyByZXByZXNlbnQKdGhhdCB5b3VyIHN1Ym1pc3Npb24gZG9lcyBub3QsIHRvIHRoZSBiZXN0IG9mIHlvdXIga25vd2xlZGdlLCBpbmZyaW5nZSB1cG9uCmFueW9uZSdzIGNvcHlyaWdodC4KCklmIHRoZSBzdWJtaXNzaW9uIGNvbnRhaW5zIG1hdGVyaWFsIGZvciB3aGljaCB5b3UgZG8gbm90IGhvbGQgY29weXJpZ2h0LAp5b3UgcmVwcmVzZW50IHRoYXQgeW91IGhhdmUgb2J0YWluZWQgdGhlIHVucmVzdHJpY3RlZCBwZXJtaXNzaW9uIG9mIHRoZQpjb3B5cmlnaHQgb3duZXIgdG8gZ3JhbnQgRFNVIHRoZSByaWdodHMgcmVxdWlyZWQgYnkgdGhpcyBsaWNlbnNlLCBhbmQgdGhhdApzdWNoIHRoaXJkLXBhcnR5IG93bmVkIG1hdGVyaWFsIGlzIGNsZWFybHkgaWRlbnRpZmllZCBhbmQgYWNrbm93bGVkZ2VkCndpdGhpbiB0aGUgdGV4dCBvciBjb250ZW50IG9mIHRoZSBzdWJtaXNzaW9uLgoKSUYgVEhFIFNVQk1JU1NJT04gSVMgQkFTRUQgVVBPTiBXT1JLIFRIQVQgSEFTIEJFRU4gU1BPTlNPUkVEIE9SIFNVUFBPUlRFRApCWSBBTiBBR0VOQ1kgT1IgT1JHQU5JWkFUSU9OIE9USEVSIFRIQU4gRFNVLCBZT1UgUkVQUkVTRU5UIFRIQVQgWU9VIEhBVkUKRlVMRklMTEVEIEFOWSBSSUdIVCBPRiBSRVZJRVcgT1IgT1RIRVIgT0JMSUdBVElPTlMgUkVRVUlSRUQgQlkgU1VDSApDT05UUkFDVCBPUiBBR1JFRU1FTlQuCgpEU1Ugd2lsbCBjbGVhcmx5IGlkZW50aWZ5IHlvdXIgbmFtZShzKSBhcyB0aGUgYXV0aG9yKHMpIG9yIG93bmVyKHMpIG9mIHRoZQpzdWJtaXNzaW9uLCBhbmQgd2lsbCBub3QgbWFrZSBhbnkgYWx0ZXJhdGlvbiwgb3RoZXIgdGhhbiBhcyBhbGxvd2VkIGJ5IHRoaXMKbGljZW5zZSwgdG8geW91ciBzdWJtaXNzaW9uLgo=
dc.title.pt_BR.fl_str_mv Métodos de primeira ordem acelerados
dc.title.alternative.eng.fl_str_mv Accelerated first oder methods
title Métodos de primeira ordem acelerados
spellingShingle Métodos de primeira ordem acelerados
Ribeiro, Douglas Nascimento
ISTA
FISTA
Método acelerado forward – backward
Complexidade por iteração
Accelerated forward – backward
Iteration complexity
CIENCIAS EXATAS E DA TERRA::MATEMATICA::MATEMATICA APLICADA
title_short Métodos de primeira ordem acelerados
title_full Métodos de primeira ordem acelerados
title_fullStr Métodos de primeira ordem acelerados
title_full_unstemmed Métodos de primeira ordem acelerados
title_sort Métodos de primeira ordem acelerados
author Ribeiro, Douglas Nascimento
author_facet Ribeiro, Douglas Nascimento
author_role author
dc.contributor.advisor1.fl_str_mv Melo, Jefferson Divino Gonçalves de
dc.contributor.advisor1Lattes.fl_str_mv http://lattes.cnpq.br/8296171010616435
dc.contributor.referee1.fl_str_mv Melo, Jefferson Divino Gonçalves de
dc.contributor.referee2.fl_str_mv Alves, Maicon Marques
dc.contributor.referee3.fl_str_mv Gonçalves, Max Leandro Nobre
dc.contributor.referee4.fl_str_mv Ferreira, Orizon Pereira
dc.contributor.authorLattes.fl_str_mv http://lattes.cnpq.br/7276599246999990
dc.contributor.author.fl_str_mv Ribeiro, Douglas Nascimento
contributor_str_mv Melo, Jefferson Divino Gonçalves de
Melo, Jefferson Divino Gonçalves de
Alves, Maicon Marques
Gonçalves, Max Leandro Nobre
Ferreira, Orizon Pereira
dc.subject.por.fl_str_mv ISTA
FISTA
Método acelerado forward – backward
Complexidade por iteração
topic ISTA
FISTA
Método acelerado forward – backward
Complexidade por iteração
Accelerated forward – backward
Iteration complexity
CIENCIAS EXATAS E DA TERRA::MATEMATICA::MATEMATICA APLICADA
dc.subject.eng.fl_str_mv Accelerated forward – backward
Iteration complexity
dc.subject.cnpq.fl_str_mv CIENCIAS EXATAS E DA TERRA::MATEMATICA::MATEMATICA APLICADA
description The analysis of the efficiency of algorithms to solve optimization problems is fundamental for the improvement and design of algorithms with better computational performances. Such efficiency can be measured, for example, by the “speed” in which the sequence generated by the algorithm converges to a solution of the problem at hand. From the work of Nesterov and Nemirovski in the 80's, the efficiency of an algorithm was also considered through its iteration complexity, that is, the number of iterations necessary to obtain an "approximate solution" for the problem. In this work, we will analyze the iteration complexity of the algorithms: Iterative Shrinkage-Thresholding (ISTA), Fast Iterative Shrinkage-Thresholding (FISTA) and an accelerated Forward-Backward Nesterov type method. This study will be be carried out from a theoretical and computational point of view.
publishDate 2022
dc.date.accessioned.fl_str_mv 2022-10-18T13:04:16Z
dc.date.available.fl_str_mv 2022-10-18T13:04:16Z
dc.date.issued.fl_str_mv 2022-08-18
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.citation.fl_str_mv RIBEIRO, D. N. Métodos de primeira ordem acelerados. 2022. 70 f. Dissertação (Mestrado em Matemática) - Universidade Federal de Goiás, Goiânia, 2022.
dc.identifier.uri.fl_str_mv http://repositorio.bc.ufg.br/tede/handle/tede/12377
dc.identifier.dark.fl_str_mv ark:/38995/0013000004v6m
identifier_str_mv RIBEIRO, D. N. Métodos de primeira ordem acelerados. 2022. 70 f. Dissertação (Mestrado em Matemática) - Universidade Federal de Goiás, Goiânia, 2022.
ark:/38995/0013000004v6m
url http://repositorio.bc.ufg.br/tede/handle/tede/12377
dc.language.iso.fl_str_mv por
language por
dc.relation.program.fl_str_mv 70
dc.relation.confidence.fl_str_mv 500
500
500
500
dc.relation.department.fl_str_mv 27
dc.relation.cnpq.fl_str_mv 795
dc.relation.sponsorship.fl_str_mv 5
dc.rights.driver.fl_str_mv Attribution-NonCommercial-NoDerivatives 4.0 International
http://creativecommons.org/licenses/by-nc-nd/4.0/
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Attribution-NonCommercial-NoDerivatives 4.0 International
http://creativecommons.org/licenses/by-nc-nd/4.0/
eu_rights_str_mv openAccess
dc.publisher.none.fl_str_mv Universidade Federal de Goiás
dc.publisher.program.fl_str_mv Programa de Pós-graduação em Matemática (IME)
dc.publisher.initials.fl_str_mv UFG
dc.publisher.country.fl_str_mv Brasil
dc.publisher.department.fl_str_mv Instituto de Matemática e Estatística - IME (RG)
publisher.none.fl_str_mv Universidade Federal de Goiás
dc.source.none.fl_str_mv reponame:Repositório Institucional da UFG
instname:Universidade Federal de Goiás (UFG)
instacron:UFG
instname_str Universidade Federal de Goiás (UFG)
instacron_str UFG
institution UFG
reponame_str Repositório Institucional da UFG
collection Repositório Institucional da UFG
bitstream.url.fl_str_mv http://repositorio.bc.ufg.br/tede/bitstreams/84a519f6-5339-4063-a887-00a47812cbd6/download
http://repositorio.bc.ufg.br/tede/bitstreams/b3b32e12-bd1a-4630-abef-7357e5cdeb00/download
http://repositorio.bc.ufg.br/tede/bitstreams/969f871f-c039-4795-9b49-4dea68c509fc/download
bitstream.checksum.fl_str_mv 8a4605be74aa9ea9d79846c1fba20a33
4460e5956bc1d1639be9ae6146a50347
ead4d4137507c781c517227d1fce7470
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
MD5
repository.name.fl_str_mv Repositório Institucional da UFG - Universidade Federal de Goiás (UFG)
repository.mail.fl_str_mv tasesdissertacoes.bc@ufg.br
_version_ 1815172561410981888