Centralised monitoring and alerting solution for complex information management infrastructure

Detalhes bibliográficos
Autor(a) principal: Binev, Yuri Ivanov
Data de Publicação: 2021
Tipo de documento: Dissertação
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: http://hdl.handle.net/10362/112992
Resumo: Internship Report presented as the partial requirement for obtaining a Master's degree in Data Science and Advanced Analytics
id RCAP_23a7cc575692f89359e41e912f8b54b4
oai_identifier_str oai:run.unl.pt:10362/112992
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling Centralised monitoring and alerting solution for complex information management infrastructureMonitoring and AlertingVisualizationBig dataTime seriesPrometheusGrafanaAlert ManagerInternship Report presented as the partial requirement for obtaining a Master's degree in Data Science and Advanced AnalyticsMonitoring and alerting receive increasing attention over the last years together with growth of the information generated and managed from one side and increasing of the computing power and capacity of the computing hardware. Monitoring solutions have been tightly linked to the software being monitored making the broad view of the performance of the all interlinked services too complex and ineffective. In this work a monitoring and alerting solution based on “Prometheus” is developed. Continuous collection of metrics from various different services is performed and organized for visualization and monitoring in several layers of precision. Different exporters for various systems were evaluated and many of them enhanced. Alerting logic in response of detected performance problems and function irregularities has been developed and implemented with “Alert Manager”. Another software is developed for recording and visualizing current or past alerts and also is used as debugging tool of the alerts configuration. Visualization is implemented for Grafana with several dashboards. All tools and software packages used for implementing this monitoring and alerting solution are open source and free to use.Pinheiro, Flávio Luís PortasCarvalho, FredericoCamelo, Filipe VasquesRUNBinev, Yuri Ivanov2021-03-03T19:35:08Z2021-01-252021-01-25T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisapplication/pdfhttp://hdl.handle.net/10362/112992TID:202658171enginfo:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2024-03-11T04:56:17Zoai:run.unl.pt:10362/112992Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-20T03:42:15.645164Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv Centralised monitoring and alerting solution for complex information management infrastructure
title Centralised monitoring and alerting solution for complex information management infrastructure
spellingShingle Centralised monitoring and alerting solution for complex information management infrastructure
Binev, Yuri Ivanov
Monitoring and Alerting
Visualization
Big data
Time series
Prometheus
Grafana
Alert Manager
title_short Centralised monitoring and alerting solution for complex information management infrastructure
title_full Centralised monitoring and alerting solution for complex information management infrastructure
title_fullStr Centralised monitoring and alerting solution for complex information management infrastructure
title_full_unstemmed Centralised monitoring and alerting solution for complex information management infrastructure
title_sort Centralised monitoring and alerting solution for complex information management infrastructure
author Binev, Yuri Ivanov
author_facet Binev, Yuri Ivanov
author_role author
dc.contributor.none.fl_str_mv Pinheiro, Flávio Luís Portas
Carvalho, Frederico
Camelo, Filipe Vasques
RUN
dc.contributor.author.fl_str_mv Binev, Yuri Ivanov
dc.subject.por.fl_str_mv Monitoring and Alerting
Visualization
Big data
Time series
Prometheus
Grafana
Alert Manager
topic Monitoring and Alerting
Visualization
Big data
Time series
Prometheus
Grafana
Alert Manager
description Internship Report presented as the partial requirement for obtaining a Master's degree in Data Science and Advanced Analytics
publishDate 2021
dc.date.none.fl_str_mv 2021-03-03T19:35:08Z
2021-01-25
2021-01-25T00:00:00Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10362/112992
TID:202658171
url http://hdl.handle.net/10362/112992
identifier_str_mv TID:202658171
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799138034362351616