A distributed platform for the volunteer execution of workflows on a local area network

Detalhes bibliográficos
Autor(a) principal: Silva, Jaquilino Lopes
Data de Publicação: 2014
Tipo de documento: Dissertação
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: http://hdl.handle.net/10362/13102
Resumo: Thesis submitted in fulfilment of the requirements for the Degree of Master of Science in Computer Science
id RCAP_a2230de1ef333b6fe2e7ecbf23ed5f62
oai_identifier_str oai:run.unl.pt:10362/13102
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling A distributed platform for the volunteer execution of workflows on a local area networkVolunteer computing systemInterdependent tasksDistributed task schedulingFault-toleranceScalabilityThesis submitted in fulfilment of the requirements for the Degree of Master of Science in Computer ScienceAlbatroz Engineering has developed a framework for over-head power lines inspection data acquisition and analysis, which includes hardware and software. The framework’s software components include inspection data analysis and reporting tools, commonly known as PLMI2 application/platform. In PLMI2, the analysis of over-head power line maintenance inspection data consists of a sequence of Automatic Tasks (ATs) interleaved with Manual Tasks (MTs). An AT consists of a set of algorithms that receives as input one or more datasets, processes them and returns new datasets. In turn, an MT enables human supervisors (also known as lines inspection operators) to correct, improve and validate the results of ATs. ATs run faster than MTs and in the overall work cycle, ATs take less than 10% of total processing time, but still take a few minutes. There is data flow dependency among tasks, which can be modelled with a workflow and even if MTs are omitted from this workflow, it is possible to carry the sequence of ATs, postponing MTs. In fact, if the computing cost and waiting time are negligible, it may be advantageous to run ATs earlier in the workflow, prior to validation. To address this opportunity, Albatroz Engineering has invested in a new procedure to stream the data through all ATs fully unattended. Considering these scenarios, it could be useful to have a system capable of detecting available workstations at a given instant and subsequently distribute the ATs to them. In this way, operators could schedule the execution of future ATs for a given inspection data, while they are performing MTs of another. The requirements of the system to implement fall within the field Volunteer Computing Systems and we will address some of the challenges posed by these kinds of systems, namely the hosts volatility and failures. Volunteer Computing is a type of distributed computing which exploits idle CPU cycles from computing resources donated by volunteers and connected through the Internet/Intranet to compute large-scale simulations. This thesis proposes and designs a new distributed task scheduling system in the context of Volunteer Computing Systems, able to schedule the ATs of PLMI2 and exploit idle CPU cycles from workstations within the company’s local area network (LAN) to accelerate the data analysis, being aware of data flow interdependencies. To evaluate the proposed system, a prototype has been implemented, and the simulations results have shown that it is scalable and supports fault-tolerance of tasks execution, by employing the rescheduling mechanism.Faculdade de Ciências e TecnologiaPaulino, HervéAzevedo, FranciscoRUNSilva, Jaquilino Lopes2014-09-11T10:44:11Z20142014-01-01T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisapplication/pdfhttp://hdl.handle.net/10362/13102enginfo:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2024-03-11T03:47:49Zoai:run.unl.pt:10362/13102Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-20T03:21:05.262936Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv A distributed platform for the volunteer execution of workflows on a local area network
title A distributed platform for the volunteer execution of workflows on a local area network
spellingShingle A distributed platform for the volunteer execution of workflows on a local area network
Silva, Jaquilino Lopes
Volunteer computing system
Interdependent tasks
Distributed task scheduling
Fault-tolerance
Scalability
title_short A distributed platform for the volunteer execution of workflows on a local area network
title_full A distributed platform for the volunteer execution of workflows on a local area network
title_fullStr A distributed platform for the volunteer execution of workflows on a local area network
title_full_unstemmed A distributed platform for the volunteer execution of workflows on a local area network
title_sort A distributed platform for the volunteer execution of workflows on a local area network
author Silva, Jaquilino Lopes
author_facet Silva, Jaquilino Lopes
author_role author
dc.contributor.none.fl_str_mv Paulino, Hervé
Azevedo, Francisco
RUN
dc.contributor.author.fl_str_mv Silva, Jaquilino Lopes
dc.subject.por.fl_str_mv Volunteer computing system
Interdependent tasks
Distributed task scheduling
Fault-tolerance
Scalability
topic Volunteer computing system
Interdependent tasks
Distributed task scheduling
Fault-tolerance
Scalability
description Thesis submitted in fulfilment of the requirements for the Degree of Master of Science in Computer Science
publishDate 2014
dc.date.none.fl_str_mv 2014-09-11T10:44:11Z
2014
2014-01-01T00:00:00Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10362/13102
url http://hdl.handle.net/10362/13102
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Faculdade de Ciências e Tecnologia
publisher.none.fl_str_mv Faculdade de Ciências e Tecnologia
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799137852009742336

Registros relacionados