CMS distributed data analysis with CRAB3
Main Author: | |
---|---|
Publication Date: | 2015 |
Other Authors: | , , , , , , , , , , , , , , |
Format: | Conference object |
Language: | eng |
Source: | Repositório Institucional da UNESP |
Download full: | http://dx.doi.org/10.1088/1742-6596/664/6/062038 http://hdl.handle.net/11449/168526 |
Summary: | The CMS Remote Analysis Builder (CRAB) is a distributed workflow management tool which facilitates analysis tasks by isolating users from the technical details of the Grid infrastructure. Throughout LHC Run 1, CRAB has been successfully employed by an average of 350 distinct users each week executing about 200,000 jobs per day. CRAB has been significantly upgraded in order to face the new challenges posed by LHC Run 2. Components of the new system include 1) a lightweight client, 2) a central primary server which communicates with the clients through a REST interface, 3) secondary servers which manage user analysis tasks and submit jobs to the CMS resource provisioning system, and 4) a central service to asynchronously move user data from temporary storage in the execution site to the desired storage location. The new system improves the robustness, scalability and sustainability of the service. Here we provide an overview of the new system, operation, and user support, report on its current status, and identify lessons learned from the commissioning phase and production roll-out. |
id |
UNSP_d38c1ae31272019f1064484988790ba3 |
---|---|
oai_identifier_str |
oai:repositorio.unesp.br:11449/168526 |
network_acronym_str |
UNSP |
network_name_str |
Repositório Institucional da UNESP |
repository_id_str |
2946 |
spelling |
CMS distributed data analysis with CRAB3The CMS Remote Analysis Builder (CRAB) is a distributed workflow management tool which facilitates analysis tasks by isolating users from the technical details of the Grid infrastructure. Throughout LHC Run 1, CRAB has been successfully employed by an average of 350 distinct users each week executing about 200,000 jobs per day. CRAB has been significantly upgraded in order to face the new challenges posed by LHC Run 2. Components of the new system include 1) a lightweight client, 2) a central primary server which communicates with the clients through a REST interface, 3) secondary servers which manage user analysis tasks and submit jobs to the CMS resource provisioning system, and 4) a central service to asynchronously move user data from temporary storage in the execution site to the desired storage location. The new system improves the robustness, scalability and sustainability of the service. Here we provide an overview of the new system, operation, and user support, report on its current status, and identify lessons learned from the commissioning phase and production roll-out.Universita e INFN Sezione di Milano-BicoccaVilnius UniversityUniversita e INFN Sezione di TriesteUniversity of Nebraska-LincolnCIEMATUniversita e INFN Sezione di PerugiaBulgarian Academy of SciencesUNESP - Universidade Estadual PaulistaUniversity of MalayaVanderbilt UniversityCERNUniversity of California San DiegoUniversity of Notre DameFNALUNESP - Universidade Estadual PaulistaSezione di Milano-BicoccaVilnius UniversitySezione di TriesteUniversity of Nebraska-LincolnCIEMATSezione di PerugiaBulgarian Academy of SciencesUniversidade Estadual Paulista (Unesp)University of MalayaVanderbilt UniversityCERNUniversity of California San DiegoUniversity of Notre DameFNALMascheroni, M.Balcas, J.Belforte, S.Bockelman, B. P.Hernandez, J. M.Ciangottini, D.Konstantinov, P. B.Silva, J. M.D. [UNESP]Ali, M. A.B.M.Melo, A. M.Riahi, H.Tanasijczuk, A. J.Yusli, M. N.B.Wolf, M.Woodard, A. E.Vaandering, E.2018-12-11T16:41:38Z2018-12-11T16:41:38Z2015-01-01info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/conferenceObjectapplication/pdfhttp://dx.doi.org/10.1088/1742-6596/664/6/062038Journal of Physics: Conference Series, v. 664, n. 6, 2015.1742-65961742-6588http://hdl.handle.net/11449/16852610.1088/1742-6596/664/6/0620382-s2.0-849622513862-s2.0-84962251386.pdfScopusreponame:Repositório Institucional da UNESPinstname:Universidade Estadual Paulista (UNESP)instacron:UNESPengJournal of Physics: Conference Series0,2410,241info:eu-repo/semantics/openAccess2023-11-20T06:09:56Zoai:repositorio.unesp.br:11449/168526Repositório InstitucionalPUBhttp://repositorio.unesp.br/oai/requestopendoar:29462023-11-20T06:09:56Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)false |
dc.title.none.fl_str_mv |
CMS distributed data analysis with CRAB3 |
title |
CMS distributed data analysis with CRAB3 |
spellingShingle |
CMS distributed data analysis with CRAB3 Mascheroni, M. |
title_short |
CMS distributed data analysis with CRAB3 |
title_full |
CMS distributed data analysis with CRAB3 |
title_fullStr |
CMS distributed data analysis with CRAB3 |
title_full_unstemmed |
CMS distributed data analysis with CRAB3 |
title_sort |
CMS distributed data analysis with CRAB3 |
author |
Mascheroni, M. |
author_facet |
Mascheroni, M. Balcas, J. Belforte, S. Bockelman, B. P. Hernandez, J. M. Ciangottini, D. Konstantinov, P. B. Silva, J. M.D. [UNESP] Ali, M. A.B.M. Melo, A. M. Riahi, H. Tanasijczuk, A. J. Yusli, M. N.B. Wolf, M. Woodard, A. E. Vaandering, E. |
author_role |
author |
author2 |
Balcas, J. Belforte, S. Bockelman, B. P. Hernandez, J. M. Ciangottini, D. Konstantinov, P. B. Silva, J. M.D. [UNESP] Ali, M. A.B.M. Melo, A. M. Riahi, H. Tanasijczuk, A. J. Yusli, M. N.B. Wolf, M. Woodard, A. E. Vaandering, E. |
author2_role |
author author author author author author author author author author author author author author author |
dc.contributor.none.fl_str_mv |
Sezione di Milano-Bicocca Vilnius University Sezione di Trieste University of Nebraska-Lincoln CIEMAT Sezione di Perugia Bulgarian Academy of Sciences Universidade Estadual Paulista (Unesp) University of Malaya Vanderbilt University CERN University of California San Diego University of Notre Dame FNAL |
dc.contributor.author.fl_str_mv |
Mascheroni, M. Balcas, J. Belforte, S. Bockelman, B. P. Hernandez, J. M. Ciangottini, D. Konstantinov, P. B. Silva, J. M.D. [UNESP] Ali, M. A.B.M. Melo, A. M. Riahi, H. Tanasijczuk, A. J. Yusli, M. N.B. Wolf, M. Woodard, A. E. Vaandering, E. |
description |
The CMS Remote Analysis Builder (CRAB) is a distributed workflow management tool which facilitates analysis tasks by isolating users from the technical details of the Grid infrastructure. Throughout LHC Run 1, CRAB has been successfully employed by an average of 350 distinct users each week executing about 200,000 jobs per day. CRAB has been significantly upgraded in order to face the new challenges posed by LHC Run 2. Components of the new system include 1) a lightweight client, 2) a central primary server which communicates with the clients through a REST interface, 3) secondary servers which manage user analysis tasks and submit jobs to the CMS resource provisioning system, and 4) a central service to asynchronously move user data from temporary storage in the execution site to the desired storage location. The new system improves the robustness, scalability and sustainability of the service. Here we provide an overview of the new system, operation, and user support, report on its current status, and identify lessons learned from the commissioning phase and production roll-out. |
publishDate |
2015 |
dc.date.none.fl_str_mv |
2015-01-01 2018-12-11T16:41:38Z 2018-12-11T16:41:38Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/conferenceObject |
format |
conferenceObject |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
http://dx.doi.org/10.1088/1742-6596/664/6/062038 Journal of Physics: Conference Series, v. 664, n. 6, 2015. 1742-6596 1742-6588 http://hdl.handle.net/11449/168526 10.1088/1742-6596/664/6/062038 2-s2.0-84962251386 2-s2.0-84962251386.pdf |
url |
http://dx.doi.org/10.1088/1742-6596/664/6/062038 http://hdl.handle.net/11449/168526 |
identifier_str_mv |
Journal of Physics: Conference Series, v. 664, n. 6, 2015. 1742-6596 1742-6588 10.1088/1742-6596/664/6/062038 2-s2.0-84962251386 2-s2.0-84962251386.pdf |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.relation.none.fl_str_mv |
Journal of Physics: Conference Series 0,241 0,241 |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
application/pdf |
dc.source.none.fl_str_mv |
Scopus reponame:Repositório Institucional da UNESP instname:Universidade Estadual Paulista (UNESP) instacron:UNESP |
instname_str |
Universidade Estadual Paulista (UNESP) |
instacron_str |
UNESP |
institution |
UNESP |
reponame_str |
Repositório Institucional da UNESP |
collection |
Repositório Institucional da UNESP |
repository.name.fl_str_mv |
Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP) |
repository.mail.fl_str_mv |
|
_version_ |
1797789760540901376 |