DES science portal: Creating science-ready catalogs
Autor(a) principal: | |
---|---|
Data de Publicação: | 2018 |
Outros Autores: | , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , |
Tipo de documento: | Artigo |
Idioma: | eng |
Título da fonte: | Repositório Institucional da UNESP |
Texto Completo: | http://dx.doi.org/10.1016/j.ascom.2018.01.002 http://hdl.handle.net/11449/176510 |
Resumo: | We present a novel approach for creating science-ready catalogs through a software infrastructure developed for the Dark Energy Survey (DES). We integrate the data products released by the DES Data Management and additional products created by the DES collaboration in an environment known as DES Science Portal. Each step involved in the creation of a science-ready catalog is recorded in a relational database and can be recovered at any time. We describe how the DES Science Portal automates the creation and characterization of lightweight catalogs for DES Year 1 Annual Release, and show its flexibility in creating multiple catalogs with different inputs and configurations. Finally, we discuss the advantages of this infrastructure for large surveys such as DES and the Large Synoptic Survey Telescope. The capability of creating science-ready catalogs efficiently and with full control of the inputs and configurations used is an important asset for supporting science analysis using data from large astronomical surveys. |
id |
UNSP_a7427d4781ed56bb4c38eb08186aedba |
---|---|
oai_identifier_str |
oai:repositorio.unesp.br:11449/176510 |
network_acronym_str |
UNSP |
network_name_str |
Repositório Institucional da UNESP |
repository_id_str |
2946 |
spelling |
DES science portal: Creating science-ready catalogsAstronomical databasesCatalogsData analysisSurveys—methodsWe present a novel approach for creating science-ready catalogs through a software infrastructure developed for the Dark Energy Survey (DES). We integrate the data products released by the DES Data Management and additional products created by the DES collaboration in an environment known as DES Science Portal. Each step involved in the creation of a science-ready catalog is recorded in a relational database and can be recovered at any time. We describe how the DES Science Portal automates the creation and characterization of lightweight catalogs for DES Year 1 Annual Release, and show its flexibility in creating multiple catalogs with different inputs and configurations. Finally, we discuss the advantages of this infrastructure for large surveys such as DES and the Large Synoptic Survey Telescope. The capability of creating science-ready catalogs efficiently and with full control of the inputs and configurations used is an important asset for supporting science analysis using data from large astronomical surveys.Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)National Science FoundationMinisterio de Economía y CompetitividadLaboratório Interinstitucional de e-Astronomia - LIneA, Rua General José Cristino, 77LSST Project Management OfficeObservatório Nacional, Rua General José Cristino, 77Instituto de Física Gleb Wataghin Universidade Estadual de Campinas, Campinas, SPInstituto de Física Universidade Federal do Rio Grande do Sul, Caixa Postal 15051, Porto Alegre, RS - 91501-970IFT-UNESP & ICTP-SAIFRCentro Federal de Educação Tecnológica Celso Suckow da Fonseca - CEFET/RJ, Av. Maracanã, 229, Rio de Janeiro, RJ, 20271-110Cerro Tololo Inter-American Observatory National Optical Astronomy ObservatoryDepartment of Physics & Astronomy University College London, Gower Street, LondonDepartment of Physics and Electronics Rhodes University, PO Box 94Fermi National Accelerator Laboratory, P.O. Box 500CNRS UMR 7095 Institut d'Astrophysique de ParisSorbonne Universités UPMC Univ Paris 06 UMR 7095 Institut d'Astrophysique de ParisInstitute of Cosmology & Gravitation University of PortsmouthDepartment of Astronomy University of Illinois, 1002 W. Green StreetNational Center for Supercomputing Applications, 1205 West Clark St., UrbanaInstitut de Física d'Altes Energies (IFAE) The Barcelona Institute of Science and Technology, Campus UAB, 08193 Bellaterra (Barcelona)Department of Physics and Astronomy University of PennsylvaniaDepartment of Physics, IIT Hyderabad, KandiDepartment of Astronomy University of MichiganDepartment of Physics University of MichiganInstitut de Ciències de l'Espai IEEC-CSIC Campus UAB Carrer de Can Magrans, s/n, 08193 BellaterraInstituto de Fisica Teorica UAM/CSIC Universidad Autonoma de MadridCenter for Cosmology and Astro-Particle Physics The Ohio State UniversityDepartment of Physics The Ohio State UniversityAstronomy Department University of Washington, Box 351580, SeattleDepartment of Physics University of California, 1156 High St. Santa CruzSanta Cruz Institute for Particle Physics University of California, 1156 High St. Santa CruzAustralian Astronomical Observatory, North RydeArgonne National Laboratory, 9700 South Cass AvenueDepartamento de Física Matemática Instituto de Física Universidade de São Paulo, CP 66318, São Paulo, SP, 05314-970George P. and Cynthia Woods Mitchell Institute for Fundamental Physics and Astronomy Department of Physics and Astronomy Texas A&M University College StationDepartment of Astrophysical Sciences Princeton University, Peyton Hall, PrincetonJet Propulsion Laboratory California Institute of Technology, 4800 Oak Grove Dr., PasadenaCentro de Investigaciones Energéticas Medioambientales y Tecnológicas (CIEMAT)SLAC National Accelerator Laboratory, Menlo ParkSchool of Physics and Astronomy University of SouthamptonComputer Science and Mathematics Division Oak Ridge National LaboratoryIFT-UNESP & ICTP-SAIFRCNPq: 157684/2015-6National Science Foundation: AST-1138766National Science Foundation: AST-1536171Ministerio de Economía y Competitividad: AYA2015-71825Ministerio de Economía y Competitividad: ESP2015-88861Ministerio de Economía y Competitividad: FPA2015-68048Ministerio de Economía y Competitividad: MDM-2015-0509Ministerio de Economía y Competitividad: SEV-2012-0234Ministerio de Economía y Competitividad: SEV-2016-0597Laboratório Interinstitucional de e-Astronomia - LIneALSST Project Management OfficeObservatório NacionalUniversidade Estadual de Campinas (UNICAMP)Universidade Federal do Rio Grande do SulUniversidade Estadual Paulista (Unesp)Centro Federal de Educação Tecnológica Celso Suckow da Fonseca - CEFET/RJNational Optical Astronomy ObservatoryUniversity College LondonRhodes UniversityFermi National Accelerator LaboratoryInstitut d'Astrophysique de ParisUniversity of PortsmouthUniversity of IllinoisNational Center for Supercomputing ApplicationsThe Barcelona Institute of Science and TechnologyUniversity of PennsylvaniaUniversity of MichiganCarrer de Can MagransUniversidad Autonoma de MadridThe Ohio State UniversityUniversity of WashingtonUniversity of CaliforniaAustralian Astronomical ObservatoryArgonne National LaboratoryUniversidade de São Paulo (USP)College StationPrinceton UniversityCalifornia Institute of TechnologyMedioambientales y Tecnológicas (CIEMAT)SLAC National Accelerator LaboratoryUniversity of SouthamptonOak Ridge National LaboratoryFausti Neto, A.da Costa, L. N.Carnero, A.Gschwend, J.Ogando, R. L.C.Sobreira, F.Maia, M. A.G.Santiago, B. X.Rosenfeld, R. [UNESP]Singulani, C.Adean, C.Nunes, L. D.P.Campisano, R.Brito, R.Soares, G.Vila-Verde, G. C.Abbott, T. M.C.Abdalla, F. B.Allam, S.Benoit-Lévy, A.Brooks, D.Buckley-Geer, E.Capozzi, D.Carrasco Kind, M.Carretero, J.D'Andrea, C. B.Desai, S.Doel, P.Drlica-Wagner, A.Evrard, A. E.Fosalba, P.García-Bellido, J.Gerdes, D. W.Gruendl, R. A.Gutierrez, G.Honscheid, K.James, D. J.Jeltema, T. E.Kuehn, K.Kuhlmann, S.Kuropatkin, N.Lahav, O.Lima, M.Marshall, J. L.Melchior, P.Menanteau, F.Plazas, A.Sanchez, E.Scarpine, V.Schindler, R.Schubnell, M.Sevilla-Noarbe, I.Smith, M.Smith, R. C.Suchyta, E.Swanson, M. E.C.Tarle, G.Walker, A. R.2018-12-11T17:21:04Z2018-12-11T17:21:04Z2018-07-01info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/article52-69application/pdfhttp://dx.doi.org/10.1016/j.ascom.2018.01.002Astronomy and Computing, v. 24, p. 52-69.2213-1337http://hdl.handle.net/11449/17651010.1016/j.ascom.2018.01.0022-s2.0-850491173082-s2.0-85049117308.pdfScopusreponame:Repositório Institucional da UNESPinstname:Universidade Estadual Paulista (UNESP)instacron:UNESPengAstronomy and Computing1,597info:eu-repo/semantics/openAccess2024-01-14T06:23:42Zoai:repositorio.unesp.br:11449/176510Repositório InstitucionalPUBhttp://repositorio.unesp.br/oai/requestopendoar:29462024-08-05T22:58:14.381568Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)false |
dc.title.none.fl_str_mv |
DES science portal: Creating science-ready catalogs |
title |
DES science portal: Creating science-ready catalogs |
spellingShingle |
DES science portal: Creating science-ready catalogs Fausti Neto, A. Astronomical databases Catalogs Data analysis Surveys—methods |
title_short |
DES science portal: Creating science-ready catalogs |
title_full |
DES science portal: Creating science-ready catalogs |
title_fullStr |
DES science portal: Creating science-ready catalogs |
title_full_unstemmed |
DES science portal: Creating science-ready catalogs |
title_sort |
DES science portal: Creating science-ready catalogs |
author |
Fausti Neto, A. |
author_facet |
Fausti Neto, A. da Costa, L. N. Carnero, A. Gschwend, J. Ogando, R. L.C. Sobreira, F. Maia, M. A.G. Santiago, B. X. Rosenfeld, R. [UNESP] Singulani, C. Adean, C. Nunes, L. D.P. Campisano, R. Brito, R. Soares, G. Vila-Verde, G. C. Abbott, T. M.C. Abdalla, F. B. Allam, S. Benoit-Lévy, A. Brooks, D. Buckley-Geer, E. Capozzi, D. Carrasco Kind, M. Carretero, J. D'Andrea, C. B. Desai, S. Doel, P. Drlica-Wagner, A. Evrard, A. E. Fosalba, P. García-Bellido, J. Gerdes, D. W. Gruendl, R. A. Gutierrez, G. Honscheid, K. James, D. J. Jeltema, T. E. Kuehn, K. Kuhlmann, S. Kuropatkin, N. Lahav, O. Lima, M. Marshall, J. L. Melchior, P. Menanteau, F. Plazas, A. Sanchez, E. Scarpine, V. Schindler, R. Schubnell, M. Sevilla-Noarbe, I. Smith, M. Smith, R. C. Suchyta, E. Swanson, M. E.C. Tarle, G. Walker, A. R. |
author_role |
author |
author2 |
da Costa, L. N. Carnero, A. Gschwend, J. Ogando, R. L.C. Sobreira, F. Maia, M. A.G. Santiago, B. X. Rosenfeld, R. [UNESP] Singulani, C. Adean, C. Nunes, L. D.P. Campisano, R. Brito, R. Soares, G. Vila-Verde, G. C. Abbott, T. M.C. Abdalla, F. B. Allam, S. Benoit-Lévy, A. Brooks, D. Buckley-Geer, E. Capozzi, D. Carrasco Kind, M. Carretero, J. D'Andrea, C. B. Desai, S. Doel, P. Drlica-Wagner, A. Evrard, A. E. Fosalba, P. García-Bellido, J. Gerdes, D. W. Gruendl, R. A. Gutierrez, G. Honscheid, K. James, D. J. Jeltema, T. E. Kuehn, K. Kuhlmann, S. Kuropatkin, N. Lahav, O. Lima, M. Marshall, J. L. Melchior, P. Menanteau, F. Plazas, A. Sanchez, E. Scarpine, V. Schindler, R. Schubnell, M. Sevilla-Noarbe, I. Smith, M. Smith, R. C. Suchyta, E. Swanson, M. E.C. Tarle, G. Walker, A. R. |
author2_role |
author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author author |
dc.contributor.none.fl_str_mv |
Laboratório Interinstitucional de e-Astronomia - LIneA LSST Project Management Office Observatório Nacional Universidade Estadual de Campinas (UNICAMP) Universidade Federal do Rio Grande do Sul Universidade Estadual Paulista (Unesp) Centro Federal de Educação Tecnológica Celso Suckow da Fonseca - CEFET/RJ National Optical Astronomy Observatory University College London Rhodes University Fermi National Accelerator Laboratory Institut d'Astrophysique de Paris University of Portsmouth University of Illinois National Center for Supercomputing Applications The Barcelona Institute of Science and Technology University of Pennsylvania University of Michigan Carrer de Can Magrans Universidad Autonoma de Madrid The Ohio State University University of Washington University of California Australian Astronomical Observatory Argonne National Laboratory Universidade de São Paulo (USP) College Station Princeton University California Institute of Technology Medioambientales y Tecnológicas (CIEMAT) SLAC National Accelerator Laboratory University of Southampton Oak Ridge National Laboratory |
dc.contributor.author.fl_str_mv |
Fausti Neto, A. da Costa, L. N. Carnero, A. Gschwend, J. Ogando, R. L.C. Sobreira, F. Maia, M. A.G. Santiago, B. X. Rosenfeld, R. [UNESP] Singulani, C. Adean, C. Nunes, L. D.P. Campisano, R. Brito, R. Soares, G. Vila-Verde, G. C. Abbott, T. M.C. Abdalla, F. B. Allam, S. Benoit-Lévy, A. Brooks, D. Buckley-Geer, E. Capozzi, D. Carrasco Kind, M. Carretero, J. D'Andrea, C. B. Desai, S. Doel, P. Drlica-Wagner, A. Evrard, A. E. Fosalba, P. García-Bellido, J. Gerdes, D. W. Gruendl, R. A. Gutierrez, G. Honscheid, K. James, D. J. Jeltema, T. E. Kuehn, K. Kuhlmann, S. Kuropatkin, N. Lahav, O. Lima, M. Marshall, J. L. Melchior, P. Menanteau, F. Plazas, A. Sanchez, E. Scarpine, V. Schindler, R. Schubnell, M. Sevilla-Noarbe, I. Smith, M. Smith, R. C. Suchyta, E. Swanson, M. E.C. Tarle, G. Walker, A. R. |
dc.subject.por.fl_str_mv |
Astronomical databases Catalogs Data analysis Surveys—methods |
topic |
Astronomical databases Catalogs Data analysis Surveys—methods |
description |
We present a novel approach for creating science-ready catalogs through a software infrastructure developed for the Dark Energy Survey (DES). We integrate the data products released by the DES Data Management and additional products created by the DES collaboration in an environment known as DES Science Portal. Each step involved in the creation of a science-ready catalog is recorded in a relational database and can be recovered at any time. We describe how the DES Science Portal automates the creation and characterization of lightweight catalogs for DES Year 1 Annual Release, and show its flexibility in creating multiple catalogs with different inputs and configurations. Finally, we discuss the advantages of this infrastructure for large surveys such as DES and the Large Synoptic Survey Telescope. The capability of creating science-ready catalogs efficiently and with full control of the inputs and configurations used is an important asset for supporting science analysis using data from large astronomical surveys. |
publishDate |
2018 |
dc.date.none.fl_str_mv |
2018-12-11T17:21:04Z 2018-12-11T17:21:04Z 2018-07-01 |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/article |
format |
article |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
http://dx.doi.org/10.1016/j.ascom.2018.01.002 Astronomy and Computing, v. 24, p. 52-69. 2213-1337 http://hdl.handle.net/11449/176510 10.1016/j.ascom.2018.01.002 2-s2.0-85049117308 2-s2.0-85049117308.pdf |
url |
http://dx.doi.org/10.1016/j.ascom.2018.01.002 http://hdl.handle.net/11449/176510 |
identifier_str_mv |
Astronomy and Computing, v. 24, p. 52-69. 2213-1337 10.1016/j.ascom.2018.01.002 2-s2.0-85049117308 2-s2.0-85049117308.pdf |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.relation.none.fl_str_mv |
Astronomy and Computing 1,597 |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
52-69 application/pdf |
dc.source.none.fl_str_mv |
Scopus reponame:Repositório Institucional da UNESP instname:Universidade Estadual Paulista (UNESP) instacron:UNESP |
instname_str |
Universidade Estadual Paulista (UNESP) |
instacron_str |
UNESP |
institution |
UNESP |
reponame_str |
Repositório Institucional da UNESP |
collection |
Repositório Institucional da UNESP |
repository.name.fl_str_mv |
Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP) |
repository.mail.fl_str_mv |
|
_version_ |
1808129478178635776 |