DES science portal: Creating science-ready catalogs

Detalhes bibliográficos
Autor(a) principal: Fausti Neto, A.
Data de Publicação: 2018
Outros Autores: da Costa, L. N., Carnero, A., Gschwend, J., Ogando, R. L.C., Sobreira, F., Maia, M. A.G., Santiago, B. X., Rosenfeld, R. [UNESP], Singulani, C., Adean, C., Nunes, L. D.P., Campisano, R., Brito, R., Soares, G., Vila-Verde, G. C., Abbott, T. M.C., Abdalla, F. B., Allam, S., Benoit-Lévy, A., Brooks, D., Buckley-Geer, E., Capozzi, D., Carrasco Kind, M., Carretero, J., D'Andrea, C. B., Desai, S., Doel, P., Drlica-Wagner, A., Evrard, A. E., Fosalba, P., García-Bellido, J., Gerdes, D. W., Gruendl, R. A., Gutierrez, G., Honscheid, K., James, D. J., Jeltema, T. E., Kuehn, K., Kuhlmann, S., Kuropatkin, N., Lahav, O., Lima, M., Marshall, J. L., Melchior, P., Menanteau, F., Plazas, A., Sanchez, E., Scarpine, V., Schindler, R., Schubnell, M., Sevilla-Noarbe, I., Smith, M., Smith, R. C., Suchyta, E., Swanson, M. E.C., Tarle, G., Walker, A. R.
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Institucional da UNESP
Texto Completo: http://dx.doi.org/10.1016/j.ascom.2018.01.002
http://hdl.handle.net/11449/176510
Resumo: We present a novel approach for creating science-ready catalogs through a software infrastructure developed for the Dark Energy Survey (DES). We integrate the data products released by the DES Data Management and additional products created by the DES collaboration in an environment known as DES Science Portal. Each step involved in the creation of a science-ready catalog is recorded in a relational database and can be recovered at any time. We describe how the DES Science Portal automates the creation and characterization of lightweight catalogs for DES Year 1 Annual Release, and show its flexibility in creating multiple catalogs with different inputs and configurations. Finally, we discuss the advantages of this infrastructure for large surveys such as DES and the Large Synoptic Survey Telescope. The capability of creating science-ready catalogs efficiently and with full control of the inputs and configurations used is an important asset for supporting science analysis using data from large astronomical surveys.
id UNSP_a7427d4781ed56bb4c38eb08186aedba
oai_identifier_str oai:repositorio.unesp.br:11449/176510
network_acronym_str UNSP
network_name_str Repositório Institucional da UNESP
repository_id_str 2946
spelling DES science portal: Creating science-ready catalogsAstronomical databasesCatalogsData analysisSurveys—methodsWe present a novel approach for creating science-ready catalogs through a software infrastructure developed for the Dark Energy Survey (DES). We integrate the data products released by the DES Data Management and additional products created by the DES collaboration in an environment known as DES Science Portal. Each step involved in the creation of a science-ready catalog is recorded in a relational database and can be recovered at any time. We describe how the DES Science Portal automates the creation and characterization of lightweight catalogs for DES Year 1 Annual Release, and show its flexibility in creating multiple catalogs with different inputs and configurations. Finally, we discuss the advantages of this infrastructure for large surveys such as DES and the Large Synoptic Survey Telescope. The capability of creating science-ready catalogs efficiently and with full control of the inputs and configurations used is an important asset for supporting science analysis using data from large astronomical surveys.Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)National Science FoundationMinisterio de Economía y CompetitividadLaboratório Interinstitucional de e-Astronomia - LIneA, Rua General José Cristino, 77LSST Project Management OfficeObservatório Nacional, Rua General José Cristino, 77Instituto de Física Gleb Wataghin Universidade Estadual de Campinas, Campinas, SPInstituto de Física Universidade Federal do Rio Grande do Sul, Caixa Postal 15051, Porto Alegre, RS - 91501-970IFT-UNESP & ICTP-SAIFRCentro Federal de Educação Tecnológica Celso Suckow da Fonseca - CEFET/RJ, Av. Maracanã, 229, Rio de Janeiro, RJ, 20271-110Cerro Tololo Inter-American Observatory National Optical Astronomy ObservatoryDepartment of Physics & Astronomy University College London, Gower Street, LondonDepartment of Physics and Electronics Rhodes University, PO Box 94Fermi National Accelerator Laboratory, P.O. Box 500CNRS UMR 7095 Institut d'Astrophysique de ParisSorbonne Universités UPMC Univ Paris 06 UMR 7095 Institut d'Astrophysique de ParisInstitute of Cosmology & Gravitation University of PortsmouthDepartment of Astronomy University of Illinois, 1002 W. Green StreetNational Center for Supercomputing Applications, 1205 West Clark St., UrbanaInstitut de Física d'Altes Energies (IFAE) The Barcelona Institute of Science and Technology, Campus UAB, 08193 Bellaterra (Barcelona)Department of Physics and Astronomy University of PennsylvaniaDepartment of Physics, IIT Hyderabad, KandiDepartment of Astronomy University of MichiganDepartment of Physics University of MichiganInstitut de Ciències de l'Espai IEEC-CSIC Campus UAB Carrer de Can Magrans, s/n, 08193 BellaterraInstituto de Fisica Teorica UAM/CSIC Universidad Autonoma de MadridCenter for Cosmology and Astro-Particle Physics The Ohio State UniversityDepartment of Physics The Ohio State UniversityAstronomy Department University of Washington, Box 351580, SeattleDepartment of Physics University of California, 1156 High St. Santa CruzSanta Cruz Institute for Particle Physics University of California, 1156 High St. Santa CruzAustralian Astronomical Observatory, North RydeArgonne National Laboratory, 9700 South Cass AvenueDepartamento de Física Matemática Instituto de Física Universidade de São Paulo, CP 66318, São Paulo, SP, 05314-970George P. and Cynthia Woods Mitchell Institute for Fundamental Physics and Astronomy Department of Physics and Astronomy Texas A&M University College StationDepartment of Astrophysical Sciences Princeton University, Peyton Hall, PrincetonJet Propulsion Laboratory California Institute of Technology, 4800 Oak Grove Dr., PasadenaCentro de Investigaciones Energéticas Medioambientales y Tecnológicas (CIEMAT)SLAC National Accelerator Laboratory, Menlo ParkSchool of Physics and Astronomy University of SouthamptonComputer Science and Mathematics Division Oak Ridge National LaboratoryIFT-UNESP & ICTP-SAIFRCNPq: 157684/2015-6National Science Foundation: AST-1138766National Science Foundation: AST-1536171Ministerio de Economía y Competitividad: AYA2015-71825Ministerio de Economía y Competitividad: ESP2015-88861Ministerio de Economía y Competitividad: FPA2015-68048Ministerio de Economía y Competitividad: MDM-2015-0509Ministerio de Economía y Competitividad: SEV-2012-0234Ministerio de Economía y Competitividad: SEV-2016-0597Laboratório Interinstitucional de e-Astronomia - LIneALSST Project Management OfficeObservatório NacionalUniversidade Estadual de Campinas (UNICAMP)Universidade Federal do Rio Grande do SulUniversidade Estadual Paulista (Unesp)Centro Federal de Educação Tecnológica Celso Suckow da Fonseca - CEFET/RJNational Optical Astronomy ObservatoryUniversity College LondonRhodes UniversityFermi National Accelerator LaboratoryInstitut d'Astrophysique de ParisUniversity of PortsmouthUniversity of IllinoisNational Center for Supercomputing ApplicationsThe Barcelona Institute of Science and TechnologyUniversity of PennsylvaniaUniversity of MichiganCarrer de Can MagransUniversidad Autonoma de MadridThe Ohio State UniversityUniversity of WashingtonUniversity of CaliforniaAustralian Astronomical ObservatoryArgonne National LaboratoryUniversidade de São Paulo (USP)College StationPrinceton UniversityCalifornia Institute of TechnologyMedioambientales y Tecnológicas (CIEMAT)SLAC National Accelerator LaboratoryUniversity of SouthamptonOak Ridge National LaboratoryFausti Neto, A.da Costa, L. N.Carnero, A.Gschwend, J.Ogando, R. L.C.Sobreira, F.Maia, M. A.G.Santiago, B. X.Rosenfeld, R. [UNESP]Singulani, C.Adean, C.Nunes, L. D.P.Campisano, R.Brito, R.Soares, G.Vila-Verde, G. C.Abbott, T. M.C.Abdalla, F. B.Allam, S.Benoit-Lévy, A.Brooks, D.Buckley-Geer, E.Capozzi, D.Carrasco Kind, M.Carretero, J.D'Andrea, C. B.Desai, S.Doel, P.Drlica-Wagner, A.Evrard, A. E.Fosalba, P.García-Bellido, J.Gerdes, D. W.Gruendl, R. A.Gutierrez, G.Honscheid, K.James, D. J.Jeltema, T. E.Kuehn, K.Kuhlmann, S.Kuropatkin, N.Lahav, O.Lima, M.Marshall, J. L.Melchior, P.Menanteau, F.Plazas, A.Sanchez, E.Scarpine, V.Schindler, R.Schubnell, M.Sevilla-Noarbe, I.Smith, M.Smith, R. C.Suchyta, E.Swanson, M. E.C.Tarle, G.Walker, A. R.2018-12-11T17:21:04Z2018-12-11T17:21:04Z2018-07-01info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/article52-69application/pdfhttp://dx.doi.org/10.1016/j.ascom.2018.01.002Astronomy and Computing, v. 24, p. 52-69.2213-1337http://hdl.handle.net/11449/17651010.1016/j.ascom.2018.01.0022-s2.0-850491173082-s2.0-85049117308.pdfScopusreponame:Repositório Institucional da UNESPinstname:Universidade Estadual Paulista (UNESP)instacron:UNESPengAstronomy and Computing1,597info:eu-repo/semantics/openAccess2024-01-14T06:23:42Zoai:repositorio.unesp.br:11449/176510Repositório InstitucionalPUBhttp://repositorio.unesp.br/oai/requestopendoar:29462024-08-05T22:58:14.381568Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)false
dc.title.none.fl_str_mv DES science portal: Creating science-ready catalogs
title DES science portal: Creating science-ready catalogs
spellingShingle DES science portal: Creating science-ready catalogs
Fausti Neto, A.
Astronomical databases
Catalogs
Data analysis
Surveys—methods
title_short DES science portal: Creating science-ready catalogs
title_full DES science portal: Creating science-ready catalogs
title_fullStr DES science portal: Creating science-ready catalogs
title_full_unstemmed DES science portal: Creating science-ready catalogs
title_sort DES science portal: Creating science-ready catalogs
author Fausti Neto, A.
author_facet Fausti Neto, A.
da Costa, L. N.
Carnero, A.
Gschwend, J.
Ogando, R. L.C.
Sobreira, F.
Maia, M. A.G.
Santiago, B. X.
Rosenfeld, R. [UNESP]
Singulani, C.
Adean, C.
Nunes, L. D.P.
Campisano, R.
Brito, R.
Soares, G.
Vila-Verde, G. C.
Abbott, T. M.C.
Abdalla, F. B.
Allam, S.
Benoit-Lévy, A.
Brooks, D.
Buckley-Geer, E.
Capozzi, D.
Carrasco Kind, M.
Carretero, J.
D'Andrea, C. B.
Desai, S.
Doel, P.
Drlica-Wagner, A.
Evrard, A. E.
Fosalba, P.
García-Bellido, J.
Gerdes, D. W.
Gruendl, R. A.
Gutierrez, G.
Honscheid, K.
James, D. J.
Jeltema, T. E.
Kuehn, K.
Kuhlmann, S.
Kuropatkin, N.
Lahav, O.
Lima, M.
Marshall, J. L.
Melchior, P.
Menanteau, F.
Plazas, A.
Sanchez, E.
Scarpine, V.
Schindler, R.
Schubnell, M.
Sevilla-Noarbe, I.
Smith, M.
Smith, R. C.
Suchyta, E.
Swanson, M. E.C.
Tarle, G.
Walker, A. R.
author_role author
author2 da Costa, L. N.
Carnero, A.
Gschwend, J.
Ogando, R. L.C.
Sobreira, F.
Maia, M. A.G.
Santiago, B. X.
Rosenfeld, R. [UNESP]
Singulani, C.
Adean, C.
Nunes, L. D.P.
Campisano, R.
Brito, R.
Soares, G.
Vila-Verde, G. C.
Abbott, T. M.C.
Abdalla, F. B.
Allam, S.
Benoit-Lévy, A.
Brooks, D.
Buckley-Geer, E.
Capozzi, D.
Carrasco Kind, M.
Carretero, J.
D'Andrea, C. B.
Desai, S.
Doel, P.
Drlica-Wagner, A.
Evrard, A. E.
Fosalba, P.
García-Bellido, J.
Gerdes, D. W.
Gruendl, R. A.
Gutierrez, G.
Honscheid, K.
James, D. J.
Jeltema, T. E.
Kuehn, K.
Kuhlmann, S.
Kuropatkin, N.
Lahav, O.
Lima, M.
Marshall, J. L.
Melchior, P.
Menanteau, F.
Plazas, A.
Sanchez, E.
Scarpine, V.
Schindler, R.
Schubnell, M.
Sevilla-Noarbe, I.
Smith, M.
Smith, R. C.
Suchyta, E.
Swanson, M. E.C.
Tarle, G.
Walker, A. R.
author2_role author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
author
dc.contributor.none.fl_str_mv Laboratório Interinstitucional de e-Astronomia - LIneA
LSST Project Management Office
Observatório Nacional
Universidade Estadual de Campinas (UNICAMP)
Universidade Federal do Rio Grande do Sul
Universidade Estadual Paulista (Unesp)
Centro Federal de Educação Tecnológica Celso Suckow da Fonseca - CEFET/RJ
National Optical Astronomy Observatory
University College London
Rhodes University
Fermi National Accelerator Laboratory
Institut d'Astrophysique de Paris
University of Portsmouth
University of Illinois
National Center for Supercomputing Applications
The Barcelona Institute of Science and Technology
University of Pennsylvania
University of Michigan
Carrer de Can Magrans
Universidad Autonoma de Madrid
The Ohio State University
University of Washington
University of California
Australian Astronomical Observatory
Argonne National Laboratory
Universidade de São Paulo (USP)
College Station
Princeton University
California Institute of Technology
Medioambientales y Tecnológicas (CIEMAT)
SLAC National Accelerator Laboratory
University of Southampton
Oak Ridge National Laboratory
dc.contributor.author.fl_str_mv Fausti Neto, A.
da Costa, L. N.
Carnero, A.
Gschwend, J.
Ogando, R. L.C.
Sobreira, F.
Maia, M. A.G.
Santiago, B. X.
Rosenfeld, R. [UNESP]
Singulani, C.
Adean, C.
Nunes, L. D.P.
Campisano, R.
Brito, R.
Soares, G.
Vila-Verde, G. C.
Abbott, T. M.C.
Abdalla, F. B.
Allam, S.
Benoit-Lévy, A.
Brooks, D.
Buckley-Geer, E.
Capozzi, D.
Carrasco Kind, M.
Carretero, J.
D'Andrea, C. B.
Desai, S.
Doel, P.
Drlica-Wagner, A.
Evrard, A. E.
Fosalba, P.
García-Bellido, J.
Gerdes, D. W.
Gruendl, R. A.
Gutierrez, G.
Honscheid, K.
James, D. J.
Jeltema, T. E.
Kuehn, K.
Kuhlmann, S.
Kuropatkin, N.
Lahav, O.
Lima, M.
Marshall, J. L.
Melchior, P.
Menanteau, F.
Plazas, A.
Sanchez, E.
Scarpine, V.
Schindler, R.
Schubnell, M.
Sevilla-Noarbe, I.
Smith, M.
Smith, R. C.
Suchyta, E.
Swanson, M. E.C.
Tarle, G.
Walker, A. R.
dc.subject.por.fl_str_mv Astronomical databases
Catalogs
Data analysis
Surveys—methods
topic Astronomical databases
Catalogs
Data analysis
Surveys—methods
description We present a novel approach for creating science-ready catalogs through a software infrastructure developed for the Dark Energy Survey (DES). We integrate the data products released by the DES Data Management and additional products created by the DES collaboration in an environment known as DES Science Portal. Each step involved in the creation of a science-ready catalog is recorded in a relational database and can be recovered at any time. We describe how the DES Science Portal automates the creation and characterization of lightweight catalogs for DES Year 1 Annual Release, and show its flexibility in creating multiple catalogs with different inputs and configurations. Finally, we discuss the advantages of this infrastructure for large surveys such as DES and the Large Synoptic Survey Telescope. The capability of creating science-ready catalogs efficiently and with full control of the inputs and configurations used is an important asset for supporting science analysis using data from large astronomical surveys.
publishDate 2018
dc.date.none.fl_str_mv 2018-12-11T17:21:04Z
2018-12-11T17:21:04Z
2018-07-01
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://dx.doi.org/10.1016/j.ascom.2018.01.002
Astronomy and Computing, v. 24, p. 52-69.
2213-1337
http://hdl.handle.net/11449/176510
10.1016/j.ascom.2018.01.002
2-s2.0-85049117308
2-s2.0-85049117308.pdf
url http://dx.doi.org/10.1016/j.ascom.2018.01.002
http://hdl.handle.net/11449/176510
identifier_str_mv Astronomy and Computing, v. 24, p. 52-69.
2213-1337
10.1016/j.ascom.2018.01.002
2-s2.0-85049117308
2-s2.0-85049117308.pdf
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv Astronomy and Computing
1,597
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv 52-69
application/pdf
dc.source.none.fl_str_mv Scopus
reponame:Repositório Institucional da UNESP
instname:Universidade Estadual Paulista (UNESP)
instacron:UNESP
instname_str Universidade Estadual Paulista (UNESP)
instacron_str UNESP
institution UNESP
reponame_str Repositório Institucional da UNESP
collection Repositório Institucional da UNESP
repository.name.fl_str_mv Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)
repository.mail.fl_str_mv
_version_ 1808129478178635776