The ACCENT-protocol: a framework for benchmarking and model evaluation

Detalhes bibliográficos
Autor(a) principal: Grewe, V.
Data de Publicação: 2012
Outros Autores: Moussiopoulos, N., Builtjes, P., Borrego, C., Isaksen, I. S. A., Volz-Thomas, A.
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: http://hdl.handle.net/10773/27130
Resumo: We summarise results from a workshop on “Model Benchmarking and Quality Assurance” of the EU-Network of Excellence ACCENT, including results from other activities (e.g. COST Action 732) and publications. A formalised evaluation protocol is presented, i.e. a generic formalism describing the procedure of how to perform a model evaluation. This includes eight steps and examples from global model applications which are given for illustration. The first and important step is concerning the purpose of the model application, i.e. the addressed underlying scientific or political question. We give examples to demonstrate that there is no model evaluation per se, i.e. without a focused purpose. Model evaluation is testing, whether a model is fit for its purpose. The following steps are deduced from the purpose and include model requirements, input data, key processes and quantities, benchmark data, quality indicators, sensitivities, as well as benchmarking and grading. We define “benchmarking” as the process of comparing the model output against either observational data or high fidelity model data, i.e. benchmark data. Special focus is given to the uncertainties, e.g. in observational data, which have the potential to lead to wrong conclusions in the model evaluation if not considered carefully.
id RCAP_011a9fdae935359e4211e204890b7868
oai_identifier_str oai:ria.ua.pt:10773/27130
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling The ACCENT-protocol: a framework for benchmarking and model evaluationWe summarise results from a workshop on “Model Benchmarking and Quality Assurance” of the EU-Network of Excellence ACCENT, including results from other activities (e.g. COST Action 732) and publications. A formalised evaluation protocol is presented, i.e. a generic formalism describing the procedure of how to perform a model evaluation. This includes eight steps and examples from global model applications which are given for illustration. The first and important step is concerning the purpose of the model application, i.e. the addressed underlying scientific or political question. We give examples to demonstrate that there is no model evaluation per se, i.e. without a focused purpose. Model evaluation is testing, whether a model is fit for its purpose. The following steps are deduced from the purpose and include model requirements, input data, key processes and quantities, benchmark data, quality indicators, sensitivities, as well as benchmarking and grading. We define “benchmarking” as the process of comparing the model output against either observational data or high fidelity model data, i.e. benchmark data. Special focus is given to the uncertainties, e.g. in observational data, which have the potential to lead to wrong conclusions in the model evaluation if not considered carefully.European Geosciences Union2019-12-10T11:05:16Z2012-01-01T00:00:00Z2012info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/10773/27130eng991-959X10.5194/gmd-5-611-2012Grewe, V.Moussiopoulos, N.Builtjes, P.Borrego, C.Isaksen, I. S. A.Volz-Thomas, A.info:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2024-02-22T11:52:35Zoai:ria.ua.pt:10773/27130Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-20T02:59:59.838814Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv The ACCENT-protocol: a framework for benchmarking and model evaluation
title The ACCENT-protocol: a framework for benchmarking and model evaluation
spellingShingle The ACCENT-protocol: a framework for benchmarking and model evaluation
Grewe, V.
title_short The ACCENT-protocol: a framework for benchmarking and model evaluation
title_full The ACCENT-protocol: a framework for benchmarking and model evaluation
title_fullStr The ACCENT-protocol: a framework for benchmarking and model evaluation
title_full_unstemmed The ACCENT-protocol: a framework for benchmarking and model evaluation
title_sort The ACCENT-protocol: a framework for benchmarking and model evaluation
author Grewe, V.
author_facet Grewe, V.
Moussiopoulos, N.
Builtjes, P.
Borrego, C.
Isaksen, I. S. A.
Volz-Thomas, A.
author_role author
author2 Moussiopoulos, N.
Builtjes, P.
Borrego, C.
Isaksen, I. S. A.
Volz-Thomas, A.
author2_role author
author
author
author
author
dc.contributor.author.fl_str_mv Grewe, V.
Moussiopoulos, N.
Builtjes, P.
Borrego, C.
Isaksen, I. S. A.
Volz-Thomas, A.
description We summarise results from a workshop on “Model Benchmarking and Quality Assurance” of the EU-Network of Excellence ACCENT, including results from other activities (e.g. COST Action 732) and publications. A formalised evaluation protocol is presented, i.e. a generic formalism describing the procedure of how to perform a model evaluation. This includes eight steps and examples from global model applications which are given for illustration. The first and important step is concerning the purpose of the model application, i.e. the addressed underlying scientific or political question. We give examples to demonstrate that there is no model evaluation per se, i.e. without a focused purpose. Model evaluation is testing, whether a model is fit for its purpose. The following steps are deduced from the purpose and include model requirements, input data, key processes and quantities, benchmark data, quality indicators, sensitivities, as well as benchmarking and grading. We define “benchmarking” as the process of comparing the model output against either observational data or high fidelity model data, i.e. benchmark data. Special focus is given to the uncertainties, e.g. in observational data, which have the potential to lead to wrong conclusions in the model evaluation if not considered carefully.
publishDate 2012
dc.date.none.fl_str_mv 2012-01-01T00:00:00Z
2012
2019-12-10T11:05:16Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10773/27130
url http://hdl.handle.net/10773/27130
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv 991-959X
10.5194/gmd-5-611-2012
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv European Geosciences Union
publisher.none.fl_str_mv European Geosciences Union
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799137655047323648