Development and uncertainty assessment of pedotransfer functions for predicting water contents at specific pressure heads.

Detalhes bibliográficos
Autor(a) principal: KOTLAR, A. M.
Data de Publicação: 2019
Outros Autores: LIER, Q. de J. van, BARROS, A. H. C., IVERSEN, B. V., VEREECKEN, H.
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Institucional da EMBRAPA (Repository Open Access to Scientific Information from EMBRAPA - Alice)
Texto Completo: http://www.alice.cnptia.embrapa.br/alice/handle/doc/1117100
Resumo: There has been much effort to improve the performance of pedotransfer functions (PTFs) using intelligent algorithms, but the issue of covariate shift, i.e., different probability distributions in training and testing datasets, and its impact on prediction uncertainty of PTFs has been rarely addressed. The common practice in PTF generation is to randomly separate the dataset into training and testing subsets, and the outcomes of this random selection may be different if the process is subject to covariate shift. We evaluated the impact of covariate shift generated by data shuffling and detected by Kolmogorov-Smirnov test for the prediction of water contents using soil databases from Denmark and Brazil. The soil water contents at different pressure heads were predicted by developing linear and stepwise regression besides machine learning based PTFs including Gaussian process regression and ensemble method. Regression based PTFs for the Brazilian dataset resulted in better predictions compared with machine learning methods, which in their turn estimated high water contents in Danish soils more accurately. One hundred PTFs were developed for water content at specific pressure heads by data shuffling. From these, 100 sets of fitted van Genuchten parameters were obtained representing the generated uncertainty. Data shuffling led to covariate shift, resulting in uncertainty in water content prediction by the PTFs. Inherent variability of data may lead to increased prediction uncertainty. For correlated data, simple regression models performed as good as sophisticated machine learning methods. Using PTF-predicted water contents for van Genuchten retention parameter fitting may lead to a high uncertainty.
id EMBR_c7b0f661818b077c8f796ccfd7871435
oai_identifier_str oai:www.alice.cnptia.embrapa.br:doc/1117100
network_acronym_str EMBR
network_name_str Repositório Institucional da EMBRAPA (Repository Open Access to Scientific Information from EMBRAPA - Alice)
repository_id_str 2154
spelling Development and uncertainty assessment of pedotransfer functions for predicting water contents at specific pressure heads.Funções de pedotransferênciaCondutividade HidráulicaRetenção de Água no SoloPedotransfer functionsSoil water retentionHydraulic conductivityThere has been much effort to improve the performance of pedotransfer functions (PTFs) using intelligent algorithms, but the issue of covariate shift, i.e., different probability distributions in training and testing datasets, and its impact on prediction uncertainty of PTFs has been rarely addressed. The common practice in PTF generation is to randomly separate the dataset into training and testing subsets, and the outcomes of this random selection may be different if the process is subject to covariate shift. We evaluated the impact of covariate shift generated by data shuffling and detected by Kolmogorov-Smirnov test for the prediction of water contents using soil databases from Denmark and Brazil. The soil water contents at different pressure heads were predicted by developing linear and stepwise regression besides machine learning based PTFs including Gaussian process regression and ensemble method. Regression based PTFs for the Brazilian dataset resulted in better predictions compared with machine learning methods, which in their turn estimated high water contents in Danish soils more accurately. One hundred PTFs were developed for water content at specific pressure heads by data shuffling. From these, 100 sets of fitted van Genuchten parameters were obtained representing the generated uncertainty. Data shuffling led to covariate shift, resulting in uncertainty in water content prediction by the PTFs. Inherent variability of data may lead to increased prediction uncertainty. For correlated data, simple regression models performed as good as sophisticated machine learning methods. Using PTF-predicted water contents for van Genuchten retention parameter fitting may lead to a high uncertainty.ALI MEHMANDOOST KOTLAR, CENA/USP; QUIRIJN DE JONG VAN LIER, CENA/USP; ALEXANDRE HUGO CEZAR BARROS, CNPS; BO V. IVERSEN, AARHUS UNIV., DENMARK; HARRY VEREECKEN, INSTITUTE OF BIO- AND GEOSCIENCES (IBG-3), AGROSPHERE, FORSCHUNGSZENTRUM JULICH, GERMANY.KOTLAR, A. M.LIER, Q. de J. vanBARROS, A. H. C.IVERSEN, B. V.VEREECKEN, H.2019-12-18T00:36:48Z2019-12-18T00:36:48Z2019-12-1720192019-12-18T00:36:48Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleVadose Zone Journal, v. 18, n. 1, 190063, 2019.http://www.alice.cnptia.embrapa.br/alice/handle/doc/111710010.2136/vzj2019.06.0063enginfo:eu-repo/semantics/openAccessreponame:Repositório Institucional da EMBRAPA (Repository Open Access to Scientific Information from EMBRAPA - Alice)instname:Empresa Brasileira de Pesquisa Agropecuária (Embrapa)instacron:EMBRAPA2019-12-18T00:36:55Zoai:www.alice.cnptia.embrapa.br:doc/1117100Repositório InstitucionalPUBhttps://www.alice.cnptia.embrapa.br/oai/requestopendoar:21542019-12-18T00:36:55falseRepositório InstitucionalPUBhttps://www.alice.cnptia.embrapa.br/oai/requestcg-riaa@embrapa.bropendoar:21542019-12-18T00:36:55Repositório Institucional da EMBRAPA (Repository Open Access to Scientific Information from EMBRAPA - Alice) - Empresa Brasileira de Pesquisa Agropecuária (Embrapa)false
dc.title.none.fl_str_mv Development and uncertainty assessment of pedotransfer functions for predicting water contents at specific pressure heads.
title Development and uncertainty assessment of pedotransfer functions for predicting water contents at specific pressure heads.
spellingShingle Development and uncertainty assessment of pedotransfer functions for predicting water contents at specific pressure heads.
KOTLAR, A. M.
Funções de pedotransferência
Condutividade Hidráulica
Retenção de Água no Solo
Pedotransfer functions
Soil water retention
Hydraulic conductivity
title_short Development and uncertainty assessment of pedotransfer functions for predicting water contents at specific pressure heads.
title_full Development and uncertainty assessment of pedotransfer functions for predicting water contents at specific pressure heads.
title_fullStr Development and uncertainty assessment of pedotransfer functions for predicting water contents at specific pressure heads.
title_full_unstemmed Development and uncertainty assessment of pedotransfer functions for predicting water contents at specific pressure heads.
title_sort Development and uncertainty assessment of pedotransfer functions for predicting water contents at specific pressure heads.
author KOTLAR, A. M.
author_facet KOTLAR, A. M.
LIER, Q. de J. van
BARROS, A. H. C.
IVERSEN, B. V.
VEREECKEN, H.
author_role author
author2 LIER, Q. de J. van
BARROS, A. H. C.
IVERSEN, B. V.
VEREECKEN, H.
author2_role author
author
author
author
dc.contributor.none.fl_str_mv ALI MEHMANDOOST KOTLAR, CENA/USP; QUIRIJN DE JONG VAN LIER, CENA/USP; ALEXANDRE HUGO CEZAR BARROS, CNPS; BO V. IVERSEN, AARHUS UNIV., DENMARK; HARRY VEREECKEN, INSTITUTE OF BIO- AND GEOSCIENCES (IBG-3), AGROSPHERE, FORSCHUNGSZENTRUM JULICH, GERMANY.
dc.contributor.author.fl_str_mv KOTLAR, A. M.
LIER, Q. de J. van
BARROS, A. H. C.
IVERSEN, B. V.
VEREECKEN, H.
dc.subject.por.fl_str_mv Funções de pedotransferência
Condutividade Hidráulica
Retenção de Água no Solo
Pedotransfer functions
Soil water retention
Hydraulic conductivity
topic Funções de pedotransferência
Condutividade Hidráulica
Retenção de Água no Solo
Pedotransfer functions
Soil water retention
Hydraulic conductivity
description There has been much effort to improve the performance of pedotransfer functions (PTFs) using intelligent algorithms, but the issue of covariate shift, i.e., different probability distributions in training and testing datasets, and its impact on prediction uncertainty of PTFs has been rarely addressed. The common practice in PTF generation is to randomly separate the dataset into training and testing subsets, and the outcomes of this random selection may be different if the process is subject to covariate shift. We evaluated the impact of covariate shift generated by data shuffling and detected by Kolmogorov-Smirnov test for the prediction of water contents using soil databases from Denmark and Brazil. The soil water contents at different pressure heads were predicted by developing linear and stepwise regression besides machine learning based PTFs including Gaussian process regression and ensemble method. Regression based PTFs for the Brazilian dataset resulted in better predictions compared with machine learning methods, which in their turn estimated high water contents in Danish soils more accurately. One hundred PTFs were developed for water content at specific pressure heads by data shuffling. From these, 100 sets of fitted van Genuchten parameters were obtained representing the generated uncertainty. Data shuffling led to covariate shift, resulting in uncertainty in water content prediction by the PTFs. Inherent variability of data may lead to increased prediction uncertainty. For correlated data, simple regression models performed as good as sophisticated machine learning methods. Using PTF-predicted water contents for van Genuchten retention parameter fitting may lead to a high uncertainty.
publishDate 2019
dc.date.none.fl_str_mv 2019-12-18T00:36:48Z
2019-12-18T00:36:48Z
2019-12-17
2019
2019-12-18T00:36:48Z
dc.type.driver.fl_str_mv info:eu-repo/semantics/publishedVersion
info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv Vadose Zone Journal, v. 18, n. 1, 190063, 2019.
http://www.alice.cnptia.embrapa.br/alice/handle/doc/1117100
10.2136/vzj2019.06.0063
identifier_str_mv Vadose Zone Journal, v. 18, n. 1, 190063, 2019.
10.2136/vzj2019.06.0063
url http://www.alice.cnptia.embrapa.br/alice/handle/doc/1117100
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.source.none.fl_str_mv reponame:Repositório Institucional da EMBRAPA (Repository Open Access to Scientific Information from EMBRAPA - Alice)
instname:Empresa Brasileira de Pesquisa Agropecuária (Embrapa)
instacron:EMBRAPA
instname_str Empresa Brasileira de Pesquisa Agropecuária (Embrapa)
instacron_str EMBRAPA
institution EMBRAPA
reponame_str Repositório Institucional da EMBRAPA (Repository Open Access to Scientific Information from EMBRAPA - Alice)
collection Repositório Institucional da EMBRAPA (Repository Open Access to Scientific Information from EMBRAPA - Alice)
repository.name.fl_str_mv Repositório Institucional da EMBRAPA (Repository Open Access to Scientific Information from EMBRAPA - Alice) - Empresa Brasileira de Pesquisa Agropecuária (Embrapa)
repository.mail.fl_str_mv cg-riaa@embrapa.br
_version_ 1794503486121967616