Revisiting the critical values of the Lilliefors test: towards the correct agrometeorological use of the Kolmogorov-Smirnov framework

Detalhes bibliográficos
Autor(a) principal: Blain,Gabriel Constantino
Data de Publicação: 2014
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Bragantia
Texto Completo: http://old.scielo.br/scielo.php?script=sci_arttext&pid=S0006-87052014000200015
Resumo: Several studies have applied the Kolmogorov-Smirnov test (KS) to verify if a particular parametric distribution can be used to assess the probability of occurrence of a given agrometeorological variable. However, when this test is applied to the same data sample from which the distribution parameters have been estimated, it leads to a high probability of failure to reject a false null hypothesis. Although the Lilliefors test had been proposed to remedy this drawback, several studies still use the KS test even when the requirement of independence between the data and the estimated parameters is not met. Aiming at stimulating the use of the Lilliefors test, we revisited the critical values of the Lilliefors test for both gamma (gam) and normal distributions, provided easy-to-use procedures capable of calculating the Lilliefors test and evaluated the performance of these two tests in correctly accepting a hypothesized distribution. The Lilliefors test was calculated by using critical values previously presented in the scientific literature (KSLcrit) and those obtained from the procedures proposed in this study (NKSLcrit). Through Monte Carlo simulations we demonstrated that the frequency of occurrence of Type I (II) errors associated with the KSLcrit may be unacceptably low (high). By using the NKSLcrit we were able to meet the significance level in all Monte Carlo experiments. The NKSLcrit also led to the lowest rate of Type II errors. Finally, we also provided polynomial equations that eliminate the need to perform statistical simulations to calculate the Lilliefors test for both gam and normal distributions.
id IAC-1_49c3b3a64168408aa43d0ad9a3ad9845
oai_identifier_str oai:scielo:S0006-87052014000200015
network_acronym_str IAC-1
network_name_str Bragantia
repository_id_str
spelling Revisiting the critical values of the Lilliefors test: towards the correct agrometeorological use of the Kolmogorov-Smirnov frameworkgoodness of fitgamma distributionnormal distributionSeveral studies have applied the Kolmogorov-Smirnov test (KS) to verify if a particular parametric distribution can be used to assess the probability of occurrence of a given agrometeorological variable. However, when this test is applied to the same data sample from which the distribution parameters have been estimated, it leads to a high probability of failure to reject a false null hypothesis. Although the Lilliefors test had been proposed to remedy this drawback, several studies still use the KS test even when the requirement of independence between the data and the estimated parameters is not met. Aiming at stimulating the use of the Lilliefors test, we revisited the critical values of the Lilliefors test for both gamma (gam) and normal distributions, provided easy-to-use procedures capable of calculating the Lilliefors test and evaluated the performance of these two tests in correctly accepting a hypothesized distribution. The Lilliefors test was calculated by using critical values previously presented in the scientific literature (KSLcrit) and those obtained from the procedures proposed in this study (NKSLcrit). Through Monte Carlo simulations we demonstrated that the frequency of occurrence of Type I (II) errors associated with the KSLcrit may be unacceptably low (high). By using the NKSLcrit we were able to meet the significance level in all Monte Carlo experiments. The NKSLcrit also led to the lowest rate of Type II errors. Finally, we also provided polynomial equations that eliminate the need to perform statistical simulations to calculate the Lilliefors test for both gam and normal distributions.Instituto Agronômico de Campinas2014-06-01info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersiontext/htmlhttp://old.scielo.br/scielo.php?script=sci_arttext&pid=S0006-87052014000200015Bragantia v.73 n.2 2014reponame:Bragantiainstname:Instituto Agronômico de Campinas (IAC)instacron:IAC10.1590/brag.2014.015info:eu-repo/semantics/openAccessBlain,Gabriel Constantinoeng2014-07-14T00:00:00Zoai:scielo:S0006-87052014000200015Revistahttps://www.scielo.br/j/brag/https://old.scielo.br/oai/scielo-oai.phpbragantia@iac.sp.gov.br||bragantia@iac.sp.gov.br1678-44990006-8705opendoar:2014-07-14T00:00Bragantia - Instituto Agronômico de Campinas (IAC)false
dc.title.none.fl_str_mv Revisiting the critical values of the Lilliefors test: towards the correct agrometeorological use of the Kolmogorov-Smirnov framework
title Revisiting the critical values of the Lilliefors test: towards the correct agrometeorological use of the Kolmogorov-Smirnov framework
spellingShingle Revisiting the critical values of the Lilliefors test: towards the correct agrometeorological use of the Kolmogorov-Smirnov framework
Blain,Gabriel Constantino
goodness of fit
gamma distribution
normal distribution
title_short Revisiting the critical values of the Lilliefors test: towards the correct agrometeorological use of the Kolmogorov-Smirnov framework
title_full Revisiting the critical values of the Lilliefors test: towards the correct agrometeorological use of the Kolmogorov-Smirnov framework
title_fullStr Revisiting the critical values of the Lilliefors test: towards the correct agrometeorological use of the Kolmogorov-Smirnov framework
title_full_unstemmed Revisiting the critical values of the Lilliefors test: towards the correct agrometeorological use of the Kolmogorov-Smirnov framework
title_sort Revisiting the critical values of the Lilliefors test: towards the correct agrometeorological use of the Kolmogorov-Smirnov framework
author Blain,Gabriel Constantino
author_facet Blain,Gabriel Constantino
author_role author
dc.contributor.author.fl_str_mv Blain,Gabriel Constantino
dc.subject.por.fl_str_mv goodness of fit
gamma distribution
normal distribution
topic goodness of fit
gamma distribution
normal distribution
description Several studies have applied the Kolmogorov-Smirnov test (KS) to verify if a particular parametric distribution can be used to assess the probability of occurrence of a given agrometeorological variable. However, when this test is applied to the same data sample from which the distribution parameters have been estimated, it leads to a high probability of failure to reject a false null hypothesis. Although the Lilliefors test had been proposed to remedy this drawback, several studies still use the KS test even when the requirement of independence between the data and the estimated parameters is not met. Aiming at stimulating the use of the Lilliefors test, we revisited the critical values of the Lilliefors test for both gamma (gam) and normal distributions, provided easy-to-use procedures capable of calculating the Lilliefors test and evaluated the performance of these two tests in correctly accepting a hypothesized distribution. The Lilliefors test was calculated by using critical values previously presented in the scientific literature (KSLcrit) and those obtained from the procedures proposed in this study (NKSLcrit). Through Monte Carlo simulations we demonstrated that the frequency of occurrence of Type I (II) errors associated with the KSLcrit may be unacceptably low (high). By using the NKSLcrit we were able to meet the significance level in all Monte Carlo experiments. The NKSLcrit also led to the lowest rate of Type II errors. Finally, we also provided polynomial equations that eliminate the need to perform statistical simulations to calculate the Lilliefors test for both gam and normal distributions.
publishDate 2014
dc.date.none.fl_str_mv 2014-06-01
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://old.scielo.br/scielo.php?script=sci_arttext&pid=S0006-87052014000200015
url http://old.scielo.br/scielo.php?script=sci_arttext&pid=S0006-87052014000200015
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv 10.1590/brag.2014.015
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv text/html
dc.publisher.none.fl_str_mv Instituto Agronômico de Campinas
publisher.none.fl_str_mv Instituto Agronômico de Campinas
dc.source.none.fl_str_mv Bragantia v.73 n.2 2014
reponame:Bragantia
instname:Instituto Agronômico de Campinas (IAC)
instacron:IAC
instname_str Instituto Agronômico de Campinas (IAC)
instacron_str IAC
institution IAC
reponame_str Bragantia
collection Bragantia
repository.name.fl_str_mv Bragantia - Instituto Agronômico de Campinas (IAC)
repository.mail.fl_str_mv bragantia@iac.sp.gov.br||bragantia@iac.sp.gov.br
_version_ 1754193303902879744