Integrating time series mining and fractals to discover patterns and extreme events in climate and remote sensing databases.
Autor(a) principal: | |
---|---|
Data de Publicação: | 2010 |
Tipo de documento: | Tese |
Idioma: | eng |
Título da fonte: | Repositório Institucional da EMBRAPA (Repository Open Access to Scientific Information from EMBRAPA - Alice) |
Texto Completo: | http://www.alice.cnptia.embrapa.br/alice/handle/doc/876360 |
Resumo: | This thesis presents new methods based on fractal theory and data mining techniques to support agricultural monitoring in regional scale, specifically regions with sugar cane fields. This commodity greatly contributes to the Brazilian economy since it is a viable alternative to replace fossil fuels. Since climate influences the national agricultural production, researchers use climate data associated to agrometeorological indexes, and recently they also employed data from satellites to support decision making processes. In this context, we proposed a method that uses the fractal dimension to identify trend changes in climate series jointly with a statistical analysis module to define which attributes are responsible for the behavior alteration in the series. Moreover, we also proposed two methods of similarity measure to allow comparisons among different agricultural regions represented by multiples variables from meteorological data and remote sensing images. Given the importance of studying the extreme weather events, which could increase in intensity, duration and frequency according to different scenarios indicated by climate forecasting models, we proposed the CLIPSMiner algorithm to identify relevant patterns and extremes in climate series. CLIPSMiner also detects correlations among multiple time series considering time lag and finds patterns according to parameters, which can be calibrated by the users. We applied two distinct approaches in order to discover association patterns on time series. The first one is the Apriori-FD method that integrates an algorithm to perform attribute selection through applying the correlation fractal dimension, an algorithm of discretization to convert continuous values of series into discrete intervals, and a well-known association rules algorithm (Apriori). Although Apriori-FD has identified interesting patterns related to temperature, this method failed to appropriately deal with time lag. As a solution, we proposed CLEARMiner that is an unsupervised algorithm in order to mine the association patterns in one time series relating them to patterns in other series considering the possibility of time lag. The proposed methods were compared with similar techniques as well as assessed by a group of meteorologists, and specialists in agrometeorology and remote sensing. The experiments showed that applying data mining techniques and fractal theory can contribute to improve the analyses of agrometeorological and satellite data. These new techniques can aid researchers in their work on decision making and become important tools to support decision making in agribusiness. |
id |
EMBR_43bf01859fb383622cca295da65aabd3 |
---|---|
oai_identifier_str |
oai:www.alice.cnptia.embrapa.br:doc/876360 |
network_acronym_str |
EMBR |
network_name_str |
Repositório Institucional da EMBRAPA (Repository Open Access to Scientific Information from EMBRAPA - Alice) |
repository_id_str |
2154 |
spelling |
Integrating time series mining and fractals to discover patterns and extreme events in climate and remote sensing databases.Mineração de textosSéries temporaisSéries climáticasText miningAgrometeorologiaSensoriamento remotoTime series analysisRemote sensingAgrometeorologyDatabasesThis thesis presents new methods based on fractal theory and data mining techniques to support agricultural monitoring in regional scale, specifically regions with sugar cane fields. This commodity greatly contributes to the Brazilian economy since it is a viable alternative to replace fossil fuels. Since climate influences the national agricultural production, researchers use climate data associated to agrometeorological indexes, and recently they also employed data from satellites to support decision making processes. In this context, we proposed a method that uses the fractal dimension to identify trend changes in climate series jointly with a statistical analysis module to define which attributes are responsible for the behavior alteration in the series. Moreover, we also proposed two methods of similarity measure to allow comparisons among different agricultural regions represented by multiples variables from meteorological data and remote sensing images. Given the importance of studying the extreme weather events, which could increase in intensity, duration and frequency according to different scenarios indicated by climate forecasting models, we proposed the CLIPSMiner algorithm to identify relevant patterns and extremes in climate series. CLIPSMiner also detects correlations among multiple time series considering time lag and finds patterns according to parameters, which can be calibrated by the users. We applied two distinct approaches in order to discover association patterns on time series. The first one is the Apriori-FD method that integrates an algorithm to perform attribute selection through applying the correlation fractal dimension, an algorithm of discretization to convert continuous values of series into discrete intervals, and a well-known association rules algorithm (Apriori). Although Apriori-FD has identified interesting patterns related to temperature, this method failed to appropriately deal with time lag. As a solution, we proposed CLEARMiner that is an unsupervised algorithm in order to mine the association patterns in one time series relating them to patterns in other series considering the possibility of time lag. The proposed methods were compared with similar techniques as well as assessed by a group of meteorologists, and specialists in agrometeorology and remote sensing. The experiments showed that applying data mining techniques and fractal theory can contribute to improve the analyses of agrometeorological and satellite data. These new techniques can aid researchers in their work on decision making and become important tools to support decision making in agribusiness.Thesis (Ph.D., Thesis ) - Instituto de Ciências Matemáticas e de Computação da Universidade de São Paulo, São Carlos.LUCIANA ALVIM SANTOS ROMANI, CNPTIA.ROMANI, L. A. S.2011-04-10T11:11:11Z2011-04-10T11:11:11Z2011-02-0920102017-05-25T11:11:11Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/doctoralThesis179 p.2010.http://www.alice.cnptia.embrapa.br/alice/handle/doc/876360enginfo:eu-repo/semantics/openAccessreponame:Repositório Institucional da EMBRAPA (Repository Open Access to Scientific Information from EMBRAPA - Alice)instname:Empresa Brasileira de Pesquisa Agropecuária (Embrapa)instacron:EMBRAPA2017-05-25T17:16:14Zoai:www.alice.cnptia.embrapa.br:doc/876360Repositório InstitucionalPUBhttps://www.alice.cnptia.embrapa.br/oai/requestcg-riaa@embrapa.bropendoar:21542017-05-25T17:16:14Repositório Institucional da EMBRAPA (Repository Open Access to Scientific Information from EMBRAPA - Alice) - Empresa Brasileira de Pesquisa Agropecuária (Embrapa)false |
dc.title.none.fl_str_mv |
Integrating time series mining and fractals to discover patterns and extreme events in climate and remote sensing databases. |
title |
Integrating time series mining and fractals to discover patterns and extreme events in climate and remote sensing databases. |
spellingShingle |
Integrating time series mining and fractals to discover patterns and extreme events in climate and remote sensing databases. ROMANI, L. A. S. Mineração de textos Séries temporais Séries climáticas Text mining Agrometeorologia Sensoriamento remoto Time series analysis Remote sensing Agrometeorology Databases |
title_short |
Integrating time series mining and fractals to discover patterns and extreme events in climate and remote sensing databases. |
title_full |
Integrating time series mining and fractals to discover patterns and extreme events in climate and remote sensing databases. |
title_fullStr |
Integrating time series mining and fractals to discover patterns and extreme events in climate and remote sensing databases. |
title_full_unstemmed |
Integrating time series mining and fractals to discover patterns and extreme events in climate and remote sensing databases. |
title_sort |
Integrating time series mining and fractals to discover patterns and extreme events in climate and remote sensing databases. |
author |
ROMANI, L. A. S. |
author_facet |
ROMANI, L. A. S. |
author_role |
author |
dc.contributor.none.fl_str_mv |
LUCIANA ALVIM SANTOS ROMANI, CNPTIA. |
dc.contributor.author.fl_str_mv |
ROMANI, L. A. S. |
dc.subject.por.fl_str_mv |
Mineração de textos Séries temporais Séries climáticas Text mining Agrometeorologia Sensoriamento remoto Time series analysis Remote sensing Agrometeorology Databases |
topic |
Mineração de textos Séries temporais Séries climáticas Text mining Agrometeorologia Sensoriamento remoto Time series analysis Remote sensing Agrometeorology Databases |
description |
This thesis presents new methods based on fractal theory and data mining techniques to support agricultural monitoring in regional scale, specifically regions with sugar cane fields. This commodity greatly contributes to the Brazilian economy since it is a viable alternative to replace fossil fuels. Since climate influences the national agricultural production, researchers use climate data associated to agrometeorological indexes, and recently they also employed data from satellites to support decision making processes. In this context, we proposed a method that uses the fractal dimension to identify trend changes in climate series jointly with a statistical analysis module to define which attributes are responsible for the behavior alteration in the series. Moreover, we also proposed two methods of similarity measure to allow comparisons among different agricultural regions represented by multiples variables from meteorological data and remote sensing images. Given the importance of studying the extreme weather events, which could increase in intensity, duration and frequency according to different scenarios indicated by climate forecasting models, we proposed the CLIPSMiner algorithm to identify relevant patterns and extremes in climate series. CLIPSMiner also detects correlations among multiple time series considering time lag and finds patterns according to parameters, which can be calibrated by the users. We applied two distinct approaches in order to discover association patterns on time series. The first one is the Apriori-FD method that integrates an algorithm to perform attribute selection through applying the correlation fractal dimension, an algorithm of discretization to convert continuous values of series into discrete intervals, and a well-known association rules algorithm (Apriori). Although Apriori-FD has identified interesting patterns related to temperature, this method failed to appropriately deal with time lag. As a solution, we proposed CLEARMiner that is an unsupervised algorithm in order to mine the association patterns in one time series relating them to patterns in other series considering the possibility of time lag. The proposed methods were compared with similar techniques as well as assessed by a group of meteorologists, and specialists in agrometeorology and remote sensing. The experiments showed that applying data mining techniques and fractal theory can contribute to improve the analyses of agrometeorological and satellite data. These new techniques can aid researchers in their work on decision making and become important tools to support decision making in agribusiness. |
publishDate |
2010 |
dc.date.none.fl_str_mv |
2010 2011-04-10T11:11:11Z 2011-04-10T11:11:11Z 2011-02-09 2017-05-25T11:11:11Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/doctoralThesis |
format |
doctoralThesis |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
2010. http://www.alice.cnptia.embrapa.br/alice/handle/doc/876360 |
identifier_str_mv |
2010. |
url |
http://www.alice.cnptia.embrapa.br/alice/handle/doc/876360 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
179 p. |
dc.source.none.fl_str_mv |
reponame:Repositório Institucional da EMBRAPA (Repository Open Access to Scientific Information from EMBRAPA - Alice) instname:Empresa Brasileira de Pesquisa Agropecuária (Embrapa) instacron:EMBRAPA |
instname_str |
Empresa Brasileira de Pesquisa Agropecuária (Embrapa) |
instacron_str |
EMBRAPA |
institution |
EMBRAPA |
reponame_str |
Repositório Institucional da EMBRAPA (Repository Open Access to Scientific Information from EMBRAPA - Alice) |
collection |
Repositório Institucional da EMBRAPA (Repository Open Access to Scientific Information from EMBRAPA - Alice) |
repository.name.fl_str_mv |
Repositório Institucional da EMBRAPA (Repository Open Access to Scientific Information from EMBRAPA - Alice) - Empresa Brasileira de Pesquisa Agropecuária (Embrapa) |
repository.mail.fl_str_mv |
cg-riaa@embrapa.br |
_version_ |
1822720736596328448 |