Enhancing data stream predictions with reliability estimators and explanation

Detalhes bibliográficos
Autor(a) principal: Bosnic,Z
Data de Publicação: 2014
Outros Autores: Demsar,J, Kespret,G, Pedro Pereira Rodrigues, João Gama, Kononenko,I
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: http://repositorio.inesctec.pt/handle/123456789/3707
http://dx.doi.org/10.1016/j.engappai.2014.06.001
Resumo: Incremental learning from data streams is increasingly attracting research focus due to many real streaming problems (such as learning from transactions, sensors or other sequential observations) that require processing and forecasting in the real time. In this paper we deal with two issues related to incremental learning - prediction accuracy and prediction explanation - and demonstrate their applicability on several streaming problems for predicting electricity load in the future. For improving prediction accuracy we propose and evaluate the use of two reliability estimators that allow us to estimate prediction error and correct predictions. For improving interpretability of the incremental model and its predictions we propose an adaptation of the existing prediction explanation methodology, which was originally developed for batch learning from stationary data. The explanation methodology is combined with a state-of-the-art concept drift detector and a visualization technique to enhance the explanation in dynamic streaming settings. The results show that the proposed approaches can improve prediction accuracy and allow transparent insight into the modeled concept.
id RCAP_4a62d0b9a25ef5825e1a60670999f48d
oai_identifier_str oai:repositorio.inesctec.pt:123456789/3707
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling Enhancing data stream predictions with reliability estimators and explanationIncremental learning from data streams is increasingly attracting research focus due to many real streaming problems (such as learning from transactions, sensors or other sequential observations) that require processing and forecasting in the real time. In this paper we deal with two issues related to incremental learning - prediction accuracy and prediction explanation - and demonstrate their applicability on several streaming problems for predicting electricity load in the future. For improving prediction accuracy we propose and evaluate the use of two reliability estimators that allow us to estimate prediction error and correct predictions. For improving interpretability of the incremental model and its predictions we propose an adaptation of the existing prediction explanation methodology, which was originally developed for batch learning from stationary data. The explanation methodology is combined with a state-of-the-art concept drift detector and a visualization technique to enhance the explanation in dynamic streaming settings. The results show that the proposed approaches can improve prediction accuracy and allow transparent insight into the modeled concept.2017-11-20T14:28:51Z2014-01-01T00:00:00Z2014info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttp://repositorio.inesctec.pt/handle/123456789/3707http://dx.doi.org/10.1016/j.engappai.2014.06.001engBosnic,ZDemsar,JKespret,GPedro Pereira RodriguesJoão GamaKononenko,Iinfo:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2023-05-15T10:20:20Zoai:repositorio.inesctec.pt:123456789/3707Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-19T17:52:58.310833Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv Enhancing data stream predictions with reliability estimators and explanation
title Enhancing data stream predictions with reliability estimators and explanation
spellingShingle Enhancing data stream predictions with reliability estimators and explanation
Bosnic,Z
title_short Enhancing data stream predictions with reliability estimators and explanation
title_full Enhancing data stream predictions with reliability estimators and explanation
title_fullStr Enhancing data stream predictions with reliability estimators and explanation
title_full_unstemmed Enhancing data stream predictions with reliability estimators and explanation
title_sort Enhancing data stream predictions with reliability estimators and explanation
author Bosnic,Z
author_facet Bosnic,Z
Demsar,J
Kespret,G
Pedro Pereira Rodrigues
João Gama
Kononenko,I
author_role author
author2 Demsar,J
Kespret,G
Pedro Pereira Rodrigues
João Gama
Kononenko,I
author2_role author
author
author
author
author
dc.contributor.author.fl_str_mv Bosnic,Z
Demsar,J
Kespret,G
Pedro Pereira Rodrigues
João Gama
Kononenko,I
description Incremental learning from data streams is increasingly attracting research focus due to many real streaming problems (such as learning from transactions, sensors or other sequential observations) that require processing and forecasting in the real time. In this paper we deal with two issues related to incremental learning - prediction accuracy and prediction explanation - and demonstrate their applicability on several streaming problems for predicting electricity load in the future. For improving prediction accuracy we propose and evaluate the use of two reliability estimators that allow us to estimate prediction error and correct predictions. For improving interpretability of the incremental model and its predictions we propose an adaptation of the existing prediction explanation methodology, which was originally developed for batch learning from stationary data. The explanation methodology is combined with a state-of-the-art concept drift detector and a visualization technique to enhance the explanation in dynamic streaming settings. The results show that the proposed approaches can improve prediction accuracy and allow transparent insight into the modeled concept.
publishDate 2014
dc.date.none.fl_str_mv 2014-01-01T00:00:00Z
2014
2017-11-20T14:28:51Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://repositorio.inesctec.pt/handle/123456789/3707
http://dx.doi.org/10.1016/j.engappai.2014.06.001
url http://repositorio.inesctec.pt/handle/123456789/3707
http://dx.doi.org/10.1016/j.engappai.2014.06.001
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799131604824621056