Regional models and minimal learning machines for nonlinear dynamical system identification
Autor(a) principal: | |
---|---|
Data de Publicação: | 2014 |
Tipo de documento: | Tese |
Idioma: | eng |
Título da fonte: | Repositório Institucional da Universidade Federal do Ceará (UFC) |
Texto Completo: | http://www.repositorio.ufc.br/handle/riufc/12481 |
Resumo: | This thesis addresses the problem of identifying nonlinear dynamic systems from a machine learning perspective. In this context, very little is assumed to be known about the system under investigation, and the only source of information comes from input/output measurements on the system. It corresponds to the black-box modeling approach. Numerous strategies and models have been proposed over the last decades in the machine learning field and applied to modeling tasks in a straightforward way. Despite of this variety, the methods can be roughly categorized into global and local modeling approaches. Global modeling consists in fitting a single regression model to the available data, using the whole set of input and output observations. On the other side of the spectrum stands the local modeling approach, in which the input space is segmented into several small partitions and a specialized regression model is fit to each partition. The first contribution of the thesis is a novel supervised global learning model, the Minimal Learning Machine (MLM). Learning in MLM consists in building a linear mapping between input and output distance matrices and then estimating the nonlinear response from the geometrical configuration of the output points. Given its general formulation, the Minimal Learning Machine is inherently capable of operating on nonlinear regression problems as well as on multidimensional response spaces. Naturally, its characteristics make the MLM able to tackle the system modeling problem. The second significant contribution of the thesis represents a different modeling paradigm, called Regional Modeling (RM), and it is motivated by the parsimonious principle. Regional models stand between the global and local modeling approaches. The proposal consists of a two-level clustering approach in which we first partition the input space using the Self-Organizing Map (SOM), and then perform clustering over the prototypes of the trained SOM. After that, regression models are built over the clusters of SOM prototypes, or regions in the input space. Even though the proposals of the thesis can be thought as quite general regression or supervised learning models, the performance assessment is carried out in the context of system identification. Comprehensive performance evaluation of the proposed models on synthetic and real-world datasets is carried out and the results compared to those achieved by standard global and local models. The experiments illustrate that the proposed methods achieve accuracies that are comparable to, and even better than, more traditional machine learning methods thus offering a valid alternative to such approaches |
id |
UFC-7_33d1a3bf1d0f185c0505c47c73bef176 |
---|---|
oai_identifier_str |
oai:repositorio.ufc.br:riufc/12481 |
network_acronym_str |
UFC-7 |
network_name_str |
Repositório Institucional da Universidade Federal do Ceará (UFC) |
repository_id_str |
|
spelling |
Regional models and minimal learning machines for nonlinear dynamical system identificationTeleinformáticaAprendizagem supervisionadaModelagem não linearThis thesis addresses the problem of identifying nonlinear dynamic systems from a machine learning perspective. In this context, very little is assumed to be known about the system under investigation, and the only source of information comes from input/output measurements on the system. It corresponds to the black-box modeling approach. Numerous strategies and models have been proposed over the last decades in the machine learning field and applied to modeling tasks in a straightforward way. Despite of this variety, the methods can be roughly categorized into global and local modeling approaches. Global modeling consists in fitting a single regression model to the available data, using the whole set of input and output observations. On the other side of the spectrum stands the local modeling approach, in which the input space is segmented into several small partitions and a specialized regression model is fit to each partition. The first contribution of the thesis is a novel supervised global learning model, the Minimal Learning Machine (MLM). Learning in MLM consists in building a linear mapping between input and output distance matrices and then estimating the nonlinear response from the geometrical configuration of the output points. Given its general formulation, the Minimal Learning Machine is inherently capable of operating on nonlinear regression problems as well as on multidimensional response spaces. Naturally, its characteristics make the MLM able to tackle the system modeling problem. The second significant contribution of the thesis represents a different modeling paradigm, called Regional Modeling (RM), and it is motivated by the parsimonious principle. Regional models stand between the global and local modeling approaches. The proposal consists of a two-level clustering approach in which we first partition the input space using the Self-Organizing Map (SOM), and then perform clustering over the prototypes of the trained SOM. After that, regression models are built over the clusters of SOM prototypes, or regions in the input space. Even though the proposals of the thesis can be thought as quite general regression or supervised learning models, the performance assessment is carried out in the context of system identification. Comprehensive performance evaluation of the proposed models on synthetic and real-world datasets is carried out and the results compared to those achieved by standard global and local models. The experiments illustrate that the proposed methods achieve accuracies that are comparable to, and even better than, more traditional machine learning methods thus offering a valid alternative to such approachesBarreto, Guilherme de AlencarSouza Júnior, Amauri Holanda de2015-05-27T19:40:24Z2015-05-27T19:40:24Z2014info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/doctoralThesisapplication/pdfSOUZA JÚNIOR, A. H. Regional models and minimal learning machines for nonlinear dynamical system identification. 2014. 116 f. Tese (Doutorado em Engenharia de Teleinformática)–Centro de Tecnologia, Universidade Federal do Ceará, Fortaleza, 2014.http://www.repositorio.ufc.br/handle/riufc/12481engreponame:Repositório Institucional da Universidade Federal do Ceará (UFC)instname:Universidade Federal do Ceará (UFC)instacron:UFCinfo:eu-repo/semantics/openAccess2020-08-24T15:10:10Zoai:repositorio.ufc.br:riufc/12481Repositório InstitucionalPUBhttp://www.repositorio.ufc.br/ri-oai/requestbu@ufc.br || repositorio@ufc.bropendoar:2020-08-24T15:10:10Repositório Institucional da Universidade Federal do Ceará (UFC) - Universidade Federal do Ceará (UFC)false |
dc.title.none.fl_str_mv |
Regional models and minimal learning machines for nonlinear dynamical system identification |
title |
Regional models and minimal learning machines for nonlinear dynamical system identification |
spellingShingle |
Regional models and minimal learning machines for nonlinear dynamical system identification Souza Júnior, Amauri Holanda de Teleinformática Aprendizagem supervisionada Modelagem não linear |
title_short |
Regional models and minimal learning machines for nonlinear dynamical system identification |
title_full |
Regional models and minimal learning machines for nonlinear dynamical system identification |
title_fullStr |
Regional models and minimal learning machines for nonlinear dynamical system identification |
title_full_unstemmed |
Regional models and minimal learning machines for nonlinear dynamical system identification |
title_sort |
Regional models and minimal learning machines for nonlinear dynamical system identification |
author |
Souza Júnior, Amauri Holanda de |
author_facet |
Souza Júnior, Amauri Holanda de |
author_role |
author |
dc.contributor.none.fl_str_mv |
Barreto, Guilherme de Alencar |
dc.contributor.author.fl_str_mv |
Souza Júnior, Amauri Holanda de |
dc.subject.por.fl_str_mv |
Teleinformática Aprendizagem supervisionada Modelagem não linear |
topic |
Teleinformática Aprendizagem supervisionada Modelagem não linear |
description |
This thesis addresses the problem of identifying nonlinear dynamic systems from a machine learning perspective. In this context, very little is assumed to be known about the system under investigation, and the only source of information comes from input/output measurements on the system. It corresponds to the black-box modeling approach. Numerous strategies and models have been proposed over the last decades in the machine learning field and applied to modeling tasks in a straightforward way. Despite of this variety, the methods can be roughly categorized into global and local modeling approaches. Global modeling consists in fitting a single regression model to the available data, using the whole set of input and output observations. On the other side of the spectrum stands the local modeling approach, in which the input space is segmented into several small partitions and a specialized regression model is fit to each partition. The first contribution of the thesis is a novel supervised global learning model, the Minimal Learning Machine (MLM). Learning in MLM consists in building a linear mapping between input and output distance matrices and then estimating the nonlinear response from the geometrical configuration of the output points. Given its general formulation, the Minimal Learning Machine is inherently capable of operating on nonlinear regression problems as well as on multidimensional response spaces. Naturally, its characteristics make the MLM able to tackle the system modeling problem. The second significant contribution of the thesis represents a different modeling paradigm, called Regional Modeling (RM), and it is motivated by the parsimonious principle. Regional models stand between the global and local modeling approaches. The proposal consists of a two-level clustering approach in which we first partition the input space using the Self-Organizing Map (SOM), and then perform clustering over the prototypes of the trained SOM. After that, regression models are built over the clusters of SOM prototypes, or regions in the input space. Even though the proposals of the thesis can be thought as quite general regression or supervised learning models, the performance assessment is carried out in the context of system identification. Comprehensive performance evaluation of the proposed models on synthetic and real-world datasets is carried out and the results compared to those achieved by standard global and local models. The experiments illustrate that the proposed methods achieve accuracies that are comparable to, and even better than, more traditional machine learning methods thus offering a valid alternative to such approaches |
publishDate |
2014 |
dc.date.none.fl_str_mv |
2014 2015-05-27T19:40:24Z 2015-05-27T19:40:24Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/doctoralThesis |
format |
doctoralThesis |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
SOUZA JÚNIOR, A. H. Regional models and minimal learning machines for nonlinear dynamical system identification. 2014. 116 f. Tese (Doutorado em Engenharia de Teleinformática)–Centro de Tecnologia, Universidade Federal do Ceará, Fortaleza, 2014. http://www.repositorio.ufc.br/handle/riufc/12481 |
identifier_str_mv |
SOUZA JÚNIOR, A. H. Regional models and minimal learning machines for nonlinear dynamical system identification. 2014. 116 f. Tese (Doutorado em Engenharia de Teleinformática)–Centro de Tecnologia, Universidade Federal do Ceará, Fortaleza, 2014. |
url |
http://www.repositorio.ufc.br/handle/riufc/12481 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
application/pdf |
dc.source.none.fl_str_mv |
reponame:Repositório Institucional da Universidade Federal do Ceará (UFC) instname:Universidade Federal do Ceará (UFC) instacron:UFC |
instname_str |
Universidade Federal do Ceará (UFC) |
instacron_str |
UFC |
institution |
UFC |
reponame_str |
Repositório Institucional da Universidade Federal do Ceará (UFC) |
collection |
Repositório Institucional da Universidade Federal do Ceará (UFC) |
repository.name.fl_str_mv |
Repositório Institucional da Universidade Federal do Ceará (UFC) - Universidade Federal do Ceará (UFC) |
repository.mail.fl_str_mv |
bu@ufc.br || repositorio@ufc.br |
_version_ |
1809935812081483776 |