Fine-tuning Deep Belief Networks using Harmony Search

• Autor(a) principal: Papa, João Paulo [UNESP]
• Data de Publicação: 2016
• Outros Autores: Scheirer, Walter, Cox, David Daniel
• Tipo de documento: Artigo
• Idioma: eng
• Título da fonte: Repositório Institucional da UNESP
• Texto Completo: http://dx.doi.org/10.1016/j.asoc.2015.08.043; http://hdl.handle.net/11449/177563
• topic: Deep Belief Networks; Harmony Search; Meta-heuristics; Restricted Boltzmann Machines

In this paper, we deal with the problem of Deep Belief Networks (DBNs) parameters fine-tuning by means of a fast meta-heuristic approach named Harmony Search (HS). Although such deep learning-based technique has been widely used in the last years, more detailed studies about how to set its parameters may not be observed in the literature. We have shown we can obtain more accurate results comparing HS against with several of its variants, a random search and two variants of the well-known Hyperopt library. The experimental results were carried out in two public datasets considering the task of binary image reconstruction, three DBN learning algorithms and three layers.