κ-Entropy Based Restricted Boltzmann Machines

• Autor(a) principal: Passos, Leandro Aparecido
• Data de Publicação: 2019
• Outros Autores: Cleison Santana, Marcos [UNESP], Moreira, Thierry [UNESP], Papa, Joao Paulo [UNESP]
• Tipo de documento: Artigo de conferência
• Idioma: eng
• Título da fonte: Repositório Institucional da UNESP
• Texto Completo: http://dx.doi.org/10.1109/IJCNN.2019.8851714; http://hdl.handle.net/11449/201217
• topic: Kaniadakis Entropy; Machine Learning; Restricted Boltzmann Machines

Restricted Boltzmann Machines achieved notorious popularity in the scientific community in the last decade due to outstanding results in a wide range of applications and also for providing the required mechanisms to build successful deep learning models, i.e., Deep Belief Networks and Deep Boltzmann Machines. However, their main bottleneck is related to the learning step, which is usually time-consuming. In this paper, we introduce a Sigmoid-like family of functions based on the Kaniadakis entropy formulation in the context of the RBM learning procedure. Experiments concerning binary image reconstruction are conducted in four public datasets to evaluate the robustness of the proposed approach. The results suggest that such a family of functions is suitable to increase the convergence rate when compared to standard functions employed by the research community.