Quaternionic convolutional neural networks with trainable Bessel activation functions

• Autor(a) principal: Vieira, Nelson
• Data de Publicação: 2023
• Tipo de documento: Artigo
• Idioma: eng
• Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
• Texto Completo: http://hdl.handle.net/10773/39163
• topic: Artificial neural networks and deep learning; Activation functions; Quaternionic convolutional neural networks; Bessel functions; Parametric activation functions

Quaternionic Convolutional Neural Networks (QCNN) possess the ability to capture both external dependencies between neighboring features and internal latent dependencies within features of an input vector. In this study, we employ QCNN with activation functions based on Bessel-type functions with trainable parameters, for performing classification tasks. Our experimental results demonstrate that this activation function outperforms the traditional ReLU activation function. Throughout our simulations, we explore various network architectures. The use of activation functions with trainable parameters offers several advantages, including enhanced flexibility, adaptability, improved learning, customized model behavior, and automatic feature extraction.