Entropy-Based Filter Selection in CNNs Applied to Text Classification

• Autor(a) principal: Bezerra de Menezes Rodrigues, Rafael [UNESP]
• Data de Publicação: 2020
• Outros Autores: Marcílio Júnior, Wilson Estécio [UNESP], Eler, Danilo Medeiros [UNESP]
• Tipo de documento: Artigo de conferência
• Idioma: eng
• Título da fonte: Repositório Institucional da UNESP
• Texto Completo: http://dx.doi.org/10.1007/978-3-030-61377-8_34; http://hdl.handle.net/11449/208080
• topic: Convolutional neural networks; Filter pruning; Mutual information

Filter selection in convolutional neural networks aims at finding the most important filters in a convolutional layer, with the goal of reducing computational costs and needed storage, as well as understanding the networks’ inner workings. In this paper we propose an entropy-based filter selection method that ranks filters based on the mutual information between their activations and the output classes using validation data. Our proposed method outperforms using filters’ absolute weights sum by a large margin, allowing to regain better performance with fewer filters.