Novelty detection in UAV images to identify emerging threats in eucalyptus crops

• Autor(a) principal: Coletta, Luiz F.S. [UNESP]
• Data de Publicação: 2022
• Outros Autores: de Almeida, Douglas C. [UNESP], Souza, Jefferson R., Manzione, Rodrigo L. [UNESP]
• Tipo de documento: Artigo
• Idioma: eng
• Título da fonte: Repositório Institucional da UNESP
• Texto Completo: http://dx.doi.org/10.1016/j.compag.2022.106901; http://hdl.handle.net/11449/223751
• topic: Active learning; New threats classification; Novelty detection; Semi-supervised learning

Supervised learning-based methods can identify crop threats in the visual data collected by an Unmanned Aerial Vehicle (UAV). However, as these methods induce classification models from a finite set of a priori known classes, they cannot recognize new patterns emerging in visual data to be classified. In agricultural environments, these patterns may appear over time, so that those related to diseases/pests should be addressed by the classifier timely. This study investigates an extension of a semi-supervised classification algorithm to identify new classes of threats appearing in UAV visual data. To do so, the algorithm aggregates information from clusters with Support Vector Machine (SVM) outcomes operating on the unlabeled (target) data. From an iterative active learning procedure, the classification model is then fed back to learn a new class. Experimental results showed that our algorithm can discover a new threat, named Ceratocystis wilt, in Eucalyptus plantations even with labeled data scarcity and class imbalance. Also, even this new class being the minority one, its error rate was reduced to almost zero in few iterations on a tested dataset. This is due to the adopted Entropy and Density-based Selection approach, which explored the new class better than an SVM Margin Sampling baseline. When operating on VGGNet-16 deep features, our algorithm achieved accuracies between 92% and 97% being slightly better than those results based on hand-crafted features.