Weakness evaluation on in-vehicle violence detection: an assessment of X3D, C2D and I3D against FGSM and PGD

• Autor(a) principal: Santos, Flávio
• Data de Publicação: 2022
• Outros Autores: Durães, Dalila, Marcondes, Francisco S., Hammerschmidt, Niklas, Machado, José Manuel, Novais, Paulo
• Tipo de documento: Artigo
• Idioma: eng
• Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
• Texto Completo: https://hdl.handle.net/1822/78013
• topic: Action recognition; Deep learning; In-car recognition; Violence recognition; Science & Technology

When constructing a deep learning model for recognizing violence inside a vehicle, it is crucial to consider several aspects. One aspect is the computational limitations, and the other is the deep learning model architecture chosen. Nevertheless, to choose the best deep learning model, it is necessary to test and evaluate the model against adversarial attacks. This paper presented three different architecture models for violence recognition inside a vehicle. These model architectures were evaluated based on adversarial attacks and interpretability methods. An analysis of the model’s convergence was conducted, followed by adversarial robustness for each model and a sanity-check based on interpretability analysis. It compared a standard evaluation for training and testing data samples with the adversarial attacks techniques. These two levels of analysis are essential to verify model weakness and sensibility regarding the complete video and in a frame-by-frame way.