This paper presents AIRA-D FusionNet, a multi-modal system for violence recognition that integrates visual analysis using a MoViNet-A0 backbone with auditory processing of MFCC features through a BiLSTM network. Trained on a combined dataset, our fused model achieves a recall of 0.91 and an AUC of 0.856, demonstrating a 12% improvement in recall over unimodal baselines by effectively leveraging complementary audio-visual cues. To enable practical deployment, the model was successfully optimized for mobile inference by conversion to TensorFlow Lite. This confirms the system's viability for real-time violence detection applications on resource-constrained devices, offering a sensitive and efficient solution for automated security monitoring.
AIRA-D FusionNet: A Multi-Modal Deep Learning Framework for Violence Recognition through Audio-Visual Cues / Halilaj, M., Bekteshi, E., Myrto, E., Dragoni, A.F.. - ELETTRONICO. - (2026). (3rd International Conference on Artificial Intelligence, Computer, Data Sciences, and Applications, ACDSA 2026 Boracay Island 5 - 7 February 2026) [10.1109/ACDSA67686.2026.11468260].
AIRA-D FusionNet: A Multi-Modal Deep Learning Framework for Violence Recognition through Audio-Visual Cues
Halilaj M.Primo
;Dragoni A. F.Ultimo
2026-01-01
Abstract
This paper presents AIRA-D FusionNet, a multi-modal system for violence recognition that integrates visual analysis using a MoViNet-A0 backbone with auditory processing of MFCC features through a BiLSTM network. Trained on a combined dataset, our fused model achieves a recall of 0.91 and an AUC of 0.856, demonstrating a 12% improvement in recall over unimodal baselines by effectively leveraging complementary audio-visual cues. To enable practical deployment, the model was successfully optimized for mobile inference by conversion to TensorFlow Lite. This confirms the system's viability for real-time violence detection applications on resource-constrained devices, offering a sensitive and efficient solution for automated security monitoring.| File | Dimensione | Formato | |
|---|---|---|---|
|
Halilaj_AIRA-D-FusionNet-Multi-Modal_2026.pdf
Solo gestori archivio
Tipologia:
Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza d'uso:
Tutti i diritti riservati
Dimensione
455.16 kB
Formato
Adobe PDF
|
455.16 kB | Adobe PDF | Visualizza/Apri Richiedi una copia |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.


