This paper presents EbESCNN, a novel Spiking Convolutional Neural Network (SCNN) designed for near-eye pupil tracking using event-based camera data. Operating on binary event representations, the proposed architecture predicts pupil coordinates by employing the membrane potential of spiking neurons as a continuous output for regression. Evaluated on the 3ET+ dataset, the network achieves 86% accuracy within a 10-pixel margin, with a mean Euclidean error of 5.68 pixels, comparable to state-of-the-art methods. Despite long training times, the architecture demonstrates strong potential for efficient and accurate eye tracking in resource-constrained and neuromorphic environments.
EbESCNN: A Eye Binary Event Spiking Convolutional Neural Network Architecture for Event-Based Eye Tracking / Troconis, L. G.; Vella, F.; Freddi, Alessandro; Monteriu', A.. - (2025), pp. 211-216. ( 4th IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering, MetroXRAINE 2025 Ancona, Italy 2025) [10.1109/MetroXRAINE66377.2025.11340169].
EbESCNN: A Eye Binary Event Spiking Convolutional Neural Network Architecture for Event-Based Eye Tracking
Troconis L. G.;Vella F.;Freddi Alessandro;Monteriu' A.
2025-01-01
Abstract
This paper presents EbESCNN, a novel Spiking Convolutional Neural Network (SCNN) designed for near-eye pupil tracking using event-based camera data. Operating on binary event representations, the proposed architecture predicts pupil coordinates by employing the membrane potential of spiking neurons as a continuous output for regression. Evaluated on the 3ET+ dataset, the network achieves 86% accuracy within a 10-pixel margin, with a mean Euclidean error of 5.68 pixels, comparable to state-of-the-art methods. Despite long training times, the architecture demonstrates strong potential for efficient and accurate eye tracking in resource-constrained and neuromorphic environments.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.


