This paper presents EbESCNN, a novel Spiking Convolutional Neural Network (SCNN) designed for near-eye pupil tracking using event-based camera data. Operating on binary event representations, the proposed architecture predicts pupil coordinates by employing the membrane potential of spiking neurons as a continuous output for regression. Evaluated on the 3ET+ dataset, the network achieves 86% accuracy within a 10-pixel margin, with a mean Euclidean error of 5.68 pixels, comparable to state-of-the-art methods. Despite long training times, the architecture demonstrates strong potential for efficient and accurate eye tracking in resource-constrained and neuromorphic environments.

EbESCNN: A Eye Binary Event Spiking Convolutional Neural Network Architecture for Event-Based Eye Tracking / Troconis, L. G.; Vella, F.; Freddi, Alessandro; Monteriu', A.. - (2025), pp. 211-216. ( 4th IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering, MetroXRAINE 2025 Ancona, Italy 2025) [10.1109/MetroXRAINE66377.2025.11340169].

EbESCNN: A Eye Binary Event Spiking Convolutional Neural Network Architecture for Event-Based Eye Tracking

Troconis L. G.;Vella F.;Freddi Alessandro;Monteriu' A.
2025-01-01

Abstract

This paper presents EbESCNN, a novel Spiking Convolutional Neural Network (SCNN) designed for near-eye pupil tracking using event-based camera data. Operating on binary event representations, the proposed architecture predicts pupil coordinates by employing the membrane potential of spiking neurons as a continuous output for regression. Evaluated on the 3ET+ dataset, the network achieves 86% accuracy within a 10-pixel margin, with a mean Euclidean error of 5.68 pixels, comparable to state-of-the-art methods. Despite long training times, the architecture demonstrates strong potential for efficient and accurate eye tracking in resource-constrained and neuromorphic environments.
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11566/357555
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact