RGBD camera monitoring system for Alzheimer’s disease assessment using Recurrent Neural Networks with Parametric Bias action recognition

The present paper proposes a computer vision system to diagnose the stage of illness in patients a ected by Alzheimer's disease. In the context of Ambient Assisted Living (AAL), the system monitors people in home environment during daily personal care activities. The aim is to evaluate the dementia stage, observing actions listed in the Direct Assessment of Funcional Status (DAFS) index and detecting anomalies during the performance, in order to assign a score explaining if the action is correct or not. In this work brushing teeth and grooming hair by a hairbrush are analysed. The technology consists of the application of a Recurrent Neural Network with Parametric Bias (RNNPB) that is able to learn movements connected with a speci c action and recognize human activities by parametric bias that work like mirror neurons. This study has been conducted using Microsoft Kinect to collect data about the actions observed and oversee the user tracking and gesture recognition. Experiments prove that the proposed computer vision system can learn and recognize complex human activities and evaluates DAFS score.