People with Parkinson’s Disease (PwPD) usually experience several neuropsychiatric signs such as anxiety, depression, and negative emotions that contribute to disability and worsening of quality of life. Notwithstanding, the assessment of these symptoms are largely underrated, subjective and difficult due to a large overlapping with other PD symptoms, like hypomimia and bradikinesia. The aim and novelty of the current work is to study and validate a method for automatic emotion recognition in PwPD during daily living through autonomic signals acquired by acceptable and low-cost consumer technology. The best shallow learning algorithm and the best minimal feature set are individuated. 11 PwPD and 8 subjects with no history of neurological injury or illness were enrolled in the study. Participants were asked to watch video clips purposely selected to arouse emotions, and annotate arousal and valence of emotions triggered by video clips, while their heart rate, skin conductance, and temperature were recorded by a smartwatch. Smartwatch data was used for features extraction, while participants’ reported arousal and valence were used as gold-standard to train machine learning algorithms for emotion classification (low/high arousal, positive/negative valence). Different feature sets and different algorithms (i.e.decision tree (DT), random forest (RF), support vector machine (SVM), and multilayer perceptron (MLP)) were evaluated to find the best solution for each group of participant. In each group of participants, it was possible to find a combination of feature set and algorithm to reach a classification accuracy greater than 90%. The Random Forest reached the best performance in both groups and for both valence and arousal. For each classification task (valence or arousal, PwPD or controls), the best model was selected and the minimal feature set was found by performing a recursive feature elimination based on the Shapley value. A lower accuracy of appraisal emerged for arousal compared to valence. Obtained results showed the feasibility of automatic emotion recognition in PwPDs through autonomic signals. Autonomic dysfunction in PwPDs may explain the lower arousal accuracy. The findings warrant confirmation from trials on larger samples and there are open issues to be deepened in future work.

Supervised learning for automatic emotion recognition in Parkinson’s disease through smartwatch signals / Pepa, Lucia; Spalazzi, Luca; Ceravolo, Maria Gabriella; Capecci, Marianna. - In: EXPERT SYSTEMS WITH APPLICATIONS. - ISSN 0957-4174. - STAMPA. - 249:(2024). [10.1016/j.eswa.2024.123474]

Supervised learning for automatic emotion recognition in Parkinson’s disease through smartwatch signals

Pepa, Lucia
Primo
;
Spalazzi, Luca
Secondo
;
Ceravolo, Maria Gabriella
Penultimo
;
Capecci, Marianna
Ultimo
2024-01-01

Abstract

People with Parkinson’s Disease (PwPD) usually experience several neuropsychiatric signs such as anxiety, depression, and negative emotions that contribute to disability and worsening of quality of life. Notwithstanding, the assessment of these symptoms are largely underrated, subjective and difficult due to a large overlapping with other PD symptoms, like hypomimia and bradikinesia. The aim and novelty of the current work is to study and validate a method for automatic emotion recognition in PwPD during daily living through autonomic signals acquired by acceptable and low-cost consumer technology. The best shallow learning algorithm and the best minimal feature set are individuated. 11 PwPD and 8 subjects with no history of neurological injury or illness were enrolled in the study. Participants were asked to watch video clips purposely selected to arouse emotions, and annotate arousal and valence of emotions triggered by video clips, while their heart rate, skin conductance, and temperature were recorded by a smartwatch. Smartwatch data was used for features extraction, while participants’ reported arousal and valence were used as gold-standard to train machine learning algorithms for emotion classification (low/high arousal, positive/negative valence). Different feature sets and different algorithms (i.e.decision tree (DT), random forest (RF), support vector machine (SVM), and multilayer perceptron (MLP)) were evaluated to find the best solution for each group of participant. In each group of participants, it was possible to find a combination of feature set and algorithm to reach a classification accuracy greater than 90%. The Random Forest reached the best performance in both groups and for both valence and arousal. For each classification task (valence or arousal, PwPD or controls), the best model was selected and the minimal feature set was found by performing a recursive feature elimination based on the Shapley value. A lower accuracy of appraisal emerged for arousal compared to valence. Obtained results showed the feasibility of automatic emotion recognition in PwPDs through autonomic signals. Autonomic dysfunction in PwPDs may explain the lower arousal accuracy. The findings warrant confirmation from trials on larger samples and there are open issues to be deepened in future work.
2024
File in questo prodotto:
File Dimensione Formato  
Pepa_Supervised-learning-automatic-emotion_2024.pdf

Solo gestori archivio

Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza d'uso: Tutti i diritti riservati
Dimensione 3.17 MB
Formato Adobe PDF
3.17 MB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pepa_Supervised-learning-automatic-emotion_Post-print_2024.pdf

embargo fino al 13/02/2026

Tipologia: Documento in post-print (versione successiva alla peer review e accettata per la pubblicazione)
Licenza d'uso: Creative commons
Dimensione 4.9 MB
Formato Adobe PDF
4.9 MB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11566/328054
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact