: Dysarthria is a neurological speech disorder characterized by impaired motor control of speech production, resulting in reduced intelligibility. It commonly arises in the context of neurodegenerative conditions, including amyotrophic lateral sclerosis and cerebral palsy. The development of deep learning systems for dysarthria assessment is hindered by the scarcity of annotated data, which restricts the ability of models to generalize to unseen speakers. This study proposes a cross-corpus diffusion-based data augmentation strategy for improving automatic speech intelligibility classification from dysarthric speech. A Grad-TTS model is trained on dysarthric speakers from the TORGO dataset and used to synthesize the vocabulary of UA-Speech, producing speaker-conditioned samples intended to transfer pathological acoustic traits across corpora. The proposed strategy is evaluated both independently and in combination with conventional signal-level augmentation using ResNet-50 and ResNet-152 classifiers in binary and four-class intelligibility classification tasks. The results indicate that cross-corpus synthetic augmentation improves average performance and that, in most settings, its integration with conventional augmentation yields further gains, suggesting that the two strategies introduce complementary forms of variability.

Improving dysarthric speech classification with generative AI-based data augmentation / Lillini, D., Basili, T., Migliorelli, L., Aironi, C., Gabrielli, L., Squartini, S.. - In: MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING. - ISSN 0140-0118. - (2026). [10.1007/s11517-026-03705-x]

Improving dysarthric speech classification with generative AI-based data augmentation

Lillini D.;Aironi C.;Gabrielli L.;Squartini S.
2026-01-01

Abstract

: Dysarthria is a neurological speech disorder characterized by impaired motor control of speech production, resulting in reduced intelligibility. It commonly arises in the context of neurodegenerative conditions, including amyotrophic lateral sclerosis and cerebral palsy. The development of deep learning systems for dysarthria assessment is hindered by the scarcity of annotated data, which restricts the ability of models to generalize to unseen speakers. This study proposes a cross-corpus diffusion-based data augmentation strategy for improving automatic speech intelligibility classification from dysarthric speech. A Grad-TTS model is trained on dysarthric speakers from the TORGO dataset and used to synthesize the vocabulary of UA-Speech, producing speaker-conditioned samples intended to transfer pathological acoustic traits across corpora. The proposed strategy is evaluated both independently and in combination with conventional signal-level augmentation using ResNet-50 and ResNet-152 classifiers in binary and four-class intelligibility classification tasks. The results indicate that cross-corpus synthetic augmentation improves average performance and that, in most settings, its integration with conventional augmentation yields further gains, suggesting that the two strategies introduce complementary forms of variability.
2026
Cross-corpus learning; Diffusion models; Dysarthric speech; Speech intelligibility classification; Synthetic speech; Text-to-speech synthesis
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11566/365896
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? 1
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact