Abstract
In this paper, we explore the effectiveness of deploying the raw phase and magnitude spectra for dysarthric speech recognition, detection and classification. In particular, we scrutinise the use- fulness of various raw phase-based representations along with their combinations with the raw magnitude spectrum and fil- terbank features. We employed single and multi-stream archi- tectures consisting of a cascade of convolutional, recurrent and fully-connected layers for acoustic modelling. Furthermore, we investigate various configurations and fusion schemes as well as their training dynamics. In addition, the accuracies of the raw phase and magnitude based systems in the detection and classification tasks are studied and discussed. We report the performance on the UASpeech and TORGO dysarthric speech databases and for different severity levels. Our best system achieved WERs of 31.2% and 9.1% for dysarthric and typical speech on TORGO and 30.2% on UASpeech, respectively.
| Original language | English |
|---|---|
| Title of host publication | Proceedings of INTERSPEECH 2023 |
| Publisher | ISCA-INST SPEECH COMMUNICATION ASSOC |
| Number of pages | 5 |
| Publication status | Accepted/In press - 17 May 2023 |