Dysarthric Speech Recognition, Detection and Classification using Raw Phase and Magnitude Spectra

Research output: Chapter in Book/Report/Conference proceedingConference paperpeer-review

126 Downloads (Pure)

Abstract

In this paper, we explore the effectiveness of deploying the raw phase and magnitude spectra for dysarthric speech recognition, detection and classification. In particular, we scrutinise the use- fulness of various raw phase-based representations along with their combinations with the raw magnitude spectrum and fil- terbank features. We employed single and multi-stream archi- tectures consisting of a cascade of convolutional, recurrent and fully-connected layers for acoustic modelling. Furthermore, we investigate various configurations and fusion schemes as well as their training dynamics. In addition, the accuracies of the raw phase and magnitude based systems in the detection and classification tasks are studied and discussed. We report the performance on the UASpeech and TORGO dysarthric speech databases and for different severity levels. Our best system achieved WERs of 31.2% and 9.1% for dysarthric and typical speech on TORGO and 30.2% on UASpeech, respectively.
Original languageEnglish
Title of host publicationProceedings of INTERSPEECH 2023
PublisherISCA-INST SPEECH COMMUNICATION ASSOC
Number of pages5
Publication statusAccepted/In press - 17 May 2023

Fingerprint

Dive into the research topics of 'Dysarthric Speech Recognition, Detection and Classification using Raw Phase and Magnitude Spectra'. Together they form a unique fingerprint.

Cite this