Bidirectional parallel echo state network for speech emotion recognition

Hemin Ibrahim, Chu Kiong Loo, Fady Alnajjar

Research output: Contribution to journalArticlepeer-review

10 Citations (Scopus)

Abstract

Speech is an effective way for communicating and exchanging complex information between humans. Speech signal has involved a great attention in human-computer interaction. Therefore, emotion recognition from speech has become a hot research topic in the field of interacting machines with humans. In this paper, we proposed a novel speech emotion recognition system by adopting multivariate time series handcrafted feature representation from speech signals. Bidirectional echo state network with two parallel reservoir layers has been applied to capture additional independent information. The parallel reservoirs produce multiple representations for each direction from the bidirectional data with two stages of concatenation. The sparse random projection approach has been adopted to reduce the high-dimensional sparse output for each direction separately from both reservoirs. Random over-sampling and random under-sampling methods are used to overcome the imbalanced nature of the used speech emotion datasets. The performance of the proposed parallel ESN model is evaluated from the speaker-independent experiments on EMO-DB, SAVEE, RAVDESS, and FAU Aibo datasets. The results show that the proposed SER model is superior to the single reservoir and the state-of-the-art studies.

Original languageEnglish
Pages (from-to)17581-17599
Number of pages19
JournalNeural Computing and Applications
Volume34
Issue number20
DOIs
Publication statusPublished - Oct 2022

Keywords

  • Random resampling
  • Recurrent neural network
  • Reservoir computing
  • Speech emotion recognition

ASJC Scopus subject areas

  • Software
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Bidirectional parallel echo state network for speech emotion recognition'. Together they form a unique fingerprint.

Cite this