Synthesis Speech Based Data Augmentation for Low Resource Children ASR

Loading...
Thumbnail Image

Access rights

openAccess

URL

Journal Title

Journal ISSN

Volume Title

A4 Artikkeli konferenssijulkaisussa

Date

2021

Major/Subject

Mcode

Degree programme

Language

en

Pages

10
317-326

Series

Speech and Computer - 23rd International Conference, SPECOM 2021, Proceedings, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Volume 12997 LNAI

Abstract

Successful speech recognition for children requires large training data with sufficient speaker variability. The collection of such a training database of children’s voices is challenging and very expensive for zero/low resource language like Punjabi. In this paper, the data scarcity issue of the low resourced language Punjabi is addressed through two levels of augmentation. The original training corpus is first augmented by modifying the prosody parameters for pitch and speaking rate. Our results show that the augmentation improves the system performance over the baseline system. Then the augmented data combined with original data and used to train the TTS system to generate synthesis data and extended dataset is further used for augmented by generating children’s utterances using text-to-speech synthesis and sampling the language model with methods that increase the acoustic and lexical diversity. The final speech recognition performance indicates a relative improvement of 50.10% with acoustic and 57.40% with language diversity based augmentation in comparison to that of the baseline system respectively.

Description

Publisher Copyright: © 2021, Springer Nature Switzerland AG.

Keywords

Children speech recognition, Low resource, Prosody modification, Speech synthesis, Tacotron

Other note

Citation

Kadyan, V, Kathania, H, Govil, P & Kurimo, M 2021, Synthesis Speech Based Data Augmentation for Low Resource Children ASR . in A Karpov & R Potapova (eds), Speech and Computer - 23rd International Conference, SPECOM 2021, Proceedings . Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 12997 LNAI, Springer, pp. 317-326, International Conference on Speech and Computer, Virtual, Online, 27/09/2021 . https://doi.org/10.1007/978-3-030-87802-3_29