Effects of training data variety in generating glottal pulses from acoustic features with DNNs
Conference article in proceedings
Proceedings of Interspeech 2017, Interspeech: Annual Conference of the International Speech Communication Association
AbstractGlottal volume velocity waveform, the acoustical excitation of voiced speech, cannot be acquired through direct measurements in normal production of continuous speech. Glottal inverse filtering (GIF), however, can be used to estimate the glottal flow from recorded speech signals. Unfortunately, the usefulness of GIF algorithms is limited since they are sensitive to noise and call for high-quality recordings. Recently, efforts have been taken to expand the use of GIF by training deep neural networks (DNNs) to learn a statistical mapping between frame-level acoustic features and glottal pulses estimated by GIF. This framework has been successfully utilized in statistical speech synthesis in the form of the GlottDNN vocoder which uses a DNN to generate glottal pulses to be used as the synthesizer’s excitation waveform. In this study, we investigate how the DNN-based generation of glottal pulses is affected by training data variety. The evaluation is done using both objective measures as well as subjective listening tests of synthetic speech. The results suggest that the performance of the glottal pulse generation with DNNs is affected particularly by how well the training corpus suits GIF: processing low-pitched male speech and sustained phonations shows better performance than processing high-pitched female voices or continuous speech.
glottal inverse filtering, speech synthesis
Airaksinen , M & Alku , P 2017 , Effects of training data variety in generating glottal pulses from acoustic features with DNNs . in Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH . vol. 2017-August , Interspeech: Annual Conference of the International Speech Communication Association , International Speech Communication Association (ISCA) , pp. 3946-3950 , Interspeech , Stockholm , Sweden , 20/08/2017 . https://doi.org/10.21437/Interspeech.2017-363