SylNet: An Adaptable End-to-End Syllable Count Estimator for Speech

Thumbnail Image

Access rights

openAccess
acceptedVersion

URL

Journal Title

Journal ISSN

Volume Title

A1 Alkuperäisartikkeli tieteellisessä aikakauslehdessä
This publication is imported from Aalto University research portal.
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)

Authors

Date

2019-09

Department

Department of Signal Processing and Acoustics

Major/Subject

Mcode

Degree programme

Language

en

Pages

5

Series

IEEE Signal Processing Letters, Volume 26, issue 9, pp. 1359-1363

Abstract

Automatic syllable count estimation (SCE) is used in a variety of applications ranging from speaking rate estimation to detecting social activity from wearable microphones or developmental research concerned with quantifying speech heard by language-learning children in different environments. The majority of previously utilized SCE methods have relied on heuristic digital signal processing (DSP) methods, and only a small number of bi-directional long short-term memory (BLSTM) approaches have made use of modern machine learning approaches in the SCE task. This letter presents a novel end-to-end method called SylNet for automatic syllable counting from speech, built on the basis of a recent developments in neural network architectures. We describe how the entire model can be optimized directly to minimize SCE error on the training data without annotations aligned at the syllable level, and how it can be adapted to new languages using limited speech data with known syllable counts. Experiments on several different languages reveal that SylNet generalizes to languages beyond its training data and further improves with adaptation. It also outperforms several previously proposed methods for syllabification, including end-to-end BLSTMs.

Description

Keywords

syllable count estimation, end-to-end learning, deep learning, speech processing, SEGMENTATION

Other note

DOI

10.1109/LSP.2019.2929415

Citation

Seshadri, S & Räsänen, O 2019, 'SylNet : An Adaptable End-to-End Syllable Count Estimator for Speech', IEEE Signal Processing Letters, vol. 26, no. 9, pp. 1359-1363. https://doi.org/10.1109/LSP.2019.2929415

Permanent link to this item

https://urn.fi/URN:NBN:fi:aalto-201909205373

Collections

[article-cris] Sähkötekniikan korkeakoulu / ELEC