A pronunciation Scoring System Embedded into Children’s Foreign Language Learning Games with Experimental Verification of Learning Benefits
Loading...
Access rights
openAccess
publishedVersion
URL
Journal Title
Journal ISSN
Volume Title
A4 Artikkeli konferenssijulkaisussa
This publication is imported from Aalto University research portal.
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
Date
Major/Subject
Mcode
Degree programme
Language
en
Pages
5
Series
9th Workshop on Speech and Language Technology in Education (SLaTE), ISCA International Workshop on Speech and Language Technology in Education
Abstract
Over the years, language technology has become a valuable asset for foreign language learners. In this work, we introduce pronunciation feedback scoring systems for 6-12 year old children. The scoring systems were embedded in second-language (L2) English learning games that were designed to prompt children to repeat words. Speech and phone recognition models were used to validate utterances and extract phoneme-wise statistics, which were used to compute feedback scores of 0-5 stars. The scoring systems were trained to mimic the preferences of a single expert who evaluated all the training data. Our automatic scoring system reached a correlation of 0.59 to the human annotation. This system was also tested in a learning experiment, where EEG measurements indicated that children who played our learning game with our scoring engine for pronunciation feedback improved their perception of speech sounds. We release the game codes and the speech data used to train the scoring system.Description
Keywords
Other note
Citation
Karhila, R, Ylinen, S, Smolander, A-R, Rouhe, A, Al-Ghezi, R, Getman, Y, Grosz, T, Uther, M & Kurimo, M 2023, A pronunciation Scoring System Embedded into Children’s Foreign Language Learning Games with Experimental Verification of Learning Benefits. in 9th Workshop on Speech and Language Technology in Education (SLaTE). ISCA International Workshop on Speech and Language Technology in Education, International Speech Communication Association (ISCA), Workshop on Speech and Language Technology in Education, Dublin, Ireland, 18/08/2023. https://doi.org/10.21437/slate.2023-5