New data, benchmark and baseline for L2 speaking assessment for low-resource languages
dc.contributor | Aalto-yliopisto | fi |
dc.contributor | Aalto University | en |
dc.contributor.author | Kurimo, Mikko | en_US |
dc.contributor.author | Getman, Yaroslav | en_US |
dc.contributor.author | Voskoboinik, Ekaterina | en_US |
dc.contributor.author | Al-Ghezi, Ragheb | en_US |
dc.contributor.author | Kallio, Heini | en_US |
dc.contributor.author | Kuronen, Mikko | en_US |
dc.contributor.author | von Zansen, Anna | en_US |
dc.contributor.author | Hilden, Raili | en_US |
dc.contributor.author | Kronholm, Sirkku | en_US |
dc.contributor.author | Huhta, Ari | en_US |
dc.contributor.author | Lindén, Krister | en_US |
dc.contributor.department | Department of Information and Communications Engineering | en |
dc.contributor.groupauthor | Speech Recognition | en |
dc.contributor.organization | Speech Recognition | en_US |
dc.contributor.organization | University of Jyväskylä | en_US |
dc.contributor.organization | University of Helsinki | en_US |
dc.date.accessioned | 2023-11-29T09:50:27Z | |
dc.date.available | 2023-11-29T09:50:27Z | |
dc.date.issued | 2023 | en_US |
dc.description | Workshop on Speech and Language Technology in Education : SLaTE ; Conference date: 18-08-2023 Through 20-08-2023 | |
dc.description.abstract | The development of large multilingual speech models provides the possibility to construct high-quality speech technology even for low-resource languages. In this paper, we present the speech data of L2 learners of Finnish and Finland Swedish that we have recently collected for training and evaluation of automatic speech recognition (ASR) and speaking assessment (ASA). It includes over 4000 recordings by over 300 students per language in short read-aloud and free-form tasks. The recordings have been manually transcribed and assessed for pronunciation, fluency, range, accuracy, task achievement, and a holistic proficiency level. We present also an ASR and ASA benchmarking setup we have constructed using this data and include results from our baseline systems built by fine-tuning self-supervised multilingual model for the target language. In addition to benchmarking, our baseline system can be used by L2 students and teachers for online self-training and evaluation of oral proficiency. | en |
dc.description.version | Peer reviewed | en |
dc.format.extent | 5 | |
dc.format.extent | 166-170 | |
dc.format.mimetype | application/pdf | en_US |
dc.identifier.citation | Kurimo, M, Getman, Y, Voskoboinik, E, Al-Ghezi, R, Kallio, H, Kuronen, M, von Zansen, A, Hilden, R, Kronholm, S, Huhta, A & Lindén, K 2023, New data, benchmark and baseline for L2 speaking assessment for low-resource languages . in Proceedings of 9th Workshop on Speech and Language Technology in Education (SLaTE) . ISCA International Workshop on Speech and Language Technology in Education, International Speech Communication Association (ISCA), pp. 166-170, Workshop on Speech and Language Technology in Education, Dublin, Ireland, 18/08/2023 . https://doi.org/10.21437/SLaTE.2023-32 | en |
dc.identifier.doi | 10.21437/SLaTE.2023-32 | en_US |
dc.identifier.issn | 2311-4975 | |
dc.identifier.other | PURE UUID: cae10a3b-fefc-43cc-a539-3bb08c8e8d04 | en_US |
dc.identifier.other | PURE ITEMURL: https://research.aalto.fi/en/publications/cae10a3b-fefc-43cc-a539-3bb08c8e8d04 | en_US |
dc.identifier.other | PURE FILEURL: https://research.aalto.fi/files/128663755/kurimo23_slate.pdf | en_US |
dc.identifier.uri | https://aaltodoc.aalto.fi/handle/123456789/124674 | |
dc.identifier.urn | URN:NBN:fi:aalto-202311297013 | |
dc.language.iso | en | en |
dc.publisher | ISCA - International Speech Communication Association | |
dc.relation.ispartof | Workshop on Speech and Language Technology in Education | en |
dc.relation.ispartofseries | Proceedings of 9th Workshop on Speech and Language Technology in Education (SLaTE) | en |
dc.relation.ispartofseries | ISCA International Workshop on Speech and Language Technology in Education | en |
dc.rights | openAccess | en |
dc.subject.keyword | Educational sciences | en_US |
dc.subject.keyword | suullinen kielitaito | en_US |
dc.subject.keyword | kielitaidon arviointi | en_US |
dc.subject.keyword | oral language skills | en_US |
dc.subject.keyword | language assessment | en_US |
dc.subject.keyword | Electronic | en_US |
dc.subject.keyword | automation and communications engineering | en_US |
dc.subject.keyword | electronics | en_US |
dc.subject.keyword | puheentunnistus | en_US |
dc.subject.keyword | automaattinen puheen arviointi | en_US |
dc.subject.keyword | automatic speech recognition | en_US |
dc.subject.keyword | automatic speaking assessment | en_US |
dc.title | New data, benchmark and baseline for L2 speaking assessment for low-resource languages | en |
dc.type | A4 Artikkeli konferenssijulkaisussa | fi |
dc.type.version | publishedVersion |