Brain activity reflects the predictability of word sequences in listened continuous speech: Brain activity predicts word sequences
| dc.contributor | Aalto-yliopisto | fi |
| dc.contributor | Aalto University | en |
| dc.contributor.author | Koskinen, Miika | en_US |
| dc.contributor.author | Kurimo, Mikko | en_US |
| dc.contributor.author | Gross, Joachim | en_US |
| dc.contributor.author | Hyvärinen, Aapo | en_US |
| dc.contributor.author | Hari, Riitta | en_US |
| dc.contributor.department | Department of Neuroscience and Biomedical Engineering | en |
| dc.contributor.department | Department of Signal Processing and Acoustics | en |
| dc.contributor.department | Department of Art | en |
| dc.contributor.groupauthor | Centre of Excellence in Computational Inference, COIN | en |
| dc.contributor.groupauthor | Speech Recognition | en |
| dc.contributor.organization | University of Glasgow | en_US |
| dc.contributor.organization | University of Helsinki | en_US |
| dc.date.accessioned | 2020-06-25T08:39:59Z | |
| dc.date.available | 2020-06-25T08:39:59Z | |
| dc.date.issued | 2020-10-01 | en_US |
| dc.description.abstract | Natural speech builds on contextual relations that can prompt predictions of upcoming utterances. To study the neural underpinnings of such predictive processing we asked 10 healthy adults to listen to a 1-h-long audiobook while their magnetoencephalographic (MEG) brain activity was recorded. We correlated the MEG signals with acoustic speech envelope, as well as with estimates of Bayesian word probability with and without the contextual word sequence (N-gram and Unigram, respectively), with a focus on time-lags. The MEG signals of auditory and sensorimotor cortices were strongly coupled to the speech envelope at the rates of syllables (4–8 Hz) and of prosody and intonation (0.5–2 Hz). The probability structure of word sequences, independently of the acoustical features, affected the ≤ 2-Hz signals extensively in auditory and rolandic regions, in precuneus, occipital cortices, and lateral and medial frontal regions. Fine-grained temporal progression patterns occurred across brain regions 100–1000 ms after word onsets. Although the acoustic effects were observed in both hemispheres, the contextual influences were statistically significantly lateralized to the left hemisphere. These results serve as a brain signature of the predictability of word sequences in listened continuous speech, confirming and extending previous results to demonstrate that deeply-learned knowledge and recent contextual information are employed dynamically and in a left-hemisphere-dominant manner in predicting the forthcoming words in natural speech. | en |
| dc.description.version | Peer reviewed | en |
| dc.format.extent | 9 | |
| dc.format.mimetype | application/pdf | en_US |
| dc.identifier.citation | Koskinen, M, Kurimo, M, Gross, J, Hyvärinen, A & Hari, R 2020, 'Brain activity reflects the predictability of word sequences in listened continuous speech : Brain activity predicts word sequences', NeuroImage, vol. 219, 116936. https://doi.org/10.1016/j.neuroimage.2020.116936 | en |
| dc.identifier.doi | 10.1016/j.neuroimage.2020.116936 | en_US |
| dc.identifier.issn | 1053-8119 | |
| dc.identifier.issn | 1095-9572 | |
| dc.identifier.other | PURE UUID: 7b9dcf40-b508-4bae-9ddd-df869b4b2168 | en_US |
| dc.identifier.other | PURE ITEMURL: https://research.aalto.fi/en/publications/7b9dcf40-b508-4bae-9ddd-df869b4b2168 | en_US |
| dc.identifier.other | PURE FILEURL: https://research.aalto.fi/files/43534523/Koskinen_Brain_activity_reflects_Neuroimage.pdf | |
| dc.identifier.uri | https://aaltodoc.aalto.fi/handle/123456789/45164 | |
| dc.identifier.urn | URN:NBN:fi:aalto-202006254121 | |
| dc.language.iso | en | en |
| dc.publisher | Elsevier | |
| dc.relation.ispartofseries | NeuroImage | en |
| dc.relation.ispartofseries | Volume 219 | en |
| dc.rights | openAccess | en |
| dc.subject.keyword | Cerebral cortex | en_US |
| dc.subject.keyword | Continuous speech | en_US |
| dc.subject.keyword | Language model | en_US |
| dc.subject.keyword | MEG | en_US |
| dc.subject.keyword | N-gram | en_US |
| dc.subject.keyword | Naturalistic neuroscience | en_US |
| dc.subject.keyword | Speech perception | en_US |
| dc.subject.keyword | Speech–brain coupling | en_US |
| dc.title | Brain activity reflects the predictability of word sequences in listened continuous speech: Brain activity predicts word sequences | en |
| dc.type | A1 Alkuperäisartikkeli tieteellisessä aikakauslehdessä | fi |
| dc.type.version | publishedVersion |