Neurophysiological correlates of producing and perceiving natural connected speech

dc.contributorAalto-yliopistofi
dc.contributorAalto Universityen
dc.contributor.advisorKujala, Jan, Dr., Aalto University, Department of Neuroscience and Biomedical Engineering, Finland
dc.contributor.authorAlexandrou, Anna Maria
dc.contributor.departmentNeurotieteen ja lääketieteellisen tekniikan laitosfi
dc.contributor.departmentDepartment of Neuroscience and Biomedical Engineeringen
dc.contributor.labImaging Languageen
dc.contributor.schoolPerustieteiden korkeakoulufi
dc.contributor.schoolSchool of Scienceen
dc.contributor.supervisorSalmelin, Riitta, Prof., Aalto University, Department of Neuroscience and Biomedical Engineering, Finland
dc.date.accessioned2018-01-06T10:02:21Z
dc.date.available2018-01-06T10:02:21Z
dc.date.defence2018-01-29
dc.date.issued2018
dc.description.abstractSpoken language is an essential part of our every-day lives. Despite being one of the most prominent human behaviors, little is known about the cortical substrates supporting the perception and production of continuous, connected speech. This doctoral dissertation aimed to fill this gap through an extensive experimental paradigm consisting of both natural speech production and speech perception tasks. There was a special emphasis on speech rhythm which is tied to speaking rate. Cortical signals were measured with magnetoencephalography. Electromyographic and acoustic signals were recorded during the speech production tasks. Study I aimed to quantify speech rhythm using a multimodal spectral approach in the form of coherence between electromyographic and acoustic signals. This multimodal approach was compared to a unimodal approach, which involves spectral analysis of electromyographic and acoustic signals in isolation. As opposed to a unimodal analysis, a multimodal analysis was shown to successfully reveal the shared periodic components in the two signals. This suggests that coherence metrics are especially useful in quantifying rhythm in the inherently complex natural speech. Study II investigated the cortical correlates of natural speech production and perception. Modulations in band-limited cortical signal power were examined in response to variations in three fundamental speech-related features: the amount of linguistic content present in an utterance, speaking rate and social relevance. The resulting spatiospectral patterns revealed that the right hemisphere is markedly involved in natural speech processing and, particularly, that processing of socially relevant speech engages the right temporo-parietal junction. Notably, natural speech production and perception were found to extensively overlap in both hemispheres. Study III examined, using audio-MEG coherence, the cortical tracking of global rhythmic structure and local, transient variations in speaking rate in perceived natural, connected speech. It was found that cortical tracking of perceived natural, connected speech extends beyond the previously reported emphasis on the temporal regions and also engages higher-order cortical regions. Furthermore, the observed audio-MEG coherence patterns revealed two spatially and functionally distinct components of cortical tuning: evolutionary tuning to global rhythmic structure, and predictive tuning that is driven by local changes in speaking rate. This doctoral dissertation presents novel methodological tools for characterizing rhythm in natural speech. It also contributes to an emerging view on cortical speech processing that is not confined to traditional left-hemispheric cortical regions and offers an insight into the functional role of speech rhythm in speech comprehension.en
dc.format.extent81 + app. 73
dc.format.mimetypeapplication/pdfen
dc.identifier.isbn978-952-60-7801-4 (electronic)
dc.identifier.isbn978-952-60-7800-7 (printed)
dc.identifier.issn1799-4942 (electronic)
dc.identifier.issn1799-4934 (printed)
dc.identifier.issn1799-4934 (ISSN-L)
dc.identifier.urihttps://aaltodoc.aalto.fi/handle/123456789/29552
dc.identifier.urnURN:ISBN:978-952-60-7801-4
dc.language.isoenen
dc.opnScott, Sophie, Prof., University College London, UK
dc.publisherAalto Universityen
dc.publisherAalto-yliopistofi
dc.relation.haspart[Publication 1]: Alexandrou, A.M., Saarinen, T., Kujala, J., Salmelin, R. (2016). A multimodal spectral approach to characterize rhythm in natural speech. The Journal of the Acoustical Society of America, 139(1), 215-226, DOI: 10.1121/1.4939496
dc.relation.haspart[Publication 2]: Alexandrou, A.M., Saarinen, T., Mäkelä, S., Kujala, J., & Salmelin, R. (2017). The right hemisphere is highlighted in connected natural speech production and perception. NeuroImage, 152C, 628-638, DOI: 10.1016/j.neuroimage.2017.03.006
dc.relation.haspart[Publication 3]: Alexandrou, A.M., Saarinen, T., Kujala, J., & Salmelin, R. (submitted). Cortical tracking of global and local variations of speech rhythm during connected natural speech perception.
dc.relation.ispartofseriesAalto University publication series DOCTORAL DISSERTATIONSen
dc.relation.ispartofseries8/2018
dc.revShtyrov, Yuri, Prof., Aarhus University, Denmark
dc.revTuomainen, Jyrki, Prof., University College London, UK
dc.subject.keywordspeech productionen
dc.subject.keywordspeech perceptionen
dc.subject.keywordspeech rhythmen
dc.subject.keywordcortexen
dc.subject.keywordmagnetoencelphalographyen
dc.subject.otherMedical sciencesen
dc.subject.otherElectrical engineeringen
dc.titleNeurophysiological correlates of producing and perceiving natural connected speechen
dc.typeG5 Artikkeliväitöskirjafi
dc.type.dcmitypetexten
dc.type.ontasotDoctoral dissertation (article-based)en
dc.type.ontasotVäitöskirja (artikkeli)fi
local.aalto.acrisexportstatuschecked
local.aalto.archiveyes
local.aalto.formfolder2018_01_04_klo_12_21
Files
Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
isbn9789526078014.pdf
Size:
3.03 MB
Format:
Adobe Portable Document Format