Multimodal imaging of language perception

Thumbnail Image
Journal Title
Journal ISSN
Volume Title
Aalto-yliopiston teknillinen korkeakoulu | Doctoral thesis (article-based)
Checking the digitized thesis and permission for publishing
Instructions for the author
Degree programme
Verkkokirja (989 KB, 49 s.)
TKK dissertations, 221
This Thesis draws together several lines of research by examining language perception in the same individuals using three neuroimaging methods: magnetoencephalography (MEG), functional magnetic resonance imaging (fMRI), and electroencephalography (EEG). The MEG experiments conducted in this Thesis demonstrated that neural processing of written and spoken words converges to the superior temporal cortex following initial modality-specific analysis. In both reading and speech perception, the superior temporal cortex is involved in processing word meaning at ∼250-450 ms in the left hemisphere and after ∼450 ms bilaterally. The data thus support a view of a largely shared semantic system in auditory and visual language perception, in line with the assumption that reading acquisition makes use of the neural systems originally developed for speech perception during evolution and in individual language development. The MEG experiments on reading morphologically complex words showed that the left superior temporal activation was enhanced for the morphologically complex words at ∼200-700 ms. The results suggest that the majority of inflected words in the highly inflected Finnish language are represented in a decomposed form and that the decomposition process requires additional neural resources. Only very high-frequency inflected words may acquire full-form representations. The MEG results on parafoveal preview in reading indicated that neural processing of written words in the left hemisphere is affected by a preview of words in the right visual field. The underlying neural mechanism may facilitate reading of connected text in natural conditions. In a direct comparison, MEG and fMRI showed diverging activation patterns in a reading task although the same individuals were performing the same task. Based on the similarity of the EEG responses recorded simultaneously with both MEG and fMRI, the participants were performing the task similarly during the two recordings. The divergent MEG and fMRI results cannot be attributed to differences in the experimental procedures or language since these factors were controlled. Rather, they are likely to reflect actual dissimilarities in the way neural activity in a high-level cognitive task is picked up by MEG evoked responses and fMRI signals.
Supervising professor
Ilmoniemi, Risto, Prof.
Thesis advisor
Salmelin, Riitta, Academy Prof.
neuroimaging, MEG, fMRI, EEG, reading, speech recognition
Other note
  • [Publication 1]: Johanna Uusvuori, Tiina Parviainen, Marianne Inkinen, and Riitta Salmelin. 2008. Spatiotemporal interaction between sound form and meaning during spoken word perception. Cerebral Cortex, volume 18, number 2, pages 456-466. © 2008 Oxford University Press. By permission.
  • [Publication 2]: Johanna Vartiainen, Tiina Parviainen, and Riitta Salmelin. 2009. Spatiotemporal convergence of semantic processing in reading and speech perception. The Journal of Neuroscience, volume 29, number 29, pages 9271-9280. © 2009 by authors.
  • [Publication 3]: Johanna Vartiainen, Mia Liljeström, Miika Koskinen, Hanna Renvall, and Riitta Salmelin. 2010. MEG and fMRI reveal different activation patterns in reading. Espoo, Finland: Aalto University School of Science and Technology. 30 pages. Helsinki University of Technology, Low Temperature Laboratory Publications, Report TKK-KYL-022. ISBN 978-952-60-3051-7.
  • [Publication 4]: Johanna Vartiainen, Silvia Aggujaro, Minna Lehtonen, Annika Hultén, Matti Laine, and Riitta Salmelin. 2009. Neural dynamics of reading morphologically complex words. NeuroImage, volume 47, number 4, pages 2064-2072. © 2009 Elsevier Science. By permission.
  • [Publication 5]: C. Pernet, J. Uusvuori, and R. Salmelin. 2007. Parafoveal-on-foveal and foveal word priming are different processes: Behavioral and neurophysiological evidence. NeuroImage, volume 38, number 2, pages 321-330. © 2007 Elsevier Science. By permission.