Neurocognitive mechanisms of audiovisual speech perception

 |  Login

Show simple item record

dc.contributor Aalto-yliopisto fi
dc.contributor Aalto University en Ojanen, Ville 2012-02-17T07:01:38Z 2012-02-17T07:01:38Z 2005-05-25
dc.identifier.isbn 951-22-7681-X
dc.identifier.issn 1455-0474
dc.description.abstract Face-to-face communication involves both hearing and seeing speech. Heard and seen speech inputs interact during audiovisual speech perception. Specifically, seeing the speaker's mouth and lip movements improves identification of acoustic speech stimuli, especially in noisy conditions. In addition, visual speech may even change the auditory percept. This occurs when mismatching auditory speech is dubbed onto visual articulation. Research on the brain mechanisms of audiovisual perception aims at revealing where, when and how inputs from different modalities interact. In this thesis, functional magnetic resonance imaging (fMRI), magnetoencephalography (MEG) and behavioral methods were used to study the neurocognitive mechanisms of audiovisual speech perception. The results suggest that interactions during audiovisual and visual speech perception have an effect on auditory speech processing at early levels of processing hierarchy. The results also suggest that auditory and visual speech inputs interact in the motor cortical areas involved in speech production. Some of these regions are part of the "mirror neuron system" (MNS). The MNS performs a specialized primate cerebral function of coupling two fundamental processes – motor action execution and perception – together. It is suggested that this action-perception coupling mechanism might be involved in audiovisual integration of speech. en
dc.format.extent 56, [34]
dc.format.mimetype application/pdf
dc.language.iso en en
dc.publisher Helsinki University of Technology en
dc.publisher Teknillinen korkeakoulu fi
dc.relation.ispartofseries Helsinki University of Technology Laboratory of Computational Engineering publications. Report B en
dc.relation.ispartofseries 49 en
dc.relation.haspart Ojanen, V., Tuomainen, J., and Sams, M., 2003. Effect of audiovisual primes on identification of auditory target syllables. In: Schwartz, J. L., Berthommier, F., Cathiard, M. A., and Sodoyer, D. (eds.), Proceedings of the International Conference on Audio-Visual Speech Processing (AVSP 2003). St. Jorioz, France, 4-7 September 2003, pages 71-75.
dc.relation.haspart Jääskeläinen, I. P., Ojanen, V., Ahveninen, J., Auranen, T., Levänen, S., Möttönen, R., Tarnanen, I., and Sams, M, 2004. Adaptation of neuromagnetic N1 responses to phonetic stimuli by visual speech in humans. NeuroReport 15 (18), pages 2741-2744.
dc.relation.haspart Pekkola, J., Ojanen, V., Autti, T., Jääskeläinen, I. P., Möttönen, R., Tarkiainen, A., and Sams, M., 2005. Primary auditory cortex activation by visual speech: an fMRI study at 3 T. NeuroReport 16 (2), pages 125-128.
dc.relation.haspart Ojanen, V., Möttönen, R., Pekkola, J., Jääskeläinen, I. P., Joensuu, R., Autti, T., and Sams, M., 2005. Processing of audiovisual speech in Broca's area. NeuroImage 25 (2), pages 333-338.
dc.relation.haspart Ojanen, V., Pekkola, J., Jääskeläinen, I. P., Möttönen, R., Autti, T., Jousmäki, V., and Sams, M., 2005. Common brain areas activated by hearing and seeing speech. Helsinki University of Technology, Laboratory of Computational Engineering publications, Technical Report B49. ISBN 951-22-7679-8.
dc.subject.other Medical sciences en
dc.subject.other Electrical engineering en
dc.title Neurocognitive mechanisms of audiovisual speech perception en
dc.type G5 Artikkeliväitöskirja fi
dc.description.version reviewed en
dc.contributor.department Department of Electrical and Communications Engineering en
dc.contributor.department Sähkö- ja tietoliikennetekniikan osasto fi
dc.subject.keyword auditory cortex en
dc.subject.keyword functional magnetic resonance imaging en
dc.subject.keyword magnetoencephalography en
dc.subject.keyword multisensory en
dc.subject.keyword audiovisual speech perception en
dc.subject.keyword lipreading en
dc.subject.keyword Broca en
dc.subject.keyword motor cortex en
dc.subject.keyword superior temporal sulcus en
dc.identifier.urn urn:nbn:fi:tkk-005286
dc.type.dcmitype text en
dc.type.ontasot Väitöskirja (artikkeli) fi
dc.type.ontasot Doctoral dissertation (article-based) en
dc.contributor.lab Laboratory of Computational Engineering & Advanced Magnetic Imaging Centre (AMI) en
dc.contributor.lab Laskennallisen tekniikan laboratorio & AMI-keskus fi

Files in this item

This item appears in the following Collection(s)

Show simple item record

Search archive

Advanced Search

article-iconSubmit a publication


My Account