The Impact of Sound Systems on the Perception of Cinematic Content in Immersive Audiovisual Productions

dc.contributorAalto-yliopistofi
dc.contributorAalto Universityen
dc.contributor.authorKorshunova, Victoriaen_US
dc.contributor.authorRemijn, Gerard B.en_US
dc.contributor.authorElischka, Synesen_US
dc.contributor.authorMendonca, Catarinaen_US
dc.contributor.departmentKyushu Universityen_US
dc.contributor.departmentDepartment of Filmen_US
dc.contributor.departmentDept Signal Process and Acousten_US
dc.contributor.editorWeng, Dongdongen_US
dc.contributor.editorChan, Liweien_US
dc.contributor.editorLee, Younghoen_US
dc.contributor.editorLiang, Xiaohuien_US
dc.contributor.editorSakata, Nobuchikaen_US
dc.date.accessioned2019-06-20T13:13:18Z
dc.date.available2019-06-20T13:13:18Z
dc.date.issued2019-05-07en_US
dc.description| openaire: EC/H2020/659114/EU//MULTISSOUND
dc.description.abstractWith fast technological developments, traditional perceptual environments disappear and new ones emerge. These changes make the human senses adapt to new ways of perceptual understanding, for example, regarding the perceptual integration of sound and vision. Proceeding from the fact that hearing cooperates with visual attention processes, the aim of this study is to investigate the effect of different sound design conditions on the perception of cinematic content in immersive audiovisual reproductions. Here we introduce the results of a visual selective attention task (counting objects) performed by participants watching a 270-degree immersive audiovisual display, on which a movie (»Ego Cure») was shown. Four sound conditions were used, which employed an increasing number of loudspeakers, i.e., mono, stereo, 5.1 and 7.1.4. Eye tracking was used to record the participant's eye gaze during the task. The eye tracking data showed that an increased number of speakers and a wider spatial audio distribution diffusedthe participants' attention from the task-related part of the display to non-task-related directions. The number of participants looking at the task-irrelevant display in the 7.1.4 condition was significantly higher than in the mono audio condition. This implies that additional spatial cues in the auditory modality automatically influence human visual attention (involuntary eye movements) and human analysis of visual information. Sound engineers should consider this when mixing educational or any other information-oriented productions.en
dc.description.versionPeer revieweden
dc.identifier.citationKorshunova , V , Remijn , G B , Elischka , S & Mendonca , C 2019 , The Impact of Sound Systems on the Perception of Cinematic Content in Immersive Audiovisual Productions . in D Weng , L Chan , Y Lee , X Liang & N Sakata (eds) , Proceedings of the 2019 12th Asia Pacific Workshop on Mixed and Augmented Reality, APMAR 2019 . , 8709163 , Proceedings of the 2019 12th Asia Pacific Workshop on Mixed and Augmented Reality, APMAR 2019 , IEEE , pp. 70-74 , Asia Pacific Workshop on Mixed and Augmented Reality , Ikoma, Nara , Japan , 28/03/2019 . https://doi.org/10.1109/APMAR.2019.8709163en
dc.identifier.doi10.1109/APMAR.2019.8709163en_US
dc.identifier.isbn9781728115719
dc.identifier.otherPURE UUID: 406d8d5a-5791-43fa-bed9-a833566081ecen_US
dc.identifier.otherPURE ITEMURL: https://research.aalto.fi/en/publications/406d8d5a-5791-43fa-bed9-a833566081ecen_US
dc.identifier.otherPURE LINK: http://www.scopus.com/inward/record.url?scp=85066332801&partnerID=8YFLogxKen_US
dc.identifier.urihttps://aaltodoc.aalto.fi/handle/123456789/38814
dc.identifier.urnURN:NBN:fi:aalto-201906203880
dc.language.isoenen
dc.relationinfo:eu-repo/grantAgreement/EC/H2020/659114/EU//MULTISSOUNDen_US
dc.relation.ispartofAsia Pacific Workshop on Mixed and Augmented Realityen
dc.relation.ispartofseriesProceedings of the 2019 12th Asia Pacific Workshop on Mixed and Augmented Reality, APMAR 2019en
dc.rightsrestrictedAccessen
dc.subject.keywordaudiovisual perceptionen_US
dc.subject.keywordeye gazeen_US
dc.subject.keywordeye trackingen_US
dc.subject.keywordimmersive environmentsen_US
dc.subject.keywordsound systemsen_US
dc.subject.keywordspatial sounden_US
dc.titleThe Impact of Sound Systems on the Perception of Cinematic Content in Immersive Audiovisual Productionsen
dc.typeConference article in proceedingsfi
Files