Subjective Evaluation of Basic Emotions from Audio–Visual Data

dc.contributorAalto-yliopistofi
dc.contributorAalto Universityen
dc.contributor.authorKadiri, Sudarsana Reddy
dc.contributor.authorAlku, Paavo
dc.contributor.departmentDept Signal Process and Acoust
dc.date.accessioned2022-08-10T08:24:04Z
dc.date.available2022-08-10T08:24:04Z
dc.date.issued2022-07-01
dc.descriptionFunding Information: Funding: This research was partly funded by Academy of Finland grant number 313390. Publisher Copyright: © 2022 by the authors. Licensee MDPI, Basel, Switzerland.
dc.description.abstractUnderstanding of the perception of emotions or affective states in humans is important to develop emotion-aware systems that work in realistic scenarios. In this paper, the perception of emotions in naturalistic human interaction (audio–visual data) is studied using perceptual evaluation. For this purpose, a naturalistic audio–visual emotion database collected from TV broadcasts such as soap-operas and movies, called the IIIT-H Audio–Visual Emotion (IIIT-H AVE) database, is used. The database consists of audio-alone, video-alone, and audio–visual data in English. Using data of all three modes, perceptual tests are conducted for four basic emotions (angry, happy, neutral, and sad) based on category labeling and for two dimensions, namely arousal (active or passive) and valence (positive or negative), based on dimensional labeling. The results indicated that the participants’ perception of emotions was remarkably different between the audio-alone, video-alone, and audio–video data. This finding emphasizes the importance of emotion-specific features compared to commonly used features in the development of emotion-aware systems.en
dc.description.versionPeer revieweden
dc.format.mimetypeapplication/pdf
dc.identifier.citationKadiri , S R & Alku , P 2022 , ' Subjective Evaluation of Basic Emotions from Audio–Visual Data ' , Sensors , vol. 22 , no. 13 , 4931 . https://doi.org/10.3390/s22134931en
dc.identifier.doi10.3390/s22134931
dc.identifier.issn1424-8220
dc.identifier.otherPURE UUID: ab003749-c3c6-4573-8a05-ab7c00e66db0
dc.identifier.otherPURE ITEMURL: https://research.aalto.fi/en/publications/ab003749-c3c6-4573-8a05-ab7c00e66db0
dc.identifier.otherPURE LINK: http://www.scopus.com/inward/record.url?scp=85132981539&partnerID=8YFLogxK
dc.identifier.otherPURE FILEURL: https://research.aalto.fi/files/85712131/Kadiri_Subjective_evaluation_of_basic_emotions_sensors_22_04931.pdf
dc.identifier.urihttps://aaltodoc.aalto.fi/handle/123456789/115878
dc.identifier.urnURN:NBN:fi:aalto-202208104700
dc.language.isoenen
dc.publisherMultidisciplinary Digital Publishing Institute (MDPI)
dc.relation.ispartofseriesSensorsen
dc.relation.ispartofseriesVolume 22, issue 13en
dc.rightsopenAccessen
dc.subject.keywordemotion analysis
dc.subject.keywordemotion recognition
dc.subject.keywordemotion synthesis
dc.subject.keywordfeature extraction
dc.subject.keywordnaturalistic audio–visual emotion database
dc.titleSubjective Evaluation of Basic Emotions from Audio–Visual Dataen
dc.typeA1 Alkuperäisartikkeli tieteellisessä aikakauslehdessäfi
dc.type.versionpublishedVersion
Files