When to Laugh and How Hard? A Multimodal Approach to Detecting Humor and Its Intensity
Loading...
Access rights
openAccess
publishedVersion
URL
Journal Title
Journal ISSN
Volume Title
A4 Artikkeli konferenssijulkaisussa
This publication is imported from Aalto University research portal.
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
Date
Major/Subject
Mcode
Degree programme
Language
en
Pages
12
Series
Proceedings of the 29th International Conference on Computational Linguistics, pp. 6875-6886, Proceedings of the International Conference on Computational Linguistics
Abstract
Prerecorded laughter accompanying dialog in comedy TV shows encourages the audience to laugh by clearly marking humorous moments in the show. We present an approach for automatically detecting humor in the Friends TV show using multimodal data. Our model is capable of recognizing whether an utterance is humorous or not and assess the intensity of it. We use the prerecorded laughter in the show as annotation as it marks humor and the length of the audience’s laughter tells us how funny a given joke is. We evaluate the model on episodes the model has not been exposed to during the training phase. Our results show that the model is capable of correctly detecting whether an utterance is humorous 78% of the time and how long the audience’s laughter reaction should last with a mean absolute error of 600 milliseconds.Description
Keywords
Other note
Citation
Alnajjar, K, Hämäläinen, M, Tiedemann, J, Laaksonen, J & Kurimo, M 2022, When to Laugh and How Hard? A Multimodal Approach to Detecting Humor and Its Intensity. in Proceedings of the 29th International Conference on Computational Linguistics. Proceedings of the International Conference on Computational Linguistics, International Committee on Computational Linguistics, pp. 6875-6886, International Conference on Computational Linguistics, Gyeongju, Korea, Republic of, 12/10/2022. < https://aclanthology.org/2022.coling-1.598 >