Dance Movement and Sound Cross-Correlation; Synthesis Parameters on the Micro and Meso Musical Time Scales
Loading...
Access rights
openAccess
publishedVersion
URL
Journal Title
Journal ISSN
Volume Title
A4 Artikkeli konferenssijulkaisussa
This publication is imported from Aalto University research portal.
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
Authors
Date
Department
Major/Subject
Mcode
Degree programme
Language
en
Pages
12
Series
AM '24: Proceedings of the 19th International Audio Mostly Conference: Explorations in Sonic Cultures, pp. 445-456, ACM International Conference Proceeding Series
Abstract
The sonification of dance movements is a dynamic area of research in the experience of interaction with sound, focusing on modulating sound synthesis within a complex relationship between human movement, technology and auditory domains. This paper introduces our method for constructing a parameter space for the sonification of dance movement, which includes correlations between real time data received from different body parts, timepoints referenced to Mel-frequency cepstral coefficient (MFCC) feature extraction, and phase vocoder index points related to movement energy. Our approach facilitates for a nuanced and dynamic interaction between dance movements and sound. We further discuss the parameter space and its impact on sound synthesis, providing a detailed explanation of how higher-order information extracted from sensory systems can modulate sound in real-time. Our project explores the theoretical foundations of this technique and its practical applications in dance performances. Through subjective observations from the participating dancer in our public demonstration, we highlight the potential of our sonification system for artistic experimentation and innovation. This work aims to contribute to the interdisciplinary field of music and dance performance studies, offering an alternative means of connecting the dancer and the music with a synthesis technique that operates at micro and meso temporal scales.Description
Publisher Copyright: © 2024 Owner/Author.
Other note
Citation
Koruga, A & Tahiroglu, K 2024, Dance Movement and Sound Cross-Correlation; Synthesis Parameters on the Micro and Meso Musical Time Scales. in L A Ludovico & D A Mauro (eds), AM '24: Proceedings of the 19th International Audio Mostly Conference: Explorations in Sonic Cultures. ACM International Conference Proceeding Series, ACM, pp. 445-456, Audio Mostly Conference, Milan, Italy, 18/09/2024. https://doi.org/10.1145/3678299.3678361