Real-time motion capture and game engine technologies in contemporary dance

Loading...
Thumbnail Image
Journal Title
Journal ISSN
Volume Title
School of Arts, Design and Architecture | Master's thesis
Location:
Date
2023
Department
Major/Subject
Mcode
Degree programme
Master's Programme in New Media
Language
en
Pages
51
Series
Abstract
This Master of Arts thesis is made for the New Media study programme in the School of Arts, Design and Architecture at Aalto University under the supervision of Matti Niinimäki and with advising from Nuno Antonio Do Nascimento Correia and Teemu Määttänen. This study is focusing on the topic of real-time motion capture and game engine technologies in contemporary dance with the goal to discover how these technologies can augment contemporary dance, both in the visual and audio domains, in a way in which sound, visuals, and choreography influence one another. The methods being used to achieve this goal include devising mixed reality audiovisual dance performance, as a part of practice-based research methodology, related work review as well as an interview with a field expert. Although the topic of motion capture in contemporary dance is fairly well-researched there is a clear shortage of studies on the ways game engines could be utilized in this segment of art and even less studies are conducted on modern hybrid club music and its influence on contemporary dance. Current research fills these gaps. This study includes a brief overview of Dance and Technology art movement, elucidates motion capture and game engine technologies as well as attempts to define modern hybrid club music. It covers a broad selection of case studies from contemporary dance segment related to each category as well as the writer’s own perspective and experience with motion capture and modern hybrid club music. Furthermore, this research includes an interview with pioneering virtual performer, Sam Rolfes, who is actively using real-time motion capture, game engines, and other real-time tools in his artistic practice and finally, it explains in great detail the whole design process behind the mixed real-ity audio-visual dance performance piece "ROCK/STAR Vol.1", an artistic component of this research. Using various game engine technologies together with the real-time motion captured data can help to establish a greater connection between different artistic domains of the performance, as well as provide a much stronger feeling of a world and a story for the performer who is wearing a suit. The ability to execute things in real-time, that this tech is offering makes it possible for performers to respond to one another, as well as the audience and the current moment in time, thus embracing and crystallizing the originality and specificity of the moment.
Description
Supervisor
Niinimäki, Matti
Thesis advisor
Mättänen, Teemu
Correia, Nuno
Keywords
motion capture, game engines, contemporary dance, dance and technology, mixed reality, audio-visual art
Other note
Media files notes: Fragment of "ROCK/STAR Vol.1" artistic component of this research Description: Video recording of premiere of mixed reality audiovisual dance performance "ROCK/STAR Vol.1" that took place on 20th of May 2023 in Odeion Screening Auditorium in Otaniemi.(Fragment) Media rights: CC-BY-NC-ND 4.0
Citation