Data Musicalization

Data musicalization is the process of automatically composing music based on given data as an approach to perceptualizing information artistically. The aim of data musicalization is to evoke subjective experiences in relation to the information rather than merely to convey unemotional information objectively. This article is written as a tutorial for readers interested in data musicalization. We start by providing a systematic characterization of musicalization approaches, based on their inputs, methods, and outputs. We then illustrate data musicalization techniques with examples from several applications: one that perceptualizes physical sleep data as music, several that artistically compose music inspired by the sleep data, one that musicalizes on-line chat conversations to provide a perceptualization of liveliness of a discussion, and one that uses musicalization in a gamelike mobile application that allows its users to produce music. We additionally provide a number of electronic samples of music producedby the different musicalization applications.

Keywords

Data Musicalization, Sonification, Automated Composition, Music, Data Analysis, Computational Creativity

DOI

10.1145/3184742

Citation

Tulilaulu , A , Nelimarkka , M , Paalasmaa , J , Johnson , D , Ventura , D , Myllys , P & Toivonen , H 2018 , ' Data Musicalization ' , ACM Transactions on Multimedia Computing, Communications and Applications , vol. 14 , no. 2 , 47 , pp. 1-27 . https://doi.org/10.1145/3184742

Permanent link to this item

https://urn.fi/URN:NBN:fi:aalto-201806183310

Collections

[article-cris] Perustieteiden korkeakoulu / SCI

Show all metadata