Al-terity: Non-Rigid Musical Instrument with Artificial Intelligence Applied to Real-Time Audio Synthesis
Loading...
Access rights
openAccess
Journal Title
Journal ISSN
Volume Title
Conference article in proceedings
This publication is imported from Aalto University research portal.
View publication in the Research portal
View/Open full text file from the Research portal
Other link related to publication
View publication in the Research portal
View/Open full text file from the Research portal
Other link related to publication
Date
2020-07-25
Department
Major/Subject
Mcode
Degree programme
Language
en
Pages
6
337-342
337-342
Series
Proceedings of the International Conference on New Interfaces for Musical Expression
Abstract
A deformable musical instrument can take numerous dis- tinct shapes with its non-rigid features. Building audio syn- thesis module for such an interface behaviour can be chal- lenging. In this paper, we present the Al-terity, a non-rigid musical instrument that comprises a deep learning model with generative adversarial network architecture and use it for generating audio samples for real-time audio synthesis. The particular deep learning model we use for this instru- ment was trained with existing data set as input for pur- poses of further experimentation. The main benefits of the model used are the ability to produce the realistic range of timbre of the trained data set and the ability to generate new audio samples in real-time, in the moment of playing, with the characteristics of sounds that the performer ever heard before. We argue that these advanced intelligence features on the audio synthesis level could allow us to ex- plore performing music with particular response features that define the instrument’s digital idiomaticity and allow us reinvent the instrument in the act of music performance.Description
Keywords
NIME, Artificial Intelligence (AI), GAN, deep learning, SOPI
Other note
Citation
Tahiroğlu , K , Kastemaa , M & Koli , O 2020 , Al-terity: Non-Rigid Musical Instrument with Artificial Intelligence Applied to Real-Time Audio Synthesis . in Proceedings of the International Conference on New Interfaces for Musical Expression . Proceedings of the International Conference on New Interfaces for Musical Expression , International Conference on New Interfaces for Musical Expression (NIME) , Birmingham , pp. 337-342 , INTERNATIONAL CONFERENCE ON NEW INTERFACES FOR MUSICAL EXPRESSION , 01/01/1900 . < https://www.nime.org/proceedings/2020/nime2020_paper65.pdf >
