AI-terity 2.0: An Autonomous NIME Featuring GANSpaceSynth Deep Learning Model
No Thumbnail Available
Access rights
openAccess
URL
Journal Title
Journal ISSN
Volume Title
A4 Artikkeli konferenssijulkaisussa
This publication is imported from Aalto University research portal.
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
Date
2021-06-15
Department
Major/Subject
Mcode
Degree programme
Language
en
Pages
Series
Proceedings of the International Conference on New Interfaces for Musical Expression, Volume 2021
Abstract
In this paper we present the recent developments in the AI-terity instrument. AI-terity is a deformable, non-rigid musical instrument that comprises a particular artificial intelligence (AI) method for generating audio samples for real-time audio synthesis. As an improvement, we developed the control interface structure with additional sensor hardware. In addition, we implemented a new hybrid deep learning architecture, GANSpaceSynth, in which we applied the GANSpace method on the GANSynth model. Following the deep learning model improvement, we developed new autonomous features for the instrument that aim at keeping the musician in an active and uncertain state of exploration. Through these new features, the instrument enables more accurate control on GAN latent space. Further, we intend to investigate the current developments through a musical composition that idiomatically reflects the new autonomous features of the AI-terity instrument. We argue that the present technology of AI is suitable for enabling alternative autonomous features in audio domain for the creative practices of musicians.Description
Keywords
Artificial Intelligence (AI), new interfaces for musical expression, Digital musical instruments, Deep Learning, GAN, GANSpaceSynth, SOPI, NIME
Other note
Citation
Tahiroğlu, K, Kastemaa, M & Koli, O 2021, AI-terity 2.0: An Autonomous NIME Featuring GANSpaceSynth Deep Learning Model . in Proceedings of the International Conference on New Interfaces for Musical Expression . vol. 2021, International Conference on New Interfaces for Musical Expression (NIME), International Conference on New Interfaces for Musical Expression, Shanghai, China, 15/06/2021 . https://doi.org/10.21428/92fbeb44.3d0e9e12