Diffusion-Based Generative Equalizer for Music Restoration
Loading...
Access rights
openAccess
publishedVersion
URL
Journal Title
Journal ISSN
Volume Title
A4 Artikkeli konferenssijulkaisussa
This publication is imported from Aalto University research portal.
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
Date
Major/Subject
Mcode
Degree programme
Language
en
Pages
8
Series
Proceedings of the 27th International Conference on Digital Audio Effects (DAFx24), Volume 27, pp. 25-32, Proceedings of the International Conference on Digital Audio Effects, DAFx
Abstract
This paper presents a novel approach to audio restoration, focusing on the enhancement of low-quality music recordings, and in particular historical ones. Building upon a previous algorithm called BABE, or Blind Audio Bandwidth Extension, we introduce BABE-2, which presents a series of improvements. This research broadens the concept of bandwidth extension to generative equalization, a task that, to the best of our knowledge, has not been previously addressed for music restoration. BABE-2 is built around an optimization algorithm utilizing priors from diffusion models, which are trained or fine-tuned using a curated set of high-quality music tracks. The algorithm simultaneously performs two critical tasks: estimation of the filter degradation magnitude response and hallucination of the restored audio. The proposed method is objectively evaluated on historical piano recordings, showing an enhancement over the prior version. The method yields similarly impressive results in rejuvenating the works of renowned vocalists Enrico Caruso and Nellie Melba. This research represents an advancement in the practical restoration of historical music. Historical music restoration examples are available at: research.spa.aalto.fi/publications/papers/dafx-babe2/.Description
Publisher Copyright: Copyright: © 2024 Eloi Moliner et al.
Keywords
Other note
Citation
Moliner Juanpere, E, Turunen, M, Elvander, F & Välimäki, V 2024, Diffusion-Based Generative Equalizer for Music Restoration. in E De Sena & J Mannall (eds), Proceedings of the 27th International Conference on Digital Audio Effects (DAFx24). vol. 27, Proceedings of the International Conference on Digital Audio Effects, DAFx, University of Surrey, Guildford, UK, pp. 25-32, International Conference on Digital Audio Effects, Guildford, United Kingdom, 03/09/2024. < https://dafx.de/paper-archive/2024/papers/DAFx24_paper_71.pdf >