Blind Audio Bandwidth Extension: A Diffusion-Based Zero-Shot Approach

dc.contributorAalto-yliopistofi
dc.contributorAalto Universityen
dc.contributor.authorMoliner Juanpere, Eloien_US
dc.contributor.authorElvander, Filipen_US
dc.contributor.authorVälimäki, Vesaen_US
dc.contributor.departmentDepartment of Information and Communications Engineeringen
dc.contributor.groupauthorStructured and Stochastic Modelingen
dc.contributor.groupauthorAudio Signal Processingen
dc.date.accessioned2024-12-17T16:18:08Z
dc.date.available2024-12-17T16:18:08Z
dc.date.issued2024-11-27en_US
dc.descriptionPublisher Copyright: © 2014 IEEE.
dc.description.abstractAudio bandwidth extension involves the realistic reconstruction of high-frequency spectra from bandlimited observations. In cases where the lowpass degradation is unknown, such as in restoring historical audio recordings, this becomes a blind problem. This paper introduces a novel method called BABE (Blind Audio Bandwidth Extension) that addresses the blind problem in a zero-shot setting, leveraging the generative priors of a pre-trained unconditional diffusion model. During the inference process, BABE utilizes a generalized version of diffusion posterior sampling, where the degradation operator is unknown but parametrized and inferred iteratively. The performance of the proposed method is evaluated using objective and subjective metrics, and the results show that BABE surpasses state-of-the-art blind bandwidth extension baselines and achieves competitive performance compared to informed methods when tested with synthetic data. Moreover, BABE exhibits robust generalization capabilities when enhancing real historical recordings, effectively reconstructing the missing high-frequency content while maintaining coherence with the original recording. Subjective preference tests confirm that BABE significantly improves the audio quality of historical music recordings. Examples of historical recordings restored with the proposed method are available on the companion webpage: http://research.spa.aalto.fi/publications/papers/ieee-taslp-babe/en
dc.description.versionPeer revieweden
dc.format.extent14
dc.format.mimetypeapplication/pdfen_US
dc.identifier.citationMoliner Juanpere, E, Elvander, F & Välimäki, V 2024, 'Blind Audio Bandwidth Extension: A Diffusion-Based Zero-Shot Approach', IEEE/ACM Transactions on Audio Speech and Language Processing, vol. 32, pp. 5092-5105. https://doi.org/10.1109/TASLP.2024.3507566en
dc.identifier.doi10.1109/TASLP.2024.3507566en_US
dc.identifier.issn2329-9290
dc.identifier.issn2329-9304
dc.identifier.otherPURE UUID: 3317fe5e-6112-4799-afa0-0c4fcabc861ben_US
dc.identifier.otherPURE ITEMURL: https://research.aalto.fi/en/publications/3317fe5e-6112-4799-afa0-0c4fcabc861ben_US
dc.identifier.otherPURE FILEURL: https://research.aalto.fi/files/167161791/Blind_Audio_Bandwidth_Extension_A_Diffusion-Based_Zero-Shot_Approach-Moliner2024.pdf
dc.identifier.urihttps://aaltodoc.aalto.fi/handle/123456789/132386
dc.identifier.urnURN:NBN:fi:aalto-202412177863
dc.language.isoenen
dc.publisherIEEE
dc.relation.ispartofseriesIEEE/ACM Transactions on Audio Speech and Language Processingen
dc.relation.ispartofseriesVolume 32, pp. 5092-5105en
dc.rightsopenAccessen
dc.rightsCC BYen_US
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subject.keywordAudio recordingen_US
dc.subject.keywordconvolutional neural networksen_US
dc.subject.keywordmachine learningen_US
dc.subject.keywordmusicen_US
dc.subject.keywordsignal restorationen_US
dc.titleBlind Audio Bandwidth Extension: A Diffusion-Based Zero-Shot Approachen
dc.typeA1 Alkuperäisartikkeli tieteellisessä aikakauslehdessäfi
dc.type.versionpublishedVersion

Files