aalto1 untyped-item.component.html
A Parametric Spatial Audio Compression Codec for Higher-Order Ambisonics
Loading...
URL
Journal Title
Journal ISSN
Volume Title
School of Electrical Engineering |
Doctoral thesis (article-based)
| Defence date: 2024-11-01
Electronic archive copy is available via Aalto Thesis Database.
Unless otherwise stated, all rights belong to the author. You may download, display and print this publication for Your own personal use. Commercial use is prohibited.
Authors
Date
Major/Subject
Mcode
Degree programme
Language
en
Pages
88 + app. 42
Series
Aalto University publication series DOCTORAL THESES, 220/2024
Abstract
Spatial audio has the potential to revolutionize how we consume music and other audio content by enabling an immersive audio experience. Therefore, the technologyand entertainment industry recently adapted their services and began delivering spatial audio formats. Higher-order Ambisonics (HOA), representing the audio scene in the spherical harmonic domain (SHD), offers various benefits as a spatial audio format, notably the independence of the recording and reproduction setup. However, a critical challenge remains: high-quality spatial audio content is largely inaccessible due to the required number of audio channels and data.
Audio codecs can successfully reduce the technical challenges originating from distribution and storage. Despite the demand for high channel-count spatial audio continuing to rise, traditional multichannel codecs fall short of delivering the required performance for HOA. Akin to parametric audio coding, model-based parametric spatial audio techniques can be adapted for perceptual spatial audio coding. Model-based spatial audio techniques may parameterize the input scene in a perceptually meaningful and compact way. The input scene parameterization allows signal-dependent processing such as directional optimizations and informed upmixing, overcoming typical challenges of signal-independent processing.
This work proposes a spatial audio codec for HOA using parametric Directional Audio Coding (DirAC). First, a modified spherical harmonic transform strategy is developed that enables analysis, modification, and reconstruction of HOA signals. The following study explores a compression strategy achieving perfect reconstruction of low-order SHD components and parameterized resynthesis of higher-order SHD components, establishing the perceptual effectiveness of this duality. Furthermore, SHD post-processing is derived that leverages the input parameterization to improve the codec output by matching to target signal properties. Finally, this work introduces a HOA audio codec based on the aforementioned theoretical foundations. The experimental results demonstrate significant improvements over traditional multi-channel audio codecs, highlighting the potential of the proposed codec to deliver high-quality spatial audio, advocating for including input parameterization side-information in order to avoid coding excessive channel-counts. The implemented codec achieves excellent perceptual quality ratings while reducing the transport data to only a few percent of the input audio data.In conclusion, this research advances the state of the art in spatial audio coding and yields further development in spatial audio codecs for delivering HOA, making the HOA format and its benefits more accessible, thus enabling wider adoption in various media applications.
Description
Supervising professor
Pulkki, Ville, Prof., Aalto University, Department of Information and Communications Engineering, FinlandThesis advisor
Politis, Archontis, Prof., Tampere University, FinlandPulkki, Ville, Prof., Aalto University, Department of Information and Communications Engineering, Finland
Keywords
Other note
Parts
- [Publication 1]: Christoph Hold, Sebastian J. Schlecht, Archontis Politis, Ville Pulkki. Spatial Filter Bank in the Spherical Harmonic Domain: Reconstruction and Application. In IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), Oct 2021.
Full text in Acris/Aaltodoc: https://urn.fi/URN:NBN:fi:aalto-202201261488DOI: 10.1109/WASPAA52581.2021.9632709 View at publisher
- [Publication 2]: Christoph Hold, Ville Pulkki, Archontis Politis, Leo McCormack. Compression of Higher-Order Ambisonic Signals Using Directional Audio Coding. IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 32, pp. 651-665, 2024.
Full text in Acris/Aaltodoc: https://urn.fi/URN:NBN:fi:aalto-202401041155DOI: 10.1109/TASLP.2023.3328284 View at publisher
- [Publication 3]: Christoph Hold, Leo McCormack, Archontis Politis, Ville Pulkki. Optimizing Higher-Order Directional Audio Coding with Adaptive Mixing and Energy Matching for Ambisonic Compression and Upmixing. In IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), Oct 2023.
Full text in Acris/Aaltodoc: https://urn.fi/URN:NBN:fi:aalto-202310186520DOI: 10.1109/WASPAA58266.2023.10248179 View at publisher
- [Publication 4]: Christoph Hold, Leo McCormack, Archontis Politis, Ville Pulkki. Perceptually-Motivated Spatial Audio Codec for Higher-Order Ambisonics Compression. In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Apr 2024.
Full text in Acris/Aaltodoc: https://urn.fi/URN:NBN:fi:aalto-202410096659DOI: 10.1109/ICASSP48485.2024.10447577 View at publisher