Foveated Spatial Compression for Remote Rendered Virtual Reality

Thumbnail Image
Access rights
openAccess
Journal Title
Journal ISSN
Volume Title
A4 Artikkeli konferenssijulkaisussa
This publication is imported from Aalto University research portal.
View publication in the Research portal
View/Open full text file from the Research portal
Other link related to publication
Author
Date
2023-06-18
Department
Department of Computer Science
Major/Subject
Mcode
Degree programme
Language
en
Pages
7
7-13
Series
MetaSys 2023 - Proceedings of the 1st Workshop on Metaverse Systems and Applications, Part of MobiSys 2023
Abstract
In remote rendered virtual reality (VR), the rendering of the application is moved to the cloud enabling high quality real-time content to be consumed on low-powered standalone head mounted displays (HMDs). The rendered frames are encoded to a video stream and streamed to a thin client which relays user's input to the server and decodes and displays the incoming video. Latency and high bandwidth requirements are key challenges for remote rendered graphics. Foveation can be used to optimize the quality of the transmitted frames to be in line with the human visual system (HVS). In this paper we evaluate multiple different strategies on how to apply foveation to spatially compress video frames, i.e., reduce their resolution, before transmission. We also show how the foveation methods can be used together with super resolution to alleviate the bandwidth usage of real-time remote rendered VR and optimize the perceived image quality.
Description
Funding Information: This work has been supported by the Academy of Finland (grant number 332306). Publisher Copyright: © 2023 Owner/Author(s).
Keywords
foveation, super resolution, virtual reality
Other note
DOI
10.1145/3597063.3597359
Citation
Kämäräinen, T & Siekkinen, M 2023, Foveated Spatial Compression for Remote Rendered Virtual Reality . in MetaSys 2023 - Proceedings of the 1st Workshop on Metaverse Systems and Applications, Part of MobiSys 2023 . ACM, pp. 7-13, Workshop on Metaverse Systems and Applications, Helsinki, Finland, 18/06/2023 . https://doi.org/10.1145/3597063.3597359
Permanent link to this item
https://urn.fi/URN:NBN:fi:aalto-202308305293
Collections
[article-cris] Perustieteiden korkeakoulu / SCI