Foveated Spatial Compression for Remote Rendered Virtual Reality

Loading...
Thumbnail Image

Access rights

openAccess

URL

Journal Title

Journal ISSN

Volume Title

A4 Artikkeli konferenssijulkaisussa

Date

2023-06-18

Major/Subject

Mcode

Degree programme

Language

en

Pages

7
7-13

Series

MetaSys 2023 - Proceedings of the 1st Workshop on Metaverse Systems and Applications, Part of MobiSys 2023

Abstract

In remote rendered virtual reality (VR), the rendering of the application is moved to the cloud enabling high quality real-time content to be consumed on low-powered standalone head mounted displays (HMDs). The rendered frames are encoded to a video stream and streamed to a thin client which relays user's input to the server and decodes and displays the incoming video. Latency and high bandwidth requirements are key challenges for remote rendered graphics. Foveation can be used to optimize the quality of the transmitted frames to be in line with the human visual system (HVS). In this paper we evaluate multiple different strategies on how to apply foveation to spatially compress video frames, i.e., reduce their resolution, before transmission. We also show how the foveation methods can be used together with super resolution to alleviate the bandwidth usage of real-time remote rendered VR and optimize the perceived image quality.

Description

Funding Information: This work has been supported by the Academy of Finland (grant number 332306). Publisher Copyright: © 2023 Owner/Author(s).

Keywords

foveation, super resolution, virtual reality

Other note

Citation

Kämäräinen, T & Siekkinen, M 2023, Foveated Spatial Compression for Remote Rendered Virtual Reality . in MetaSys 2023 - Proceedings of the 1st Workshop on Metaverse Systems and Applications, Part of MobiSys 2023 . ACM, pp. 7-13, Workshop on Metaverse Systems and Applications, Helsinki, Finland, 18/06/2023 . https://doi.org/10.1145/3597063.3597359