ViReo: Internet of Things Integration in eXtended Reality for Network Platforms

Thumbnail Image
Journal Title
Journal ISSN
Volume Title
Perustieteiden korkeakoulu | Master's thesis
Human-Computer Interaction and Design
Degree programme
Master's Programme in ICT Innovation
70 + 0
Extended Reality (XR) and Internet of Things (IoT) are transforming the way humans interact with the surrounding world. When combined, XR and IoT provide a more immersive and natural way for users to sense and control the environment. However, visualization and interaction of IoT systems in XR is more complex than in traditional 2D applications, and have only been addressed by few pioneering works, whose solutions also lack standardization. Furthermore, the IoT ecosystem is vastly heterogeneous in nature, which poses challenges to interoperability at large and ease of integration with external applications. This thesis presents ViReo, a system that integrates IoT into a Virtual Reality (VR) application. ViReo is composed by a VR frontend and a flexible interface facilitating integration with IoT systems. The VR frontend provides functionalities to visualize and interact with IoT devices in a modular fashion, allowing ViReo to be extended effortlessly with ad-hoc functionalities, such as alternative representations of IoT data. The flexible interface towards IoT systems utilizes standard communication protocols and a unified data format, aiming to unify the access to IoT, whose heterogeneity hindered the widespread adoption of the technology. Additionally, the thesis identifies essential capabilities that could be implemented and exposed over the Network Platform, a new platform that could provide ease of use and seamless integration between XR applications and IoT data. The identified capabilities consist in: (i) a unified IoT layer providing interoperability of standards; (ii) selection and provisioning of IoT metadata to the XR client for optimized IoT communication and discovery; (iii) automated device and broker discovery. These results contribute towards standard methods to design efficient VR applications that interact with IoT systems. Ultimately, Network Platforms will enable a seamless reality merging physical and digital worlds contributing to the creation of a more human-friendly, sustainable and efficient society.
Siekkinen, Matti
Thesis advisor
Corneo, Lorenzo
extended reality, virtual reality, Internet of Things, human-computer interaction, network platform
Other note