A Mixed Reality Interface for a Digital Twin Based Crane
Loading...
Access rights
openAccess
URL
Journal Title
Journal ISSN
Volume Title
A1 Alkuperäisartikkeli tieteellisessä aikakauslehdessä
This publication is imported from Aalto University research portal.
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
Date
2021-10-01
Major/Subject
Mcode
Degree programme
Language
en
Pages
11
Series
APPLIED SCIENCES, Volume 11, issue 20
Abstract
Featured Application:& nbsp;A proof-of-concept version of a mixed reality application for controlling and monitoring a digital twin based overhead crane, featured by interactivity, flexibility, and immersiveness, together with a protocol defined to standardize quantitative evaluation on control accuracy of industrial mixed reality applications. Digital twin technology empowers the digital transformation of the industrial world with an increasing amount of data, which meanwhile creates a challenging context for designing a human-machine interface (HMI) for operating machines. This work aims at creating an HMI for digital twin based services. With an industrial crane platform as a case study, we presented a mixed reality (MR) application running on a Microsoft HoloLens 1 device. The application, consisting of visualization, interaction, communication, and registration modules, allowed crane operators to both monitor the crane status and control its movement through interactive holograms and bi-directional data communication, with enhanced mobility thanks to spatial registration and tracking of the MR environment. The prototype was quantitatively evaluated regarding the control accuracy in 20 measurements following a step-by-step protocol that we defined to standardize the measurement procedure. The results suggested that the differences between the target and actual positions were within the 10 cm range in three dimensions, which were considered sufficiently small regarding the typical crane operation use case of logistics purposes and could be improved with the adoption of robust registration and tracking techniques in our future work.Description
Keywords
mixed reality, augmented reality, Digital twins, Microsoft HoloLens, industrial cranes, Human-machine interface, industrial communication, Smart manufacturing, Industrial Internet of Things (IIoT)
Other note
Citation
Tu, X, Autiosalo, J, Jadid, A, Tammi, K & Klinker, G 2021, ' A Mixed Reality Interface for a Digital Twin Based Crane ', Applied Sciences, vol. 11, no. 20, 9480 . https://doi.org/10.3390/app11209480