Augmented Reality in Forest Machine Cabin

Abstract

Augmented reality human machine interface is demonstrated in the cabin of a forest machine outdoors for the first time in real time. In this work, we propose a system setup and a real-time capable algorithm to augment the operator’s visual field with measurements from the forest machine and its environment. In the demonstration, an instrumented forestry crane and a lidar are used to model the pose of the crane and its surroundings. In our approach, a camera and an inertial measurement unit are used to estimate the pose of the operator’s head in difficult lighting conditions with the help of planar markers placed on the cabin structures. Using the estimate, a point cloud and a crane model are superimposed on the video feed to form an augmented reality view. Our system is tested to work outdoors using a forest machine research platform in real time with encouraging initial results.