Automatic Map Update Using Dashcam Videos
Loading...
Access rights
openAccess
URL
Journal Title
Journal ISSN
Volume Title
A1 Alkuperäisartikkeli tieteellisessä aikakauslehdessä
This publication is imported from Aalto University research portal.
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
Date
2023-07-01
Major/Subject
Mcode
Degree programme
Language
en
Pages
19
11825-11843
11825-11843
Series
IEEE Internet of Things Journal, Volume 10, issue 13
Abstract
Autonomous driving requires 3D maps that provide accurate and up-to-date information about semantic landmarks. Since cameras present wider availability and lower cost compared with laser scanners, vision-based mapping solutions, especially the ones using crowdsourced visual data, have attracted much attention from academia and industry. However, previous works have mainly focused on creating 3D point clouds, leaving automatic change detection as open issue. We propose a pipeline for initiating and updating 3D maps with dashcam videos, with a focus on automatic change detection based on comparison of metadata (e.g., the types and locations of traffic signs). To improve the performance of metadata generation, which depends on the accuracy of 3D object detection and localization, we introduce a novel deep learning-based pixel-wise 3D localization algorithm. The algorithm, trained directly with SfM (Structure from Motion) point cloud data, accurately locates objects in 3D space by estimating not only depth from monocular images but also lateral and height distances. In addition, we also propose a point clustering and thresholding algorithm to improve the robustness of the system to errors. We have performed experiments with different types of cameras, lighting, and weather conditions. The changes were detected with an average accuracy above 90%. The errors in the campus area were mainly due to traffic signs seen from a far distance to the vehicle and intended for pedestrians and cyclists only. We also conducted cause analysis of the detection and localization errors to measure the impact from the performance of the background technology in use.Description
Publisher Copyright: Author | openaire: EC/H2020/825496/EU//5G-MOBIX
Keywords
autonomous driving, Cameras, change detection, localization, Location awareness, mapping, Pipelines, Point cloud compression, Semantic segmentation, Semantics, structure from motion, Three-dimensional displays
Other note
Citation
Zhanabatyrova, A, Souza Leite, C & Xiao, Y 2023, ' Automatic Map Update Using Dashcam Videos ', IEEE Internet of Things Journal, vol. 10, no. 13, pp. 11825-11843 . https://doi.org/10.1109/JIOT.2023.3244693