Dense Road Surface Grip Map Prediction from Multimodal Image Data
No Thumbnail Available
Access rights
openAccess
publishedVersion
URL
Journal Title
Journal ISSN
Volume Title
A4 Artikkeli konferenssijulkaisussa
This publication is imported from Aalto University research portal.
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
Date
2024-12-03
Department
Major/Subject
Mcode
Degree programme
Language
en
Pages
Series
Pattern Recognition - 27th International Conference, ICPR 2024, Proceedings, pp. 387–404, Lecture Notes in Computer Science ; Volume 15317
Abstract
Slippery road weather conditions are prevalent in many regions and cause a regular risk for traffic. Still, there has been less research on how autonomous vehicles could detect slippery driving conditions on the road to drive safely. In this work, we propose a method to predict a dense grip map from the area in front of the car, based on postprocessed multimodal sensor data. We trained a convolutional neural network to predict pixelwise grip values from fused RGB camera, thermal camera, and LiDAR reflectance images, based on weakly supervised ground truth from an optical road weather sensor. The experiments show that it is possible to predict dense grip values with good accuracy from the used data modalities as the produced grip map follows both ground truth measurements and local weather conditions, such as snowy areas on the road. The model using only the RGB camera or LiDAR reflectance modality provided good baseline results for grip prediction accuracy while using models fusing the RGB camera, thermal camera, and LiDAR modalities improved the grip predictions significantly.Description
Keywords
Autonomous driving, Convolutional neural networks, Grip prediction
Other note
Citation
Maanpää, J, Pesonen, J, Hyyti, H, Melekhov, I, Kannala, J, Manninen, P, Kukko, A & Hyyppä, J 2024, Dense Road Surface Grip Map Prediction from Multimodal Image Data . in A Antonacopoulos, S Chaudhuri, R Chellappa, C-L Liu, S Bhattacharya & U Pal (eds), Pattern Recognition - 27th International Conference, ICPR 2024, Proceedings . Lecture Notes in Computer Science, vol. 15317, Springer, pp. 387–404, International Conference on Pattern Recognition, Kolkata, India, 01/12/2024 . https://doi.org/10.1007/978-3-031-78447-7_26