Radar-Lidar Fusion for Object Detection by Designing Effective Convolution Networks
No Thumbnail Available
Access rights
openAccess
acceptedVersion
URL
Journal Title
Journal ISSN
Volume Title
A4 Artikkeli konferenssijulkaisussa
This publication is imported from Aalto University research portal.
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
Date
2024
Major/Subject
Mcode
Degree programme
Language
en
Pages
8
Series
2023 IEEE 26th International Conference on Intelligent Transportation Systems, ITSC 2023, pp. 3575-3582, IEEE Conference on Intelligent Transportation Systems, Proceedings, ITSC
Abstract
Object detection is a core component of perception systems, providing the ego vehicle with information about its surroundings to ensure safe route planning. While cameras and Lidar have significantly advanced perception systems, their performance can be limited in adverse weather conditions. In contrast, millimeter-wave technology enables radars to function effectively in such conditions. However, relying solely on radar for building a perception system doesn't fully capture the environment due to the data's sparse nature. To address this, sensor fusion strategies have been introduced. We propose a dual-branch framework to integrate radar and Lidar data for enhanced object detection. The primary branch focuses on extracting radar features, while the auxiliary branch extracts Lidar features. These are then combined using additive attention. Subsequently, the integrated features are processed through a novel Parallel Forked Structure (PFS) to manage scale variations. A region proposal head is then utilized for object detection. We evaluated the effectiveness of our proposed method on the Radiate dataset using COCO metrics. The results show that it surpasses state-of-the-art methods by 1.89% and 2.61% in favorable and adverse weather conditions, respectively. This underscores the value of radar-Lidar fusion in achieving precise object detection and localization, especially in challenging weather conditions.Description
Publisher Copyright: © 2023 IEEE.
Keywords
attention, radar object detection, sensor fusion
Other note
Citation
Munir, F, Azam, S, Kucner, T, Kyrki, V & Jeon, M 2024, Radar-Lidar Fusion for Object Detection by Designing Effective Convolution Networks . in 2023 IEEE 26th International Conference on Intelligent Transportation Systems, ITSC 2023 . IEEE Conference on Intelligent Transportation Systems, Proceedings, ITSC, IEEE, pp. 3575-3582, IEEE International Conference on Intelligent Transportation Systems, Bilbao, Spain, 24/09/2023 . https://doi.org/10.1109/ITSC57777.2023.10422295