LSVL: Large-scale season-invariant visual localization for UAVs

dc.contributorAalto-yliopistofi
dc.contributorAalto Universityen
dc.contributor.authorKinnari, Joukoen_US
dc.contributor.authorRenzulli, Riccardoen_US
dc.contributor.authorVerdoja, Francescoen_US
dc.contributor.authorKyrki, Villeen_US
dc.contributor.departmentDepartment of Electrical Engineering and Automationen
dc.contributor.groupauthorIntelligent Roboticsen
dc.date.accessioned2023-08-23T06:09:45Z
dc.date.available2023-08-23T06:09:45Z
dc.date.issued2023-10en_US
dc.descriptionFunding Information: This work was supported by Business Finland project Multico (6575/31/2019) and Saab Finland Oy. We thank Olli Knuuttila for the implementation work in real-time experiments. We thank Mika Järvenpää and Kari Hautio for testing opportunities and support with implementation on the Nokia Drone Networks device. Funding Information: This work was supported by Business Finland project Multico ( 6575/31/2019 ) and Saab Finland Oy . We thank Olli Knuuttila for the implementation work in real-time experiments. We thank Mika Järvenpää and Kari Hautio for testing opportunities and support with implementation on the Nokia Drone Networks device. Publisher Copyright: © 2023 The Author(s)
dc.description.abstractLocalization of autonomous unmanned aerial vehicles (UAVs) relies heavily on Global Navigation Satellite Systems (GNSS), which are susceptible to interference. Especially in security applications, robust localization algorithms independent of GNSS are needed to provide dependable operations of autonomous UAVs also in interfered conditions. Typical non-GNSS visual localization approaches rely on known starting pose, work only on a small-sized map, or require known flight paths before a mission starts. We consider the problem of localization with no information on initial pose or planned flight path. We propose a solution for global visual localization on large maps, based on matching orthoprojected UAV images to satellite imagery using learned season-invariant descriptors, and test with environment sizes up to 100 km2. We show that the method is able to determine heading, latitude and longitude of the UAV at 12.6–18.7 m lateral translation error in as few as 23.2–44.4 updates from an uninformed initialization, also in situations of significant seasonal appearance difference (winter–summer) between the UAV image and the map. We evaluate the characteristics of multiple neural network architectures for generating the descriptors, and likelihood estimation methods that are able to provide fast convergence and low localization error. We also evaluate the operation of the algorithm using real UAV data and evaluate running time on a real-time embedded platform. We believe this is the first work that is able to recover the pose of an UAV at this scale and rate of convergence, while allowing significant seasonal difference between camera observations and map.en
dc.description.versionPeer revieweden
dc.format.mimetypeapplication/pdfen_US
dc.identifier.citationKinnari, J, Renzulli, R, Verdoja, F & Kyrki, V 2023, ' LSVL: Large-scale season-invariant visual localization for UAVs ', Robotics and Autonomous Systems, vol. 168, 104497 . https://doi.org/10.1016/j.robot.2023.104497en
dc.identifier.doi10.1016/j.robot.2023.104497en_US
dc.identifier.issn0921-8890
dc.identifier.otherPURE UUID: ef6a486e-b5c6-4e0e-bdcb-b4b34e6fa576en_US
dc.identifier.otherPURE ITEMURL: https://research.aalto.fi/en/publications/ef6a486e-b5c6-4e0e-bdcb-b4b34e6fa576en_US
dc.identifier.otherPURE LINK: http://www.scopus.com/inward/record.url?scp=85166950202&partnerID=8YFLogxKen_US
dc.identifier.otherPURE FILEURL: https://research.aalto.fi/files/119045687/1_s2.0_S0921889023001367_main.pdfen_US
dc.identifier.urihttps://aaltodoc.aalto.fi/handle/123456789/122679
dc.identifier.urnURN:NBN:fi:aalto-202308235025
dc.language.isoenen
dc.publisherElsevier Science
dc.relation.ispartofseriesRobotics and Autonomous Systemsen
dc.relation.ispartofseriesVolume 168en
dc.rightsopenAccessen
dc.subject.keywordLocalizationen_US
dc.subject.keywordSeasonal appearance changeen_US
dc.subject.keywordUAVen_US
dc.subject.keywordWake-up robot problemen_US
dc.titleLSVL: Large-scale season-invariant visual localization for UAVsen
dc.typeA1 Alkuperäisartikkeli tieteellisessä aikakauslehdessäfi
dc.type.versionpublishedVersion
Files