Few-shot model-based adaptation in noisy conditions
Loading...
Access rights
openAccess
acceptedVersion
URL
Journal Title
Journal ISSN
Volume Title
A1 Alkuperäisartikkeli tieteellisessä aikakauslehdessä
This publication is imported from Aalto University research portal.
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Date
Major/Subject
Mcode
Degree programme
Language
en
Pages
8
Series
IEEE Robotics and Automation Letters, Volume 6, issue 2, pp. 4193-4200
Abstract
Few-shot adaptation is a challenging problem in the context of simulation-to-real transfer in robotics, requiring safe and informative data collection. In physical systems, additional challenge may be posed by domain noise, which is present in virtually all real-world applications. In this letter, we propose to perform few-shot adaptation of dynamics models in noisy conditions using an uncertainty-aware Kalman filter-based neural network architecture. We show that the proposed method, which explicitly addresses domain noise, improves few-shot adaptation error over a blackbox adaptation LSTM baseline, and over a model-free on-policy reinforcement learning approach, which tries to learn an adaptable and informative policy at the same time. The proposed method also allows for system analysis by analyzing hidden states of the model during and after adaptation.Description
Publisher Copyright: IEEE Copyright: Copyright 2021 Elsevier B.V., All rights reserved.
Other note
Citation
Arndt, K, Ghadirzadeh, A, Hazara, M & Kyrki, V 2021, 'Few-shot model-based adaptation in noisy conditions', IEEE Robotics and Automation Letters, vol. 6, no. 2, 9384205, pp. 4193-4200. https://doi.org/10.1109/LRA.2021.3068104