Teacher-Learner Interaction for Robot Active Learning
Loading...
URL
Journal Title
Journal ISSN
Volume Title
School of Electrical Engineering |
Doctoral thesis (article-based)
| Defence date: 2020-10-30
Unless otherwise stated, all rights belong to the author. You may download, display and print this publication for Your own personal use. Commercial use is prohibited.
Authors
Date
2020
Major/Subject
Mcode
Degree programme
Language
en
Pages
98 + app. 60
Series
Aalto University publication series DOCTORAL DISSERTATIONS, 145/2020
Abstract
Robots are being adopted in an increasing number of new application areas, such as health care, logistics, and domestic services. Far from the structured environments of industrial settings, interaction between robots and humans will often become necessary and potentially beneficial. Simultaneously, the target audience of robots will grow to include users who lack the technical skills needed to program robots in the traditional manner. This dissertation proposes interactive learning methods based on Active Learning (AL) and Learning from Demonstration (LfD) that allow robots to learn by interacting with humans-in-the-loop. First, LfD, a learning paradigm that allows the user to program robots by providing examples of the desired behaviour, is adopted for the programming of in-contact tasks. To handle the variability of demonstrations collected through kinesthetic teaching, a probabilistic approach to the encoding of force profiles is proposed. Robot learning is then analysed as a collaborative task, showing how LfD often requires the human teacher to be an expert not only at the task in question but also at teaching a robot.To address the consequences of this rarely met requirement, AL, a learning paradigm that allows robots to participate actively in the teaching process by making queries to their teachers, is proposed for two applications: in combination with LfD for the learning of temporal task models, and as an aid for the tuning of robot programs in an End User Programming (EUP) scenario. The proposed AL approaches and their queries are designed taking into account the interaction between the robot and its human teacher. Investigating the interaction aspect of the proposed AL approaches revealed how their efficient queries may not always be optimal when human teachers are not considered ever-present, infallible sources of information. To investigate this issue, a AL approach that selects queries by taking into account the effort needed for the teacher to answer them is proposed and compared to traditional AL strategies, showing how these strategies impact the teacher's error rates, response times, and workload. Studying the interaction aspect further revealed the importance of transparency and the need for tools that expose robots' decisions to their users. A model-agnostic method that generates natural language explanations for robot policies is therefore presented, along with a study of the effect of its explanations on the user's understanding of the robot's policy. In summary, this dissertation investigates robot learning methods, emphasizing how their design should account for the interaction aspect of the training process.Description
A doctoral dissertation completed for the degree of Doctor of
Science (Technology) to be defended, with the permission of the
Aalto University School of Electrical Engineering, remote connection
at aalto.zoom.us/j/61397232666, on the 30th of October 2020 at
14:00 EET.
Supervising professor
Kyrki, Ville, Prof., Aalto University, Department of Electrical Engineering and Automation, FinlandKeywords
robotics, human-robot Interaction, active learning, learning from demonstration
Other note
Parts
-
[Publication 1]: Mattia Racca, Joni Pajarinen, Alberto Montebelli and Ville Kyrki. Learning In-Contact Control Strategies from Demonstration. In International Conference on Intelligent Robots and Systems (IROS), Daejeon, South Korea. pp. 688–695, September 2016.
DOI: 10.1109/IROS.2016.7759127 View at publisher
-
[Publication 2]: Mattia Racca and Ville Kyrki. Active Robot Learning for Temporal Task Models. In International Conference on Human-Robot Interaction (HRI), Chicago, USA. pp. 123–131, February 2018.
Full text in Acris/Aaltodoc: http://urn.fi/URN:NBN:fi:aalto-201902251972DOI: 10.1145/3171221.3171241 View at publisher
-
[Publication 3]: Mattia Racca, Antti Oulasvirta and Ville Kyrki. Teacher-Aware Active Robot Learning. In International Conference on Human-Robot Interaction (HRI), Daegu, South Korea. pp. 335–343, March 2019.
Full text in Acris/Aaltodoc: http://urn.fi/URN:NBN:fi:aalto-201905062891DOI: 10.1109/HRI.2019.8673300 View at publisher
-
[Publication 4]: Mattia Racca, Ville Kyrki and Maya Cakmak. Interactive Tuning of Robot Program Parameters via Expected Divergence Maximization. In International Conference on Human-Robot Interaction (HRI), Cambridge, UK. pp. 629–638, March 2020.Full text in Acris/Aaltodoc: http://urn.fi/URN:NBN:fi:aalto-202004282916.
DOI: 10.1145/3319502.3374784 View at publisher
-
[Publication 5]: Oliver Struckmeier, Mattia Racca and Ville Kyrki. Autonomous Generation of Robust and Focused Explanations for Robot Policies. In International Conference on Robot and Human Interactive Communication (RO-MAN), New Delhi, India. pp. 1–8, October 2019.
DOI: 10.1109/RO-MAN46459.2019.8956323 View at publisher