Automated Excavator Based on Reinforcement Learning and Multibody System Dynamics
Loading...
Access rights
openAccess
publishedVersion
URL
Journal Title
Journal ISSN
Volume Title
A1 Alkuperäisartikkeli tieteellisessä aikakauslehdessä
This publication is imported from Aalto University research portal.
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
Date
2020-12-10
Department
Major/Subject
Mcode
Degree programme
Language
en
Pages
9
Series
IEEE Access, Volume 8, pp. 213998-214006
Abstract
Fully autonomous earth-moving heavy equipment able to operate without human intervention can be seen as the primary goal of automated earth construction. To achieve this objective requires that the machines have the ability to adapt autonomously to complex and changing environments. Recent developments in automation have focused on the application of different machine learning approaches, of which the use of reinforcement learning algorithms is considered the most promising. The key advantage of reinforcement learning is the ability of the system to learn, adapt and work independently in a dynamic environment. This article investigates an application of reinforcement learning algorithm for heavy mining machinery automation. To this end, the training associated with reinforcement learning is done using the multibody approach. The procedure used combines a multibody approach and proximal policy optimization with a covariance matrix adaptation learning algorithm to simulate an autonomous excavator. The multibody model includes a representation of the hydraulic system, multiple sensors observing the state of the excavator and deformable ground. The task of loading a hopper with soil taken from a chosen point on the ground is simulated. The excavator is trained to load the hopper effectively within a given time while avoiding collisions with the ground and the hopper. The proposed system demonstrates the desired behavior after short training times.Description
| openaire: EC/H2020/845600/EU//RealFlex
Keywords
Other note
Citation
Kurinov, I, Orzechowski, G, Hämäläinen, P & Mikkola, A 2020, ' Automated Excavator Based on Reinforcement Learning and Multibody System Dynamics ', IEEE Access, vol. 8, 9268069, pp. 213998-214006 . https://doi.org/10.1109/ACCESS.2020.3040246