Visualizing Movement Control Optimization Landscapes
Loading...
Access rights
openAccess
publishedVersion
URL
Journal Title
Journal ISSN
Volume Title
A1 Alkuperäisartikkeli tieteellisessä aikakauslehdessä
This publication is imported from Aalto University research portal.
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Date
2022
Department
Major/Subject
Mcode
Degree programme
Language
en
Pages
Series
IEEE Transactions on Visualization and Computer Graphics, Volume 28, issue 3, pp. 1648-1660
Abstract
A large body of animation research focuses on optimization of movement control, either as action sequences or policy parameters. However, as closed-form expressions of the objective functions are often not available, our understanding of the optimization problems is limited. Building on recent work on analyzing neural network training, we contribute novel visualizations of high-dimensional control optimization landscapes; this yields insights into why control optimization is hard and why common practices like early termination and spline-based action parameterizations make optimization easier. For example, our experiments show how trajectory optimization can become increasingly ill-conditioned with longer trajectories, but parameterizing control as partial target states-e.g., target angles converted to torques using a PD-controller-can act as an efficient preconditioner. Both our visualizations and quantitative empirical data also indicate that neural network policy optimization scales better than trajectory optimization for long planning horizons. Our work advances the understanding of movement optimization and our visualizations should also provide value in educational use.Description
Keywords
Other note
Citation
Hämäläinen, P, Toikka, J, Babadi, A & Liu, C K 2022, ' Visualizing Movement Control Optimization Landscapes ', IEEE Transactions on Visualization and Computer Graphics, vol. 28, no. 3, pp. 1648-1660 . https://doi.org/10.1109/TVCG.2020.3018187