Predicting Game Difficulty and Engagement Using AI Players

This paper presents a novel approach to automated playtesting for the prediction of human player behavior and experience. We have previously demonstrated that Deep Reinforcement Learning (DRL) game-playing agents can predict both game difficulty and player engagement, operationalized as average pass and churn rates. We improve this approach by enhancing DRL with Monte Carlo Tree Search (MCTS). We also motivate an enhanced selection strategy for predictor features, based on the observation that an AI agent's best-case performance can yield stronger correlations with human data than the agent's average performance. Both additions consistently improve the prediction accuracy, and the DRL-enhanced MCTS outperforms both DRL and vanilla MCTS in the hardest levels. We conclude that player modelling via automated playtesting can benefit from combining DRL and MCTS. Moreover, it can be worthwhile to investigate a subset of repeated best AI agent runs, if AI gameplay does not yield good predictions on average.

DOI

10.1145/3474658

Citation

Roohi, S, Guckelsberger, C, Relas, A, Heiskanen, H, Takatalo, J & Hämäläinen, P 2021, ' Predicting Game Difficulty and Engagement Using AI Players ', Proceedings of the ACM on Human-Computer Interaction, vol. 5, no. CHIPLAY, 231, pp. 1-17 . https://doi.org/10.1145/3474658

Permanent link to this item

https://urn.fi/URN:NBN:fi:aalto-2021112410418

Collections

[article-cris] Perustieteiden korkeakoulu / SCI

Show all metadata

Predicting Game Difficulty and Engagement Using AI Players

Access rights

URL

Journal Title

Journal ISSN

Volume Title

Authors

Date

Department

Major/Subject

Mcode

Degree programme

Language

Pages

Series

Abstract

Description

Keywords

Other note

DOI

Citation

Permanent link to this item

Collections