Modeling Risky Choices in Unknown Environments

Loading...
Thumbnail Image

Access rights

openAccess

URL

Journal Title

Journal ISSN

Volume Title

A4 Artikkeli konferenssijulkaisussa

Date

2021-05-01

Major/Subject

Mcode

Degree programme

Language

en

Pages

16
1081-1096

Series

Proceedings of The 13th Asian Conference on Machine Learning, Volume 157, Proceedings of Machine Learning Research

Abstract

Decision-theoretic models explain human behavior in choice problems involving uncertainty, in terms of individual tendencies such as risk aversion. However, many classical models of risk require knowing the distribution of possible outcomes (rewards) for all options, limiting their applicability outside of controlled experiments. We study the task of learning such models in contexts where the modeler does not know the distributions but instead can only observe the choices and their outcomes for a user familiar with the decision problems, for example a skilled player playing a digital game. We propose a framework combining two separate components, one for modeling the unknown decision-making environment and another for the risk behavior. By using environment models capable of learning distributions we are able to infer classical models of decision-making under risk from observations of the user’s choices and outcomes alone, and we also demonstrate alternative models for predictive purposes. We validate the approach on artificial data and demonstrate a practical use case in modeling risk attitudes of professional esports teams.

Description

Keywords

Other note

Citation

Tanskanen, V, Rajani, C, Afrabandpey, H, Putkonen, A, Nioche, A & Klami, A 2021, Modeling Risky Choices in Unknown Environments . in V N Balasubramanian & I Tsang (eds), Proceedings of The 13th Asian Conference on Machine Learning . vol. 157, Proceedings of Machine Learning Research, vol. 157, JMLR, pp. 1081-1096, Asian Conference on Machine Learning, Virtual, Online, 17/11/2021 . < https://proceedings.mlr.press/v157/tanskanen21a.html >