Malekipirbazari, MiladÇavuş, Özlem2022-01-272022-01-272021-01-250018-9286http://hdl.handle.net/11693/76828In classical multiarmed bandit problem, the aim is to find a policy maximizing the expected total reward, implicitly assuming that the decision-maker is risk-neutral. On the other hand, the decision-makers are risk-averse in some real-life applications. In this article, we design a new setting based on the concept of dynamic risk measures where the aim is to find a policy with the best risk-adjusted total discounted outcome. We provide a theoretical analysis of multiarmed bandit problem with respect to this novel setting and propose a priority-index heuristic which gives risk-averse allocation indices having a structure similar to Gittins index. Although an optimal policy is shown not always to have index-based form, empirical results express the excellence of this heuristic and show that with risk-averse allocation indices we can achieve optimal or near-optimal interpretable policies.EnglishCoherent risk measuresDynamic allocation indexDynamic risk-aversionGittins indexMultiarmed bandit (MAB)Article10.1109/TAC.2021.30535391558-2523