Browsing by Subject "Dynamic coherent risk measures"

Now showing 1 - 2 of 2

Embargo
Index policy for multiarmed bandit problem with dynamic risk measures
(Elsevier BV, 2023-08-06) Malekipirbazari, Milad; Çavus, Özlem
The multiarmed bandit problem (MAB) is a classic problem in which a finite amount of resources must be allocated among competing choices with the aim of identifying a policy that maximizes the expected total reward. MAB has a wide range of applications including clinical trials, portfolio design, tuning parameters, internet advertisement, auction mechanisms, adaptive routing in networks, and project management. The classical MAB makes the strong assumption that the decision maker is risk-neutral and indifferent to the variability of the outcome. However, in many real life applications, these assumptions are not met and decision makers are risk-averse. Motivated to resolve this, we study risk-averse control of the multiarmed bandit problem in regard to the concept of dynamic coherent risk measures to determine a policy with the best risk-adjusted total discounted return. In respect of this specific setting, we present a theoretical analysis based on Whittle’s retirement problem and propose a priority-index policy that reduces to the Gittins index when the level of risk-aversion converges to zero. We generalize the restart formulation of the Gittins index to effectively compute these risk-averse allocation indices. Numerical results exhibit the excellent performance of this heuristic approach for two well-known coherent risk measures of first-order mean-semideviation and mean-AVaR. Our experimental studies suggest that there is no guarantee that an index-based optimal policy exists for the risk-averse problem. Nonetheless, our risk-averse allocation indices can achieve optimal or near-optimal policies which in some instances are easier to interpret compared to the exact optimal policy.
Open Access
Risk-averse multi-stage mixed-integer stochastic programming problems
(2019-01) Mahmutoğulları, Ali İrfan
Risk-averse multi-stage mixed-integer stochastic programming problems form a class of extremely challenging problems since the problem size grows exponentially with the number of stages, they are non-convex due to integrality restrictions, and their objective functions are nonlinear in general. In this thesis, we first focus on such problems with an objective of dynamic mean conditional value-at-risk. We propose a scenario tree decomposition approach to obtain lower and upper bounds for their optimal values and then use these bounds in an evaluate-and-cut procedure which serves as an exact solution algorithm for such problems with integer first-stage decisions. Later, we consider a risk-averse day-ahead scheduling of electricity generation or unit commitment problem where the objective is a dynamic coherent risk measure. We consider two different versions of the problem: adaptive and non-adaptive. In the adaptive model, the commitment decisions are updated in each stage, whereas in the non-adaptive model, the commitment decisions are fixed in the first-stage. We provide theoretical and empirical analyses on the benefit of using an adaptive multi-stage stochastic model. Finally, we investigate the trade off between the adaptivity of the model and the computational effort to solve it for risk-averse multi-stage production planning problems with an objective of dynamic coherent risk measure. We also conduct computational experiments in order to verify the theoretical findings and discuss the results of these experiments.