Statistics for Markov decision process formulations for management of pumped hydro energy storage systems