Statistics for Exploiting relevance for online decision-making in high-dimensions