Radio resource allocation in 5G/B5G networks : A dimension reduction approach using Markov decision processes.

Abstract

We tackle radio resource allocation in 5G and B5G networks, focusing on applications with stringent delay requirements. We formulate this problem as a discounted Markov Decision Process (MDP), considering each user's Channel Quality Indicator and queue status. We introduce a reducible MDP using state abstraction. By mapping transition dynamics and rewards to an abstract state space, we simplify solving MDPs with smaller state spaces, avoiding the complexity of the original highdimensional state space. We explore different methods for weighted state aggregation and verify through simulations that our dimension reduction strategy yields results close to the optimal policy.