Abstract
The 5th generation (5G) mobile networks and beyond need to support massive machine-type communications (MTC) devices with limited available radio resources. In this paper, we study the power-domain non-orthogonal multiple access (NOMA) technology to support energy-efficient massive MTC networks, where MTC devices exchange information using sporadic and low-rate short packets. We investigate the subchannel allocation and power control policy to maximize the achievable effective energy efficiency (EE) for uplink NOMA-based massive MTC networks, taking into account of short-packet communication characteristics. We model the subchannel allocation problem as a multi-agent Markov decision process and propose an efficient Q-learning algorithm to solve it. Furthermore, we obtain the optimal transmission power policy by approximating the achievable effective rate of uplink NOMA-based short packet communications. Compared with the existing OFDMA scheme, simulations validate that the proposed scheme can improve the achievable effective EE of massive MTC networks with 5.93%.