Abstract
As the development of blockchain and 5G, all kinds of intelligent devices have increasingly higher requirements on data rate and computing power, a large number of base stations are used, optimizing service cost and equipment energy consumption have become new challenges. It is certain that blockchain will be an important technology for the successful development of 5G network. As a new research direction, non-orthogonal multiple access technology (NOMA) combined with ultra-dense network (UDN) can effectively improve system capacity and reduce service cost. In this paper, we study a dynamic energy efficiency (EE) optimization problem under uplink NOMA communication in UDN. In order to ensure the real-time requirement of user equipment, a markov decision process (MDP) model is constructed by quantifying resources in access points (APs) and user equipments (UEs). On this basis, we propose a Deep Q-Network (DQN) based dynamic uplink power control algorithm to maximize the EE. According to different uplink channel gains in different base stations, UE transmission power is controlled through the center node. Through emulation and comparison with traditional Q-learning algorithm, experimental results show that DQN algorithm can effectively improve the EE of the system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Luong, N.C., Xiong, Z., Wang, P., Niyato, D.: Optimal auction for edge computing resource management in mobile blockchain networks: a deep learning approach. In: 2018 IEEE International Conference on Communications (ICC), Kansas City, MO, pp. 1–6 (2018)
Ericsson Mobility Report. https://www.ericsson.com/49d1d9/assets/local/mobility-report/documents/2019/ericsson-mobility-report-june-2019.pdf. Accessed 1 Oct 2019
Seng, S., Li, X., Ji, H., Zhang, H.: Joint access selection and heterogeneous resources allocation in UDNs with MEC based on non-orthogonal multiple access. In: 2018 IEEE International Conference on Communications Workshops (ICC Workshops), Kansas City, MO, pp. 1–6 (2018)
Yang, X., Yu, P., Feng, L., Zhou, F., Li, W., Qiu, X.: A deep reinforcement learning based mechanism for cell outage compensation in 5G UDN. In: 2019 IFIP/IEEE Symposium on Integrated Network and Service Management (IM), Arlington, VA, USA, pp. 476–481 (2019)
Wu, Q., Li, G.Y., Chen, W., Ng, D.W.K., Schober, R.: An overview of sustainable green 5G networks. IEEE Wirel. Commun. 24(4), 72–80 (2017)
de Souza, L.L., Pereira, P.H.M., Silva, J.D.C., Marins, C.N.M., Marcondes, G.A.B., Rodrigues, J.J.P.C..: IoT 5G-UDN protocols: practical model and evaluation. In: 2018 IEEE International Conference on Communications Workshops (ICC Workshops), Kansas City, MO, pp. 1–6 (2018)
Rabee, F.A., Davaslioglu, K., Gitlin, R.: The optimum received power levels of uplink non-orthogonal multiple access (NOMA) signals. In: 2017 IEEE 18th Wireless and Microwave Technology Conference (WAMICON), Cocoa Beach, FL, pp. 1–4 (2017)
Yin, Y., Peng, Y., Liu, M., Yang, J., Gui, G.: Dynamic user grouping-based NOMA over Rayleigh fading channels. IEEE Access 7, 110964–110971 (2019)
Sun, Y., Ding, Z., Dai, X., Dobre, O.A.: On the performance of network NOMA in uplink CoMP systems: a stochastic geometry approach. IEEE Trans. Commun. 67(7), 5084–5098 (2019)
Zeng, J., et al.: Investigation on evolving single-carrier NOMA into multi-carrier NOMA in 5G. IEEE Access 6, 48268–48288 (2018)
Fang, F., Cheng, J., Ding, Z.: Joint energy efficient subchannel and power optimization for a downlink NOMA heterogeneous network. IEEE Trans. Veh. Technol. 68(2), 1351–1364 (2019)
Liu, Y., Li, X., Ji, H., Zhang, H.: A multi-user access scheme for throughput enhancement in UDN with NOMA. In: 2017 IEEE International Conference on Communications Workshops (ICC Workshops), Paris, pp. 1364–1369 (2017)
Zhang, J., Xu, W., Chen, W., Gao, H., Lin, J.: Joint subcarrier assignment and downlink-uplink time-power allocation for wireless powered OFDM-NOMA systems. In: 2018 10th International Conference on Wireless Communications and Signal Processing (WCSP), Hangzhou, pp. 1–7 (2018)
Zhang, N., Wang, J., Kang, G., Liu, Y.: Uplink nonorthogonal multiple access in 5G systems. IEEE Commun. Lett. 20(3), 458–461 (2016)
Shahab, M.B., Irfan, M., Fazlul Kader, Md., Shin, S.Y.: User pairing schemes for capacity maximization in non-orthogonal multiple access systems. Wirel. Commun. Mob. Comput. 16, 2884–2894 (2016)
Shafi, M., et al.: 5G: a tutorial overview of standards trials challenges deployment and practice. IEEE JSAC 35(6), 1201–1221 (2017)
Fu, Y., Wen, W., Zhao, Z., Quek, T.Q.S., Jin, S., Zheng, F.: Dynamic power control for NOMA transmissions in wireless caching networks. IEEE Wirel. Commun. Lett. 8, 1485–1488 (2019)
Sun, Y., Wang, Y., Jiao, J., Wu, S., Zhang, Q.: Deep learning-based long-term power allocation scheme for NOMA downlink system in S-IoT. IEEE Access 7, 86288–86296 (2019)
Dai, Y., Xu, D., Maharjan, S., Chen, Z., He, Q., Zhang, Y.: Blockchain and deep reinforcement learning empowered intelligent 5G beyond. IEEE Netw. 33(3), 10–17 (2019)
Acknowledgments
This work is partly supported by the National Natural Science Foundation of China (Nos. 61872044, 61902029), the Key Research and Cultivation Projects at Beijing Information Science and Technology University (No.5211910958), the Supplementary and Supportive Project for Teachers at Beijing Information Science and Technology University (No. 5111911128), Beijing Municipal Program for Top Talent Cultivation (CIT & TCD201804055) and Qinxin Talent Program of Beijing Information Science and Technology University.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Liu, X., Chen, X., Chen, Y., Li, Z. (2020). Deep Learning Based Dynamic Uplink Power Control for NOMA Ultra-Dense Network System. In: Zheng, Z., Dai, HN., Tang, M., Chen, X. (eds) Blockchain and Trustworthy Systems. BlockSys 2019. Communications in Computer and Information Science, vol 1156. Springer, Singapore. https://doi.org/10.1007/978-981-15-2777-7_64
Download citation
DOI: https://doi.org/10.1007/978-981-15-2777-7_64
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-2776-0
Online ISBN: 978-981-15-2777-7
eBook Packages: Computer ScienceComputer Science (R0)