More Web Proxy on the site http://driver.im/

research-article

Application of Machine Learning in Wireless Networks: Key Techniques and Open Issues

Authors:

Yangcheng Zhou,

Shiwen MaoAuthors Info & Claims

IEEE Communications Surveys & Tutorials, Volume 21, Issue 4

Pages 3072 - 3108

https://doi.org/10.1109/COMST.2019.2924243

Published: 01 October 2019 Publication History

Abstract

As a key technique for enabling artificial intelligence, machine learning (ML) is capable of solving complex problems without explicit programming. Motivated by its successful applications to many practical tasks like image recognition, both industry and the research community have advocated the applications of ML in wireless communication. This paper comprehensively surveys the recent advances of the applications of ML in wireless communication, which are classified as: resource management in the MAC layer, networking and mobility management in the network layer, and localization in the application layer. The applications in resource management further include power control, spectrum management, backhaul management, cache management, and beamformer design and computation resource management, while ML-based networking focuses on the applications in clustering, base station switching control, user association, and routing. Moreover, literatures in each aspect is organized according to the adopted ML techniques. In addition, several conditions for applying ML to wireless communication are identified to help readers decide whether to use ML and which kind of ML techniques to use. Traditional approaches are also summarized together with their performance comparison with ML-based approaches, based on which the motivations of surveyed literatures to adopt ML are clarified. Given the extensiveness of the research area, challenges and unresolved issues are presented to facilitate future studies. Specifically, ML-based network slicing, infrastructure update to support ML-based paradigms, open data sets and platforms for researchers, theoretical guidance for ML implementation, and so on are discussed.

References

[1]

M. Peng, W. Wang, and H.-H. Chen, “TD-SCDMA evolution,” IEEE Veh. Technol. Mag., vol. 5, no. 2, pp. 28–41, Jun. 2010.

[2]

M. Agiwal, A. Roy, and N. Saxena, “Next generation 5G wireless networks: A comprehensive survey,” IEEE Commun. Surveys Tuts., vol. 18, no. 3, pp. 1617–1655, 3rd Quart., 2016.

Digital Library

[3]

M. Peng, Y. Li, Z. Zhao, and C. Wang, “System architecture and key technologies for 5G heterogeneous cloud radio access networks,” IEEE Netw., vol. 29, no. 2, pp. 6–14, Mar./Apr. 2015.

Digital Library

[4]

M. Peng, S. Yan, K. Zhang, and C. Wang, “Fog-computing-based radio access networks: Issues and challenges,” IEEE Netw., vol. 30, no. 4, pp. 46–53, Jul./Aug. 2016.

Digital Library

[5]

M. Peng, C. Wang, V. Lau, and H. V. Poor, “Fronthaul-constrained cloud radio access networks: Insights and challenges,” IEEE Wireless Commun., vol. 22, no. 2, pp. 152–160, Apr. 2015.

Digital Library

[6]

W. H. Chin, Z. Fan, and R. Haines, “Emerging technologies and research challenges for 5G wireless networks,” IEEE Wireless Commun., vol. 21, no. 2, pp. 106–112, Apr. 2014.

[7]

Y. Mao, C. You, J. Zhang, K. Huang, and K. B. Letaief, “A survey on mobile edge computing: The communication perspective,” IEEE Commun. Surveys Tuts., vol. 19, no. 4, pp. 2322–2358, 4th Quart., 2017.

[8]

X. Wang, M. Chen, T. Taleb, A. Ksentini, and V. C. M. Leung, “Cache in the air: Exploiting content caching and delivery techniques for 5G systems,” IEEE Commun. Mag., vol. 52, no. 2, pp. 131–139, Feb. 2014.

[9]

J. Li, M. Peng, Y. Yu, and Z. Ding, “Energy-efficient joint congestion control and resource optimization in heterogeneous cloud radio access networks,” IEEE Trans. Veh. Technol., vol. 65, no. 12, pp. 9873–9887, Dec. 2016.

[10]

M. Peng, K. Zhang, J. Jiang, J. Wang, and W. Wang, “Energy-efficient resource assignment and power allocation in heterogeneous cloud radio access networks,” IEEE Trans. Veh. Technol., vol. 64, no. 11, pp. 5275–5287, Nov. 2015.

[11]

M. Peng, Y. Sun, X. Li, Z. Mao, and C. Wang, “Recent advances in cloud radio access networks: System architectures, key techniques, and open issues,” IEEE Commun. Surveys Tuts., vol. 18, no. 3, pp. 2282–2308, 3rd Quart., 2016.

Digital Library

[12]

J. Liu, N. Kato, J. Ma, and N. Kadowaki, “Device-to-device communication in LTE-advanced networks: A survey,” IEEE Commun. Surveys Tuts., vol. 17, no. 4, pp. 1923–1940, 4th Quart., 2015.

Digital Library

[13]

S. Han, C.-L. I, G. Li, S. Wang, and Q. Sun, “Big data enabled mobile network design for 5G and beyond,” IEEE Commun. Mag., vol. 55, no. 9, pp. 150–157, Sep. 2017.

Digital Library

[14]

R. S. Michalski, J. G. Carbonell, and T. M. Mitchell, Machine Learning: An Artificial Intelligence Approach. Heidelberg, Germany: Springer, 2013.

Digital Library

[15]

H. Sun, X. Chen, Q. Shi, M. Hong, X. Fu, and N. D. Sidiropoulos, “Learning to optimize: Training deep neural networks for interference management,” IEEE Trans. Signal Process., vol. 66, no. 20, pp. 5438–5453, Oct. 2018.

[16]

G. Cao, Z. Lu, X. Wen, T. Lei, and Z. Hu, “AIF: An artificial intelligence framework for smart wireless network management,” IEEE Commun. Lett., vol. 22, no. 2, pp. 400–403, Feb. 2018.

[17]

C. Xiao, D. Yang, Z. Chen, and G. Tan, “3-D BLE indoor localization based on denoising autoencoder,” IEEE Access, vol. 5, pp. 12751–12760, 2017.

[18]

R. Li, Z. Zhao, X. Chen, J. Palicot, and H. Zhang, “TACT: A transfer actor-critic learning framework for energy saving in cellular radio access networks,” IEEE Trans. Wireless Commun., vol. 13, no. 4, pp. 2000–2011, Apr. 2014.

[19]

C. Jiang, H. Zhang, Y. Ren, Z. Han, K.-C. Chen, and L. Hanzo, “Machine learning paradigms for next-generation wireless networks,” IEEE Wireless Commun., vol. 24, no. 2, pp. 98–105, Apr. 2017.

Digital Library

[20]

M. A. Alsheikh, S. Lin, D. Niyato, and H.-P. Tan, “Machine learning in wireless sensor networks: Algorithms, strategies, and applications,” IEEE Commun. Surveys Tuts., vol. 16, no. 4, pp. 1996–2018, 4th Quart., 2014.

[21]

T. Park, N. Abuzainab, and W. Saad, “Learning how to communicate in the Internet of Things: Finite resources and heterogeneity,” IEEE Access, vol. 4, pp. 7063–7073, 2016.

[22]

O. B. Sezer, E. Dogdu, and A. M. Ozbayoglu, “Context-aware computing, learning, and big data in Internet of Things: A survey,” IEEE Internet Things J., vol. 5, no. 1, pp. 1–27, Feb. 2018.

[23]

M. Bkassiny, Y. Li, and S. K. Jayaweera, “A survey on machine-learning techniques in cognitive radios,” IEEE Commun. Surveys Tuts., vol. 15, no. 3, pp. 1136–1159, 3rd Quart., 2013.

[24]

W. Wang, A. Kwasinski, D. Niyato, and Z. Han, “A survey on applications of model-free strategy learning in cognitive wireless networks,” IEEE Commun. Surveys Tuts., vol. 18, no. 3, pp. 1717–1757, 3rd Quart., 2016.

Digital Library

[25]

X. Wang, X. Li, and V. C. M. Leung, “Artificial intelligence-based techniques for emerging heterogeneous network: State of the arts, opportunities, and challenges,” IEEE Access, vol. 3, pp. 1379–1391, 2015.

[26]

P. V. Klaine, M. A. Imran, O. Onireti, and R. D. Souza, “A survey of machine learning techniques applied to self-organizing cellular networks,” IEEE Commun. Surveys Tuts., vol. 19, no. 4, pp. 2392–2431, 4th Quart., 2017.

[27]

X. Cao, L. Liu, Y. Cheng, and X. S. Shen, “Towards energy-efficient wireless networking in the big data era: A survey,” IEEE Commun. Surveys Tuts., vol. 20, no. 1, pp. 303–332, 1st Quart., 2018.

[28]

M. Chen, U. Challita, W. Saad, C. Yin, and M. Debbah, “Machine learning for wireless networks with artificial intelligence: A tutorial on neural networks,” arXiv:1710.02913v1, Oct. 2017.

[29]

T. O’Shea and J. Hoydis, “An introduction to deep learning for the physical layer,” IEEE Trans. Cogn. Commun. Netw., vol. 3, no. 4, pp. 563–575, Dec. 2017.

[30]

T. Wang, C.-K. Wen, H. Wang, F. Gao, T. Jiang, and S. Jin, “Deep learning for wireless physical layer: Opportunities and challenges,” China Commun., vol. 14, no. 11, pp. 92–111, Nov. 2017.

[31]

Q. Mao, F. Hu, and Q. Hao, “Deep learning for intelligent wireless networks: A comprehensive survey,” IEEE Commun. Surveys Tuts., vol. 20, no. 4, pp. 2595–2621, 4th Quart., 2018.

Digital Library

[32]

C. Zhang, P. Patras, and H. Haddadi, “Deep learning in mobile and wireless networking: A survey,” IEEE Commun. Surveys Tuts., to be published. 10.1109/COMST.2019.2904897.

[33]

Z. M. Fadlullahet al., “State-of-the-art deep learning: Evolving machine intelligence toward tomorrow’s intelligent network traffic control systems,” IEEE Commun. Surveys Tuts., vol. 19, no. 4, pp. 2432–2455, 4th Quart., 2017.

[34]

V. N. Vapnik, Statistical Learning Theory, vol. 1. New York, NY, USA: Wiley, 1998.

Digital Library

[35]

B. S. Everitt, S. Landau, M. Leese, and D. Stahl, Miscellaneous Clustering Methods, in Cluster Analysis, 5th ed. Chichester, U.K.: Wiley, 2011.

[36]

H. Abdi and L. J. Williams, “Principal component analysis,” Wiley Interdiscipl. Rev. Comput. Stat., vol. 2, no. 4, pp. 433–459, Jul./Aug. 2010.

Digital Library

[37]

R. Sutton and A. Barto, Reinforcement Learning: An Introduction. Cambridge, MA, USA: MIT Press, 1998.

Digital Library

[38]

P. Y. Glorennec, “Fuzzy Q-learning and dynamical fuzzy Q-learning,” in Proc. IEEE 3rd Int. Fuzzy Syst. Conf., Orlando, FL, USA, Jun. 1994, pp. 474–479.

[39]

S. Maghsudi and E. Hossain, “Distributed user association in energy harvesting dense small cell networks: A mean-field multi-armed bandit approach,” IEEE Access, vol. 5, pp. 3513–3523, 2017.

[40]

S. Bubeck and N. Cesa-Bianchi, “Regret analysis of stochastic and nonstochastic multi-armed bandit problems,” Found. Trends^® Mach. Learn., vol. 5, no. 1, pp. 1–122, 2012.

[41]

S. Singh, T. Jaakkola, M. L. Littman, and C. Szepesvári, “Convergence results for single-step on-policy reinforcement-learning algorithms,” Mach. Learn., vol. 38, no. 3, pp. 287–308, Mar. 2000.

Digital Library

[42]

S. M. Perlaza, H. Tembine, and S. Lasaulce, “How can ignorant but patient cognitive terminals learn their strategy and utility?” in Proc. SPAWC, Marrakesh, Morocco, Jun. 2010, pp. 1–5.

[43]

V. Mnihet al., “Human-level control through deep reinforcement learning,” Nature, vol. 518, no. 7540, pp. 529–533, Feb. 2015.

[44]

Y. Li, “Deep reinforcement learning: An overview,” arXiv:1701.07274v6, Nov. 2018.

[45]

S. Ruder, “An overview of gradient descent optimization algorithms,” arXiv:1609.04747v2, Jun. 2017.

[46]

G.-B. Huang, Q.-Y. Zhu, and C.-K. Siew, “Extreme learning machine: Theory and applications,” Neurocomputing, vol. 70, nos. 1–3, pp. 489–501, Dec. 2006.

[47]

M. E. Taylor and P. Stone, “Transfer learning for reinforcement learning domains: A survey,” J. Mach. Learn. Res., vol. 10, pp. 1633–1685, Dec. 2009.

[48]

M. Simsek, M. Bennis, and I. Güvenç, “Learning based frequency-and time-domain inter-cell interference coordination in HetNets,” IEEE Trans. Veh. Technol., vol. 64, no. 10, pp. 4589–4602, Oct. 2015.

[49]

T. Sanguanpuak, S. Guruacharya, N. Rajatheva, M. Bennis, and M. Latva-Aho, “Multi-operator spectrum sharing for small cell networks: A matching game perspective,” IEEE Trans. Wireless Commun., vol. 16, no. 6, pp. 3761–3774, Jun. 2017.

[50]

A. Galindo-Serrano and L. Giupponi, “Distributed Q-learning for aggregated interference control in cognitive radio networks,” IEEE Trans. Veh. Technol., vol. 59, no. 4, pp. 1823–1834, May 2010.

[51]

M. Bennis, S. M. Perlaza, P. Blasco, Z. Han, and H. V. Poor, “Self-organization in small cell networks: A reinforcement learning approach,” IEEE Trans. Wireless Commun., vol. 12, no. 7, pp. 3202–3212, Jul. 2013.

[52]

A. Asheralieva and Y. Miyanaga, “An autonomous learning-based algorithm for joint channel and power level selection by D2D pairs in heterogeneous cellular networks,” IEEE Trans. Commun., vol. 64, no. 9, pp. 3996–4012, Sep. 2016.

[53]

L. Xu and A. Nallanathan, “Energy-efficient chance-constrained resource allocation for multicast cognitive OFDM network,” IEEE J. Sel. Areas Commun., vol. 34, no. 5, pp. 1298–1306, May 2016.

Digital Library

[54]

M. Lin, J. Ouyang, and W.-P. Zhu, “Joint beamforming and power control for device-to-device communications underlaying cellular networks,” IEEE J. Sel. Areas Commun., vol. 34, no. 1, pp. 138–150, Jan. 2016.

Digital Library

[55]

W. Lee, M. Kim, and D.-H. Cho, “Deep power control: Transmit power control scheme based on convolutional neural network,” IEEE Commun. Lett., vol. 22, no. 6, pp. 1276–1279, Jun. 2018.

[56]

K. I. Ahmed, H. Tabassum, and E. Hossain, “Deep learning for radio resource allocation in multi-cell networks,” IEEE Netw., submitted for publication. 10.1109/MNET.2019.1900029.

Digital Library

[57]

A. Galindo-Serrano, L. Giupponi, and G. Auer, “Distributed learning in multiuser OFDMA femtocell networks,” in Proc. VTC, Yokohama, Japan, May 2011, pp. 1–6.

[58]

C. Fan, B. Li, C. Zhao, W. Guo, and Y.-C. Liang, “Learning-based spectrum sharing and spatial reuse in mm-Wave ultradense networks,” IEEE Trans. Veh. Technol., vol. 67, no. 6, pp. 4954–4968, Jun. 2018.

[59]

Y. Zhang, W. P. Tay, K. H. Li, M. Esseghir, and D. Gaiti, “Learning temporal-spatial spectrum reuse,” IEEE Trans. Commun., vol. 64, no. 7, pp. 3092–3103, Jul. 2016.

[60]

G. Alnwaimi, S. Vahid, and K. Moessner, “Dynamic heterogeneous learning games for opportunistic access in LTE-based macro/femtocell deployments,” IEEE Trans. Wireless Commun., vol. 14, no. 4, pp. 2294–2308, Apr. 2015.

Digital Library

[61]

Y. Sun, M. Peng, and H. V. Poor, “A distributed approach to improving spectral efficiency in uplink device-to-device-enabled cloud radio access networks,” IEEE Trans. Commun., vol. 66, no. 12, pp. 6511–6526, Dec. 2018.

[62]

M. Srinivasan, V. J. Kotagi, and C. S. R. Murthy, “A Q-learning framework for user QoE enhanced self-organizing spectrally efficient network using a novel inter-operator proximal spectrum sharing,” IEEE J. Sel. Areas Commun., vol. 34, no. 11, pp. 2887–2901, Nov. 2016.

Digital Library

[63]

M. Chen, W. Saad, and C. Yin, “Echo state networks for self-organizing resource allocation in LTE-U with uplink–downlink decoupling,” IEEE Trans. Wireless Commun., vol. 16, no. 1, pp. 3–16, Jan. 2017.

Digital Library

[64]

M. Chen, W. Saad, and C. Yin, “Virtual reality over wireless networks: Quality-of-service model and learning-based resource management,” IEEE Trans. Commun., vol. 66, no. 11, pp. 5621–5635, Nov. 2018.

[65]

M. Jaber, M. Imran, R. Tafazolli, and A. Tukmanov, “An adaptive backhaul-aware cell range extension approach,” in Proc. ICCW, London, U.K., Jun. 2015, pp. 74–79.

[66]

Y. Xu, R. Yin, and G. Yu, “Adaptive biasing scheme for load balancing in backhaul constrained small cell networks,” IET Commun., vol. 9, no. 7, pp. 999–1005, May 2015.

[67]

K. Hamidouche, W. Saad, M. Debbah, J. B. Song, and C. S. Hong, “The 5G cellular backhaul management dilemma: To cache or to serve,” IEEE Trans. Wireless Commun., vol. 16, no. 8, pp. 4866–4879, Aug. 2017.

Digital Library

[68]

S. Samarakoon, M. Bennis, W. Saad, and M. Latva-Aho, “Backhaul-aware interference management in the uplink of wireless small cell networks,” IEEE Trans. Wireless Commun., vol. 12, no. 11, pp. 5813–5825, Nov. 2013.

[69]

J. Lun and D. Grace, “Cognitive green backhaul deployments for future 5G networks,” in Proc. Int. Workshop Cogn. Cellular Syst. (CCS), Duisburg, Germany, Sep. 2014, pp. 1–5.

[70]

P. Blasco, M. Bennis, and M. Dohler, “Backhaul-aware self-organizing operator-shared small cell networks,” in Proc. ICC, Budapest, Hungary, Jun. 2013, pp. 2801–2806.

[71]

M. Jaber, M. A. Imran, R. Tafazolli, and A. Tukmanov, “A multiple attribute user-centric backhaul provisioning scheme using distributed SON,” in Proc. GLOBECOM, Washington, DC, USA, Dec. 2016, pp. 1–6.

[72]

Cisco Visual Networking Index: Global Mobile Data Traffic Forecast Update, 2015–2020, Cisco, San Jose, CA, USA, 2016.

[73]

Z. Chang, L. Lei, Z. Zhou, S. Mao, and T. Ristaniemi, “Learn to cache: Machine learning for network edge caching in the big data era,” IEEE Wireless Commun., vol. 25, no. 3, pp. 28–35, Jun. 2018.

[74]

S. Tamoor-ul-Hassan, S. Samarakoon, M. Bennis, M. Latva-Aho, and C. S. Hong, “Learning-based caching in cloud-aided wireless networks,” IEEE Commun. Lett., vol. 22, no. 1, pp. 137–140, Jan. 2018.

[75]

W. Wang, R. Lan, J. Gu, A. Huang, H. Shan, and Z. Zhang, “Edge caching at base stations with device-to-device offloading,” IEEE Access, vol. 5, pp. 6399–6410, 2017.

[76]

Y. He, N. Zhao, and H. Yin, “Integrated networking, caching, and computing for connected vehicles: A deep reinforcement learning approach,” IEEE Trans. Veh. Technol., vol. 67, no. 1, pp. 44–55, Jan. 2018.

[77]

C. Zhong, M. C. Gursoy, and S. Velipasalar, “A deep reinforcement learning-based framework for content caching,” in Proc. CISS, Princeton, NJ, USA, Mar. 2018, pp. 1–6.

[78]

S. M. S. Tanzil, W. Hoiles, and V. Krishnamurthy, “Adaptive scheme for caching YouTube content in a cellular network: Machine learning approach,” IEEE Access, vol. 5, pp. 5870–5881, 2017.

[79]

M. Chen, M. Mozaffari, W. Saad, C. Yin, M. Debbah, and C. S. Hong, “Caching in the sky: Proactive deployment of cache-enabled unmanned aerial vehicles for optimized quality-of-experience,” IEEE J. Sel. Areas Commun., vol. 35, no. 5, pp. 1046–1061, May 2017.

Digital Library

[80]

M. Chen, W. Saad, C. Yin, and M. Debbah, “Echo state networks for proactive caching in cloud-based radio access networks with mobile users,” IEEE Trans. Wireless Commun., vol. 16, no. 6, pp. 3520–3535, Jun. 2017.

Digital Library

[81]

K. N. Doan, T. V. Nguyen, T. Q. S. Quek, and H. Shin, “Content-aware proactive caching for backhaul offloading in cellular network,” IEEE Trans. Wireless Commun., vol. 17, no. 5, pp. 3128–3140, May 2018.

[82]

B. N. Bharath, K. G. Nagananda, and H. V. Poor, “A learning-based approach to caching in heterogenous small cell networks,” IEEE Trans. Wireless Commun., vol. 64, no. 4, pp. 1674–1686, Apr. 2016.

[83]

E. Bastug, M. Bennis, and M. Debbah, “Anticipatory caching in small cell networks: A transfer learning approach,” in Proc. Workshop Anticipatory Netw., Stuttgart, Germany, Sep. 2014, pp. 1–3.

[84]

E. Baştuǧ, M. Bennis, and M. Debbah, “A transfer learning approach for cache-enabled wireless networks,” in Proc. WiOpt, Mumbai, India, May 2015, pp. 161–166.

[85]

X. Chen, H. Zhang, C. Wu, S. Mao, Y. Ji, and M. Bennis, “Optimized computation offloading performance in virtual edge computing systems via deep reinforcement learning,” IEEE Internet Things J., vol. 6, no. 3, pp. 4005–4018, Jun. 2019.

[86]

J.-B. Wanget al., “A machine learning framework for resource allocation assisted by cloud computing,” IEEE Netw., vol. 32, no. 2, pp. 144–151, Mar./Apr. 2018.

[87]

Z. Li, C. Wang, and C.-J. Jiang, “User association for load balancing in vehicular networks: An online reinforcement learning approach,” IEEE Trans. Intell. Transp. Syst., vol. 18, no. 8, pp. 2217–2228, Aug. 2017.

Digital Library

[88]

F. Pervez, M. Jaber, J. Qadir, S. Younis, and M. A. Imran, “Fuzzy Q-learning-based user-centric backhaul-aware user cell association scheme,” in Proc. IWCMC, Valencia, Spain, Jun. 2017, pp. 1840–1845.

[89]

T. Kudo and T. Ohtsuki, “Cell range expansion using distributed Q-learning in heterogeneous networks,” in Proc. VTC, Las Vegas, NV, USA, Sep. 2013, pp. 1–5.

[90]

Y. Meng, C. Jiang, L. Xu, Y. Ren, and Z. Han, “User association in heterogeneous networks: A social interaction approach,” IEEE Trans. Veh. Technol., vol. 65, no. 12, pp. 9982–9993, Dec. 2016.

[91]

U. Challita, W. Saad, and C. Bettstetter, “Cellular-connected UAVs over 5G: Deep reinforcement learning for interference management,” arXiv:1801.05500v1, Jan. 2018.

[92]

H. Yu, M. H. Cheung, G. Iosifidis, L. Gao, L. Tassiulas, and J. Huang, “Mobile data offloading for green wireless networks,” IEEE Wireless Commun., vol. 24, no. 4, pp. 31–37, Aug. 2017.

Digital Library

[93]

I. Ashraf, F. Boccardi, and L. Ho, “SLEEP mode techniques for small cell deployments,” IEEE Commun. Mag., vol. 49, no. 8, pp. 72–79, Aug. 2011.

[94]

R. Li, Z. Zhao, X. Chen, and H. Zhang, “Energy saving through a learning framework in greener cellular radio access networks,” in Proc. GLOBECOM, Anaheim, CA, USA, Dec. 2012, pp. 1556–1561.

[95]

X. Ganet al., “Energy efficient switch policy for small cells,” China Commun., vol. 12, no. 1, pp. 78–88, Jan. 2015.

[96]

G. Yu, Q. Chen, and R. Yin, “Dual-threshold sleep mode control scheme for small cells,” IET Commun., vol. 8, no. 11, pp. 2008–2016, Jul. 2014.

Digital Library

[97]

Z. Xu, Y. Wang, J. Tang, J. Wang, and M. C. Gursoy, “A deep reinforcement learning based framework for power-efficient resource allocation in cloud RANs,” in Proc. ICC, Paris, France, May 2017, pp. 1–6.

[98]

S. Fan, H. Tian, and C. Sengul, “Self-optimized heterogeneous networks for energy efficiency,” Eurasip J. Wireless Commun. Netw., vol. 21, pp. 1–11, Feb. 2015.

[99]

P.-Y. Kong and D. Panaitopol, “Reinforcement learning approach to dynamic activation of base station resources in wireless networks,” in Proc. PIMRC, London, U.K., Sep. 2013, pp. 3264–3268.

[100]

S. Sharma, S. J. Darak, and A. Srivastava, “Energy saving in heterogeneous cellular network via transfer reinforcement learning based policy,” in Proc. COMSNETS, Bengaluru, India, Jan. 2017, pp. 397–398.

[101]

S. Sharma, S. J. Darak, A. Srivastava, and H. Zhang, “A transfer learning framework for energy efficient Wi-Fi networks and performance analysis using real data,” in Proc. ANTS, Bengaluru, India, Nov. 2016, pp. 1–6.

[102]

S. Samarakoon, M. Bennis, W. Saad, and M. Latva-Aho, “Dynamic clustering and ON/OFF strategies for wireless small cell networks,” IEEE Trans. Wireless Commun., vol. 15, no. 3, pp. 2164–2178, Mar. 2016.

Digital Library

[103]

Q. Zhao, D. Grace, A. Vilhar, and T. Javornik, “Using k-means clustering with transfer and Q learning for spectrum, load and energy optimization in opportunistic mobile broadband networks,” in Proc. ISWCS, Brussels, Belgium, Aug. 2015, pp. 116–120.

[104]

M. Miozzo, L. Giupponi, M. Rossi, and P. Dini, “Distributed Q-learning for energy harvesting heterogeneous networks,” in Proc. IEEE Int. Conf. Commun. Workshop (ICCW), Brussels, Belgium, 2015, pp. 2006–2011.

[105]

Y. Saleem, K.-L. A. Yau, H. Mohamad, N. Ramli, M. H. Rehmani, and Q. Ni, “Clustering and reinforcement-learning-based routing for cognitive radio networks,” IEEE Wireless Commun., vol. 24, no. 4, pp. 146–151, Aug. 2017.

[106]

A. R. Syed, K.-L. A. Yau, J. Qadir, H. Mohamad, N. Ramli, and S. L. Keoh, “Route selection for multi-hop cognitive radio networks using reinforcement learning: An experimental study,” IEEE Access, vol. 4, pp. 6304–6324, 2016.

[107]

H. A. A. Al-Rawi, K.-L. A. Yau, H. Mohamad, N. Ramli, and W. Hashim, “Effects of network characteristics on learning mechanism for routing in cognitive radio ad hoc networks,” in Proc. CSNDSP, Manchester, U.K., Jul. 2014, pp. 748–753.

[108]

W.-S. Jung, J. Yim, and Y.-B. Ko, “QGeo: Q-learning-based geographic ad hoc routing protocol for unmanned robotic networks,” IEEE Commun. Lett., vol. 21, no. 10, pp. 2258–2261, Oct. 2017.

[109]

N. Katoet al., “The deep learning vision for heterogeneous network traffic control: Proposal, challenges, and future perspective,” IEEE Wireless Commun., vol. 24, no. 3, pp. 146–153, Jun. 2017.

Digital Library

[110]

F. Tanget al., “On removing routing protocol from future wireless networks: A real-time deep learning approach for intelligent traffic control,” IEEE Wireless. Commun., vol. 25, no. 1, pp. 154–160, Feb. 2018.

Digital Library

[111]

L. Lei, L. You, G. Dai, T. X. Vu, D. Yuan, and S. Chatzinotas, “A deep learning approach for optimizing content delivering in cache-enabled HetNet,” in Proc. ISWCS, Bologna, Italy, Aug. 2017, pp. 449–453.

[112]

H. Tabrizi, G. Farhadi, and J. M. Cioffi, “CaSRA: An algorithm for cognitive tethering in dense wireless areas,” in Proc. GLOBECOM, Atlanta, GA, USA, Dec. 2013, pp. 3855–3860.

[113]

Y. Heet al., “Deep-reinforcement-learning-based optimization for cache-enabled opportunistic interference alignment wireless networks,” IEEE Trans. Veh. Technol., vol. 66, no. 11, pp. 10433–10445, Nov. 2017.

[114]

J. Wu, J. Liu, Z. Huang, and S. Zheng, “Dynamic fuzzy Q-learning for handover parameters optimization in 5G multi-tier networks,” in Proc. WCSP, Nanjing, China, Oct. 2015, pp. 1–5.

[115]

A. Klein, N. P. Kuruvatti, J. Schneider, and H. D. Schotten, “Fuzzy Q-learning for mobility robustness optimization in wireless networks,” in Proc. GC Wkshps, Atlanta, GA, USA, Dec. 2013, pp. 76–81.

[116]

P. Muñoz, R. Barco, J. M. Ruiz-Avilés, I. de la Bandera, and A. Aguilar, “Fuzzy rule-based reinforcement learning for load balancing techniques in enterprise LTE femtocells,” IEEE Trans. Veh. Technol., vol. 62, no. 5, pp. 1962–1973, Jun. 2013.

[117]

K. T. Dinh and S. Kukliński, “Joint implementation of several LTE-SON functions,” in Proc. GC Wkshps, Atlanta, GA, USA, Dec. 2013, pp. 953–957.

[118]

Z. Wang, Y. Xu, L. Li, H. Tian, and S. Cui, “Handover control in wireless systems via asynchronous multiuser deep reinforcement learning,” IEEE Internet Things J., vol. 5, no. 6, pp. 4296–4307, Dec. 2018.

[119]

C. Yuet al., “Modeling user activity patterns for next-place prediction,” IEEE Syst. J., vol. 11, no. 2, pp. 1060–1071, Jun. 2017.

[120]

D. Castro-Hernandez and R. Paranjape, “Classification of user trajectories in LTE HetNets using unsupervised shapelets and multiresolution wavelet decomposition,” IEEE Trans. Veh. Technol., vol. 66, no. 9, pp. 7934–7946, Sep. 2017.

[121]

N. Sinclair, D. Harle, I. A. Glover, J. Irvine, and R. C. Atkinson, “An advanced SOM algorithm applied to handover management within LTE,” IEEE Trans. Veh. Technol., vol. 62, no. 5, pp. 1883–1894, Jun. 2013.

[122]

D. Li, B. Zhang, Z. Yao, and C. Li, “A feature scaling based k-nearest neighbor algorithm for indoor positioning system,” in Proc. GLOBECOM, Austin, TX, USA, Dec. 2014, pp. 436–441.

[123]

J. Niu, B. Wang, L. Shu, T. Q. Duong, and Y. Chen, “ZIL: An energy-efficient indoor localization system using ZigBee radio to detect WiFi fingerprints,” IEEE J. Sel. Areas Commun., vol. 33, no. 7, pp. 1431–1442, Jul. 2015.

[124]

Y. Xu, M. Zhou, W. Meng, and L. Ma, “Optimal KNN positioning algorithm via theoretical accuracy criterion in WLAN indoor environment,” in Proc. GLOBECOM, Miami, FL, USA, Dec. 2010, pp. 1–5.

[125]

Z. Wu, K. Fu, E. Jedari, S. R. Shuvra, R. Rashidzadeh, and M. Saif, “A fast and resource efficient method for indoor positioning using received signal strength,” IEEE Trans. Veh. Technol., vol. 65, no. 12, pp. 9747–9758, Dec. 2016.

[126]

T. Van Nguyen, Y. Jeong, H. Shin, and M. Z. Win, “Machine learning for wideband localization,” IEEE J. Sel. Areas Commun., vol. 33, no. 7, pp. 1357–1380, Jul. 2015.

Digital Library

[127]

H. Wymeersch, S. Marano, W. M. Gifford, and M. Z. Win, “A machine learning approach to ranging error mitigation for UWB localization,” IEEE Trans. Wireless Commun., vol. 60, no. 6, pp. 1719–1728, Jun. 2012.

[128]

Z. Qiu, H. Zou, H. Jiang, L. Xie, and Y. Hong, “Consensus-based parallel extreme learning machine for indoor localization,” in Proc. GLOBECOM, Washington, DC, USA, Dec. 2016, pp. 1–6.

[129]

X. Ye, X. Yin, X. Cai, A. P. Yuste, and H. Xu, “Neural-network-assisted UE localization using radio-channel fingerprints in LTE networks,” IEEE Access, vol. 5, pp. 12071–12087, 2017.

[130]

H. Dai, W.-H. Ying, and J. Xu, “Multi-layer neural network for received signal strength-based indoor localisation,” IET Commun., vol. 10, no. 6, pp. 717–723, Apr. 2016.

[131]

Y. Mo, Z. Zhang, W. Meng, and G. Agha, “Space division and dimensional reduction methods for indoor positioning system,” in Proc. ICC, London, U.K., Jun. 2015, pp. 3263–3268.

[132]

J. Yoo, K. H. Johansson, and H. J. Kim, “Indoor localization without a prior map by trajectory learning from crowdsourced measurements,” IEEE Trans. Instrum. Meas., vol. 66, no. 11, pp. 2825–2835, Nov. 2017.

[133]

X. Wang, L. Gao, and S. Mao, “CSI phase fingerprinting for indoor localization with a deep learning approach,” IEEE Internet Things J., vol. 3, no. 6, pp. 1113–1123, Dec. 2016.

[134]

X. Wang, L. Gao, S. Mao, and S. Pandey, “CSI-based fingerprinting for indoor localization: A deep learning approach,” IEEE Trans. Veh. Technol., vol. 66, no. 1, pp. 763–776, Jan. 2017.

[135]

X. Wang, L. Gao, and S. Mao, “BiLoc: Bi-modal deep learning for indoor localization with commodity 5GHz WiFi,” IEEE Access, vol. 5, pp. 4209–4220, 2017.

[136]

J. Xiao, K. Wu, Y. Yi, and L. M. Ni, “FIFS: Fine-grained indoor fingerprinting system,” in Proc. IEEE ICCCN, Munich, Germany, Jul. 2012, pp. 1–7.

[137]

K. Derpanis, M. Lecce, K. Daniilidis, and R. Wildes, “Dynamic scene understanding: The role of orientation features in space and time in scene classification,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Providence, RI, USA, Jun. 2012, pp. 1306–1313.

[138]

K. Soomro, A. R. Zamir, and M. Shah, “UCF101: A dataset of 101 human actions classes from videos in the wild,” arXiv:1212.0402, Dec. 2012. Accessed: Jun. 13, 2019.

[139]

I. Goodfellow, Y. Bengio, A. Courville, and Y. Bengio, Deep Learning. Cambridge, MA, USA: MIT Press, 2016.

Digital Library

[140]

K. Zhou, “Robust cross-layer design with reinforcement learning for IEEE 802.11n link adaptation,” in Proc. IEEE ICC, Kyoto, Japan, Jun. 2011, pp. 1–5.

[141]

I. Grondman, L. Busoniu, G. A. D. Lopes, and R. Babuska, “A survey of actor-critic reinforcement learning: Standard and natural policy gradients,” IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 42, no. 6, pp. 1291–1307, Nov. 2012.

Digital Library

[142]

Y. Sun, M. Peng, and S. Mao, “Deep reinforcement learning-based mode selection and resource management for green fog radio access networks,” IEEE Internet Things J., vol. 6, no. 2, pp. 1960–1971, Apr. 2019.

[143]

M. Feng and S. Mao, “Dealing with limited backhaul capacity in millimeter-wave systems: A deep reinforcement learning approach,” IEEE Commun. Mag., vol. 57, no. 3, pp. 50–55, Mar. 2019.

Digital Library

[144]

K. Xiao, S. Mao, and J. K. Tugnait, “TCP-Drinc: Smart congestion control based on deep reinforcement learning,” IEEE Access, vol. 7, pp. 11892–11904, 2019.

[145]

D. Shiet al., “Deep Q-network based route scheduling for TNC vehicles with passengers’ location differential privacy,” IEEE Internet Things J., submitted for publication. 10.1109/JIOT.2019.2902815.

[146]

Y. Yu, T. Wang, and S. C. Liew, “Deep-reinforcement learning multiple access for heterogeneous wireless networks,” IEEE J. Sel. Areas Commun., vol. 37, no. 6, pp. 1277–1290, Jun. 2019.

[147]

S. N. Sivanandam and S. N. Deepa, “Genetic algorithm optimization problems,” in Introduction to Genetic Algorithms. Heidelberg, Germany: Springer, 2008, pp. 165–209.

[148]

Q. Shi, M. Razaviyayn, Z.-Q. Luo, and C. He, “An iteratively weighted MMSE approach to distributed sum-utility maximization for a MIMO interfering broadcast channel,” IEEE Trans. Signal Process., vol. 59, no. 9, pp. 4331–4340, Sep. 2011.

Digital Library

[149]

G. Alnwaimi, K. Arshad, and K. Moessner, “Dynamic spectrum allocation algorithm with interference management in co-existing networks,” IEEE Commun. Lett., vol. 15, no. 9, pp. 932–934, Sep. 2011.

[150]

F. Kelly, “Charging and rate control for elastic traffic,” Eur. Trans. Telecommun., vol. 8, no. 1, pp. 33–37, 1997.

[151]

M. Abrams, C. R. Standridge, G. Abdulla, S. Williams, and E. A. Fox, “Caching proxies: Limitations and potentials,” in Proc. WWW-4 Boston Conf., 1995, pp. 119–133.

[152]

M. Arlitt, L. Cherkasova, J. Dilley, R. Friedrich, and T. Jin, “Evaluating content management techniques for Web proxy caches,” ACM SIGMETRICS Perform. Eval. Rev., vol. 27, no. 4, pp. 3–11, 2000.

Digital Library

[153]

J. Wang, H. Zhu, L. Dai, N. J. Gomes, and J. Wang, “Low-complexity beam allocation for switched-beam based multiuser massive MIMO systems,” IEEE Trans. Wireless Commun., vol. 15, no. 12, pp. 8236–8248, Dec. 2016.

Digital Library

[154]

Q. Ye, B. Rong, Y. Chen, M. Al-Shalash, C. Caramanis, and J. G. Andrews, “User association for load balancing in heterogeneous cellular networks,” IEEE Trans. Wireless Commun., vol. 12, no. 6, pp. 2706–2716, Jun. 2013.

[155]

K. Son, H. Kim, Y. Yi, and B. Krishnamachari, “Base station operation and user association mechanisms for energy-delay tradeoffs in green cellular networks,” IEEE J. Sel. Areas Commun., vol. 29, no. 8, pp. 1525–1536, Sep. 2011.

[156]

M. Deghel, E. Baştuğ, M. Assaad, and M. Debbah, “On the benefits of edge caching for MIMO interference alignment,” in Proc. SPAWC, Stockholm, Sweden, Jun. 2015, pp. 655–659.

[157]

N. Zhao, F. R. Yu, H. Sun, and M. Li, “Adaptive power allocation schemes for spectrum sharing in interference-alignment-based cognitive radio networks,” IEEE Trans. Veh. Technol., vol. 65, no. 5, pp. 3700–3714, May 2016.

[158]

G. Cao, Z. Lu, T. Lei, X. Wen, L. Wang, and Y. Yang, “Demo: SDN-based seamless handover in WLAN and 3GPP cellular with CAPWAN,” presented at the 13th Int. Symp. Wireless Commun. Syst., Poznań, Poland, 2016, pp. 1–3.

[159]

T. Jansen, I. Balan, J. Turk, I. Moerman, and T. Kurner, “Handover parameter optimization in LTE self-organizing networks,” in Proc. VTC, Ottawa, ON, Canada, Sep. 2010, pp. 1–5.

[160]

M. Youssef and A. Agrawala, “The horus WLAN location determination system,” in Proc. ACM MobiSys, Seattle, WA, USA, Jun. 2005, pp. 205–218.

[161]

X. Wang, L. Gao, and S. Mao, “PhaseFi: Phase fingerprinting for indoor localization with a deep learning approach,” in Proc. IEEE Globecom, San Diego, CA, USA, Dec. 2015, pp. 1–6.

[162]

O. G. Aliu, A. Imran, M. A. Imran, and B. Evans, “A survey of self organisation in future cellular networks,” IEEE Commun. Surveys Tuts., vol. 15, no. 1, pp. 336–361, 1st Quart., 2013.

[163]

Z. Yan, M. Peng, and C. Wang, “Economical energy efficiency: An advanced performance metric for 5G systems,” IEEE Wireless Commun., vol. 24, no. 1, pp. 32–37, Feb. 2017.

Digital Library

[164]

H. Xiang, W. Zhou, M. Daneshmand, and M. Peng, “Network slicing in fog radio access networks: Issues and challenges,” IEEE Commun. Mag., vol. 55, no. 12, pp. 110–116, Dec. 2017.

Digital Library

[165]

Y. Sun, M. Peng, S. Mao, and S. Yan, “Hierarchical radio resource allocation for network slicing in fog radio access networks,” IEEE Trans. Veh. Technol., vol. 68, no. 4, pp. 3866–3881, Apr. 2019.

[166]

R. Liet al., “Deep reinforcement learning for resource management in network slicing,” arXiv:1805.06591v3, Nov. 2018.

[167]

X. Chenet al., “Multi-tenant cross-slice resource orchestration: A deep reinforcement learning approach,” arXiv:1807.09350v2, Jun. 2019.

Cited By

Lei CWang YZhao JLi KJiang HWang Q(2025)A patient specific forecasting model for human albumin based on deep neural networksComputer Methods and Programs in Biomedicine10.1016/j.cmpb.2020.105555196:COnline publication date: 7-Jan-2025
https://dl.acm.org/doi/10.1016/j.cmpb.2020.105555
Zhang SYang ZChen GDong ZHan Z(2024)Convergence Analysis and Energy Minimization for Reconfigurable Intelligent Surface-Assisted Federated LearningIEEE Transactions on Wireless Communications10.1109/TWC.2024.345339823:11_Part_2(17384-17398)Online publication date: 1-Nov-2024
https://dl.acm.org/doi/10.1109/TWC.2024.3453398
Zheng HXiong KSun MWu HZhong ZShen X(2024)Maximizing Age-Energy Efficiency in Wireless Powered Industrial IoE Networks: A Dual-Layer DQN-Based ApproachIEEE Transactions on Wireless Communications10.1109/TWC.2023.328788523:2(1276-1292)Online publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1109/TWC.2023.3287885
Show More Cited By

Index Terms

Application of Machine Learning in Wireless Networks: Key Techniques and Open Issues

Index terms have been assigned to the content through auto-classification.

Recommendations

Understanding the key performance issues with MAC protocols for multi-hop wireless networks: Research Articles
Medium Access Control Protocols for Wireless Ad Hoc Networks

Multi-hop wireless networks arise in the context of ad hoc networks, sensor networks, and mesh networks, and their performance depends critically on the underlying medium access control (MAC) protocol. Inspite of the large body of work devoted to MAC ...
Layered view of QoS issues in IP-based mobile wireless networks: Research Articles
Radio Resource Management for Provisioning IP-Based QoS in Wireless Cellular Networks

With the convergence of wireless communication and IP-based networking technologies, future IP-based wireless networks are expected to support real-time multimedia. IP services over wireless networks (e.g. wireless access to Internet) enhance the ...
Priority Aware Interference Mitigation Techniques for Coexistence of Wireless Technologies in Smart Utility Networks
Q2SWinet '17: Proceedings of the 13th ACM Symposium on QoS and Security for Wireless and Mobile Networks

In recent years, Smart Grid (SG) is envisioned to be the next generation electric power system by replacing traditional power grid due to its advantage of using two way communications. To implement reliable SG wireless communication networks, IEEE ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image IEEE Communications Surveys & Tutorials

IEEE Communications Surveys & Tutorials Volume 21, Issue 4

Fourthquarter 2019

839 pages

ISSN:1553-877X

Issue’s Table of Contents

1553-877X © 2019 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.

Publisher

IEEE Press

Publication History

Published: 01 October 2019

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

65
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 30 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Lei CWang YZhao JLi KJiang HWang Q(2025)A patient specific forecasting model for human albumin based on deep neural networksComputer Methods and Programs in Biomedicine10.1016/j.cmpb.2020.105555196:COnline publication date: 7-Jan-2025
https://dl.acm.org/doi/10.1016/j.cmpb.2020.105555
Zhang SYang ZChen GDong ZHan Z(2024)Convergence Analysis and Energy Minimization for Reconfigurable Intelligent Surface-Assisted Federated LearningIEEE Transactions on Wireless Communications10.1109/TWC.2024.345339823:11_Part_2(17384-17398)Online publication date: 1-Nov-2024
https://dl.acm.org/doi/10.1109/TWC.2024.3453398
Zheng HXiong KSun MWu HZhong ZShen X(2024)Maximizing Age-Energy Efficiency in Wireless Powered Industrial IoE Networks: A Dual-Layer DQN-Based ApproachIEEE Transactions on Wireless Communications10.1109/TWC.2023.328788523:2(1276-1292)Online publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1109/TWC.2023.3287885
He YYu GCai YLuo H(2024)Integrated Sensing, Computation, and Communication: System Framework and Performance OptimizationIEEE Transactions on Wireless Communications10.1109/TWC.2023.328586923:2(1114-1128)Online publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1109/TWC.2023.3285869
Asheralieva ANiyato DMiyanaga Y(2024)Efficient Dynamic Distributed Resource Slicing in 6G Multi-Access Edge Computing Networks With Online ADMM and Message Passing Graph Neural NetworksIEEE Transactions on Mobile Computing10.1109/TMC.2023.326251423:4(2614-2638)Online publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1109/TMC.2023.3262514
Zayat AHasabelnaby MObeed MChaaban A(2024)Transformer Masked Autoencoders for Next-Generation Wireless Communications: Architecture and OpportunitiesIEEE Communications Magazine10.1109/MCOM.002.230025762:7(88-94)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1109/MCOM.002.2300257
Ribeiro MFilomeno MCamponogara ÂOliveira TMoreira TGalli SPoor H(2024)Seamless Connectivity: The Power of Integrating Power Line and Wireless CommunicationsIEEE Communications Surveys & Tutorials10.1109/COMST.2023.332732126:1(1-40)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/COMST.2023.3327321
Bi MYan CLin RHong YLi J(2024)Client scheduling and bandwidth slicing for multiple federated learning tasks over multiple passive optical networksComputer Networks: The International Journal of Computer and Telecommunications Networking10.1016/j.comnet.2024.110309243:COnline publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1016/j.comnet.2024.110309
Yadav SRishi R(2024)Joint mode selection and resource allocation for cellular V2X communication using distributed deep reinforcement learning under 5G and beyond networksComputer Communications10.1016/j.comcom.2024.04.015221:C(54-65)Online publication date: 1-May-2024
https://dl.acm.org/doi/10.1016/j.comcom.2024.04.015
Mezher ADueñas Santos CAstudillo Leon JCárdenas-Barrera JMeng JCastillo-Guerra E(2024)Exploring model transferability in ML-integrated RPL routing for smart grid communicationAd Hoc Networks10.1016/j.adhoc.2024.103626164:COnline publication date: 21-Nov-2024
https://dl.acm.org/doi/10.1016/j.adhoc.2024.103626
Show More Cited By

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents