Green Deep Reinforcement Learning for Radio Resource Management: Architecture, Algorithm Compression, and Challenges

Zhiyong Du, Yansha Deng, Weisi Guo, Arumugam Nallanathan, Qihui Wu

Research output: Contribution to journalArticlepeer-review

16 Citations (Scopus)

Abstract

Artificial intelligence (AI) heralds a step-change in wireless networks but may also cause irreversible environmental damage due to its high energy consumption. Here, we address this challenge in the context of 5G and beyond, where there is a complexity explosion in radio resource management (RRM). For high-dimensional RRM problems in a dynamic environment, deep reinforcement learning (DRL) provides a powerful tool for scalable optimization, but it consumes a large amount of energy over time and risks compromising progress made in green radio research. This article reviews and analyzes how to achieve green DRL for RRM via both architecture and algorithm innovations. Architecturally, a cloudbased training and distributed decision-making DRL scheme is proposed, where RRM entities can make lightweight, deep, local decisions while being assisted by on-cloud training and updating. At the algorithm level, compression approaches are introduced for both deep neural networks (DNNs) and the underlying Markov decision processes (MDPs), enabling accurate lowdimensional representations of challenges. To scale learning across geographic areas, a spatial transfer learning scheme is proposed to further promote the learning efficiency of distributed DRL entities by exploiting the traffic demand correlations. Together, our proposed architecture and algorithms provide a vision for green and on-demand DRL capability.

Original languageEnglish
Article number9205233
Pages (from-to)29-39
Number of pages11
JournalIEEE Vehicular Technology Magazine
Volume16
Issue number1
DOIs
Publication statusPublished - Mar 2021

Keywords

  • Training
  • Optimization
  • Green products
  • Energy consumption
  • Vehicle dynamics
  • Machine learning
  • Wireless networks

Fingerprint

Dive into the research topics of 'Green Deep Reinforcement Learning for Radio Resource Management: Architecture, Algorithm Compression, and Challenges'. Together they form a unique fingerprint.

Cite this