Dynamic Aerial Base Station Placement for Minimum-Delay Communications

Tong Bai; Cunhua Pan; Jingjing Wang; Yansha Deng; Maged Elkashlan; Arumugam Nallanathan; Lajos Hanzo

doi:10.1109/JIOT.2020.3013752

Dynamic Aerial Base Station Placement for Minimum-Delay Communications

Tong Bai, Cunhua Pan, Jingjing Wang, Yansha Deng, Maged Elkashlan, Arumugam Nallanathan, Lajos Hanzo^*

^*Corresponding author for this work

Research output: Contribution to journal › Article › peer-review

16 Citations (Scopus)

Abstract

Queuing delay is of essential importance in the Internet-of-Things scenarios where the buffer sizes of devices are limited. The existing cross-layer research contributions aiming at minimizing the queuing delay usually rely on either transmit power control or dynamic spectrum allocation. Bearing in mind that the transmission throughput is dependent on the distance between the transmitter and the receiver, in this context we exploit the agility of the unmanned-aerial-vehicle (UAV)-mounted base stations (BSs) for proactively adjusting the aerial BS (ABS)'s placement in accordance with wireless teletraffic dynamics. Specifically, we formulate a minimum-delay ABS placement problem for UAV-enabled networks, subject to realistic constraints on the ABS's battery life and velocity. Its solutions are technically realized under three different assumptions in regard to the wireless teletraffic dynamics. The backward induction technique is invoked for both the scenario where the full knowledge of the wireless teletraffic dynamics is available, and for the case where only their statistical knowledge is available. In contrast, a reinforcement learning aided approach is invoked for the case when neither the exact number of arriving packets nor that of their statistical knowledge is available. The numerical results demonstrate that our proposed algorithms are capable of improving the system's performance compared to the benchmark schemes in terms of both the average delay and of the buffer overflow probability.

Original language	English
Article number	9154460
Pages (from-to)	1623-1635
Number of pages	13
Journal	IEEE Internet of Things Journal
Volume	8
Issue number	3
DOIs	https://doi.org/10.1109/JIOT.2020.3013752
Publication status	Published - 1 Feb 2021

Keywords

Delay optimal
dynamic programming
Markov decision process (MDP)
reinforcement learning
unmanned aerial vehicle (UAV)

Access to Document

10.1109/JIOT.2020.3013752

Cite this

@article{02d72b79fd8440ec872d502cb9bad54e,

title = "Dynamic Aerial Base Station Placement for Minimum-Delay Communications",

abstract = "Queuing delay is of essential importance in the Internet-of-Things scenarios where the buffer sizes of devices are limited. The existing cross-layer research contributions aiming at minimizing the queuing delay usually rely on either transmit power control or dynamic spectrum allocation. Bearing in mind that the transmission throughput is dependent on the distance between the transmitter and the receiver, in this context we exploit the agility of the unmanned-aerial-vehicle (UAV)-mounted base stations (BSs) for proactively adjusting the aerial BS (ABS)'s placement in accordance with wireless teletraffic dynamics. Specifically, we formulate a minimum-delay ABS placement problem for UAV-enabled networks, subject to realistic constraints on the ABS's battery life and velocity. Its solutions are technically realized under three different assumptions in regard to the wireless teletraffic dynamics. The backward induction technique is invoked for both the scenario where the full knowledge of the wireless teletraffic dynamics is available, and for the case where only their statistical knowledge is available. In contrast, a reinforcement learning aided approach is invoked for the case when neither the exact number of arriving packets nor that of their statistical knowledge is available. The numerical results demonstrate that our proposed algorithms are capable of improving the system's performance compared to the benchmark schemes in terms of both the average delay and of the buffer overflow probability. ",

keywords = "Delay optimal, dynamic programming, Markov decision process (MDP), reinforcement learning, unmanned aerial vehicle (UAV)",

author = "Tong Bai and Cunhua Pan and Jingjing Wang and Yansha Deng and Maged Elkashlan and Arumugam Nallanathan and Lajos Hanzo",

note = "Funding Information: Manuscript received March 31, 2020; revised June 30, 2020; accepted July 29, 2020. Date of publication August 3, 2020; date of current version January 22, 2021. This work was supported in part by the Engineering and Physical Science Research Council under Grant EP/N004558/1, Grant EP/N023862/1, and Grant EP/N029720/2; in part by the European Research Council{\textquoteright}s Advanced Fellow Grant through the QuantCom Project; in part by the Royal Society{\textquoteright}s Global Research Challenges Grant; and in part by the Shuimu Tsinghua Scholar Program. (Corresponding author: Lajos Hanzo.) Tong Bai is with the School of Cyber Science and Technology, Beihang University, Beijing 100191, China, and also with the School of Electronic Engineering and Computer Science, Queen Mary University of London, London E1 4NS, U.K. (e-mail: [email protected]). Publisher Copyright: {\textcopyright} 2014 IEEE. Copyright: Copyright 2021 Elsevier B.V., All rights reserved.",

year = "2021",

month = feb,

day = "1",

doi = "10.1109/JIOT.2020.3013752",

language = "English",

volume = "8",

pages = "1623--1635",

journal = "IEEE Internet of Things Journal",

issn = "2327-4662",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

number = "3",

}

TY - JOUR

T1 - Dynamic Aerial Base Station Placement for Minimum-Delay Communications

AU - Bai, Tong

AU - Pan, Cunhua

AU - Wang, Jingjing

AU - Deng, Yansha

AU - Elkashlan, Maged

AU - Nallanathan, Arumugam

AU - Hanzo, Lajos

N1 - Funding Information: Manuscript received March 31, 2020; revised June 30, 2020; accepted July 29, 2020. Date of publication August 3, 2020; date of current version January 22, 2021. This work was supported in part by the Engineering and Physical Science Research Council under Grant EP/N004558/1, Grant EP/N023862/1, and Grant EP/N029720/2; in part by the European Research Council’s Advanced Fellow Grant through the QuantCom Project; in part by the Royal Society’s Global Research Challenges Grant; and in part by the Shuimu Tsinghua Scholar Program. (Corresponding author: Lajos Hanzo.) Tong Bai is with the School of Cyber Science and Technology, Beihang University, Beijing 100191, China, and also with the School of Electronic Engineering and Computer Science, Queen Mary University of London, London E1 4NS, U.K. (e-mail: [email protected]). Publisher Copyright: © 2014 IEEE. Copyright: Copyright 2021 Elsevier B.V., All rights reserved.

PY - 2021/2/1

Y1 - 2021/2/1

N2 - Queuing delay is of essential importance in the Internet-of-Things scenarios where the buffer sizes of devices are limited. The existing cross-layer research contributions aiming at minimizing the queuing delay usually rely on either transmit power control or dynamic spectrum allocation. Bearing in mind that the transmission throughput is dependent on the distance between the transmitter and the receiver, in this context we exploit the agility of the unmanned-aerial-vehicle (UAV)-mounted base stations (BSs) for proactively adjusting the aerial BS (ABS)'s placement in accordance with wireless teletraffic dynamics. Specifically, we formulate a minimum-delay ABS placement problem for UAV-enabled networks, subject to realistic constraints on the ABS's battery life and velocity. Its solutions are technically realized under three different assumptions in regard to the wireless teletraffic dynamics. The backward induction technique is invoked for both the scenario where the full knowledge of the wireless teletraffic dynamics is available, and for the case where only their statistical knowledge is available. In contrast, a reinforcement learning aided approach is invoked for the case when neither the exact number of arriving packets nor that of their statistical knowledge is available. The numerical results demonstrate that our proposed algorithms are capable of improving the system's performance compared to the benchmark schemes in terms of both the average delay and of the buffer overflow probability.

AB - Queuing delay is of essential importance in the Internet-of-Things scenarios where the buffer sizes of devices are limited. The existing cross-layer research contributions aiming at minimizing the queuing delay usually rely on either transmit power control or dynamic spectrum allocation. Bearing in mind that the transmission throughput is dependent on the distance between the transmitter and the receiver, in this context we exploit the agility of the unmanned-aerial-vehicle (UAV)-mounted base stations (BSs) for proactively adjusting the aerial BS (ABS)'s placement in accordance with wireless teletraffic dynamics. Specifically, we formulate a minimum-delay ABS placement problem for UAV-enabled networks, subject to realistic constraints on the ABS's battery life and velocity. Its solutions are technically realized under three different assumptions in regard to the wireless teletraffic dynamics. The backward induction technique is invoked for both the scenario where the full knowledge of the wireless teletraffic dynamics is available, and for the case where only their statistical knowledge is available. In contrast, a reinforcement learning aided approach is invoked for the case when neither the exact number of arriving packets nor that of their statistical knowledge is available. The numerical results demonstrate that our proposed algorithms are capable of improving the system's performance compared to the benchmark schemes in terms of both the average delay and of the buffer overflow probability.

KW - Delay optimal

KW - dynamic programming

KW - Markov decision process (MDP)

KW - reinforcement learning

KW - unmanned aerial vehicle (UAV)

UR - http://www.scopus.com/inward/record.url?scp=85100241738&partnerID=8YFLogxK

U2 - 10.1109/JIOT.2020.3013752

DO - 10.1109/JIOT.2020.3013752

M3 - Article

AN - SCOPUS:85100241738

SN - 2327-4662

VL - 8

SP - 1623

EP - 1635

JO - IEEE Internet of Things Journal

JF - IEEE Internet of Things Journal

IS - 3

M1 - 9154460

ER -

Dynamic Aerial Base Station Placement for Minimum-Delay Communications

Abstract

Keywords

Access to Document

Other files and links

Fingerprint

Cite this