Model-free based automated trajectory optimization for uavs toward data transmission

Jingjing Cui, Zhiguo DIng, Yansha Deng, Arumugam Nallanathan

Research output: Chapter in Book/Report/Conference proceedingConference paperpeer-review

6 Citations (Scopus)

Abstract

In this paper, we consider an unmanned aerial vehicle (UAV) enabled wireless network with a set of ground devices that are randomly distributed in an area and each having a certain amount of data for transmission. The UAV flies over this region from a starting point to a destination. During its flight, the UAV wants to communicate to the ground devices for maximizing the cumulative collected data by optimizing the trajectory of the UAV subject to its flight time constraint. Due to uncertainty in the locations of the ground devices and the communication dynamics, an accurate system model is difficult to acquire and maintain. With the help of stochastic modelling, we present a reinforcement learning based automated trajectory optimization algorithm. By dividing the considered region into small grids with finite state space and action space, we apply the Q-learning based automated trajectory optimization approach for maximizing the cumulative collected data during its flight time. Simulation results demonstrate that the reinforcement learning approach can find an optimal strategy under the flight time constraint.

Original languageEnglish
Title of host publication2019 IEEE Global Communications Conference, GLOBECOM 2019 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728109626
DOIs
Publication statusPublished - Dec 2019
Event2019 IEEE Global Communications Conference, GLOBECOM 2019 - Waikoloa, United States
Duration: 9 Dec 201913 Dec 2019

Publication series

Name2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM)
ISSN (Print)2334-0983

Conference

Conference2019 IEEE Global Communications Conference, GLOBECOM 2019
Country/TerritoryUnited States
CityWaikoloa
Period9/12/201913/12/2019

Fingerprint

Dive into the research topics of 'Model-free based automated trajectory optimization for uavs toward data transmission'. Together they form a unique fingerprint.

Cite this