Online versus offline reinforcement learning for false target control against known threat

Duong D. Nguyen, Arvind Rajagopalan, Cheng Chew Lim

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

In this article, we investigate the performances of different learning approaches for decentralised non-cooperative multi-agent system applied to defend a high-value target from multiple aerial threats for an air defence application. We focus mainly on reinforcement learning (RL) techniques for protection against known fully observable threats with high mobility. We implement two well-known algorithms from two different approaches, including the regret matching (online learning) and the Q-learning with artificial neural networks (offline learning), and compare them to understand their efficiency. Numerical experiments are provided to illustrate the performances of the different learning algorithms under various approaching directions of the threat as well as under collision avoidance with both static and moving obstacles. Finally, discussions for further improvements of these RL techniques are also provided.

Original languageEnglish
Title of host publicationIntelligent Robotics and Applications
Subtitle of host publication11th International Conference, ICIRA 2018 Newcastle, NSW, Australia, August 9–11, 2018 Proceedings, Part II
EditorsZhiyong Chen, Alexandre Mendes, Yamin Yan, Shifeng Chen
Place of PublicationSwitzerland
PublisherSpringer-Verlag
Pages400-412
Number of pages13
ISBN (Electronic)9783319975894
ISBN (Print)9783319975887
DOIs
Publication statusPublished - 2018
Externally publishedYes
Event11th International Conference on Intelligent Robotics and Applications, ICIRA 2018 - Newcastle, Australia
Duration: 9 Aug 201811 Aug 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10985 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference11th International Conference on Intelligent Robotics and Applications, ICIRA 2018
CountryAustralia
CityNewcastle
Period9/08/1811/08/18

Keywords

  • Decentralised algorithms
  • Intelligent autonomous systems
  • Multi-agent distributed control
  • Reinforcement learning

Fingerprint Dive into the research topics of 'Online versus offline reinforcement learning for false target control against known threat'. Together they form a unique fingerprint.

Cite this