Solving a spatial puzzle using answer set programming integrated with Markov decision process

Thiago Freitas Dos Santos, Paulo Santos, Leonardo Ferreira, Reinaldo Bianchi, Pedro Cabalar

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Spatial puzzles are interesting domains to investigate problem solving, since the reasoning processes involved in reasoning about spatial knowledge is one of the essential items for an agent to interact in the human environment. With this in mind, the goal of this work is to investigate the knowledge representation and reasoning process related to the solution of a spatial puzzle, the Fisherman's Folly, composed of flexible string, rigid objects and holes. To achieve this goal, the present paper uses heuristics (obtained after solving a relaxed version of the puzzle) to accelerate the learning process, while applying a method that combines Answer Set programming (ASP) with Reinforcement learning (RL), the oASP(MDP) algorithm, to find a solution to the puzzle. ASP is the logic language chosen to build the set of states and actions of a Markov Decision Process (MDP) representing the domain, where RL is used to learn the optimal policy of the problem.

Original languageEnglish
Title of host publicationProceedings - 2018 Brazilian Conference on Intelligent Systems, BRACIS 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages528-533
Number of pages6
ISBN (Electronic)9781538680230
DOIs
Publication statusPublished - 17 Dec 2018
Externally publishedYes
Event2018 Brazilian Conference on Intelligent Systems, BRACIS 2018 - Sao Paulo, Brazil
Duration: 22 Oct 201825 Oct 2018

Publication series

NameProceedings - 2018 Brazilian Conference on Intelligent Systems, BRACIS 2018

Conference

Conference2018 Brazilian Conference on Intelligent Systems, BRACIS 2018
CountryBrazil
CitySao Paulo
Period22/10/1825/10/18

Keywords

  • answer set programming
  • heuristic
  • oASP(MDP)
  • reinforcement learning
  • spatial puzzle

Fingerprint Dive into the research topics of 'Solving a spatial puzzle using answer set programming integrated with Markov decision process'. Together they form a unique fingerprint.

Cite this