Approximate solution of the HJB inequality related to the infinite horizon optimal control problem with discounting

Vladimir Gaitsgory, Serguei Rossomakhine, N Thatcher

    Research output: Contribution to journalArticlepeer-review

    18 Citations (Scopus)

    Abstract

    This paper is focusing on finding smooth approximate solutions of the HJB inequality that corresponds to the infinite horizon optimal control problem with discounting. We establish that such approximate solutions exist (under a simple controllability type condition) and that they can be used for construction of near optimal controls. We also show that these approximate solutions of the HJB inequality can be found by solving certain semi-infinite linear programming problems and we propose an algorithm for the solution of the latter. We discuss a numerical solution of a non-trivial optimal control problem obtained with the help of a software implementation of the new algorithm.

    Original languageEnglish
    Pages (from-to)65-92
    Number of pages28
    JournalDynamics of Continuous, Discrete and Impulsive Systems. Series B: Applications and Algorithms
    Volume19
    Issue number1-2
    Publication statusPublished - 2012

    Keywords

    • Discounted occupational measures
    • Duality
    • HJB inequality
    • Linear programming approach to optimal control problems
    • Numerical solution of optimal control problems
    • Semi-infinite linear programming

    Fingerprint

    Dive into the research topics of 'Approximate solution of the HJB inequality related to the infinite horizon optimal control problem with discounting'. Together they form a unique fingerprint.

    Cite this