Unbounded dynamic programming via the Q-transform

Qingyin Ma*, John Stachurski, Alexis Akira Toda

*Corresponding author for this work

    Research output: Contribution to journalArticlepeer-review

    4 Citations (Scopus)

    Abstract

    We propose a new approach to solving dynamic decision problems with unbounded rewards based on the transformations used in Q-learning. In our case, however, the objective of the transform is not learning. Rather, it is to convert an unbounded dynamic program into a bounded one. The approach is general enough to handle problems for which existing methods struggle, and yet simple relative to other techniques and accessible for applied work. We show by example that a variety of common decision problems satisfy our conditions.

    Original languageEnglish
    Article number102652
    JournalJournal of Mathematical Economics
    Volume100
    DOIs
    Publication statusPublished - May 2022

    Fingerprint

    Dive into the research topics of 'Unbounded dynamic programming via the Q-transform'. Together they form a unique fingerprint.

    Cite this