NobleBlocks

Research indexPreprint

Beyond dynamic programming

Muraleedharan

arXiv (Cornell University)26 Jun 2023Open access

NobleIDark:/48914/w1/20260525/07376C97DOI10.48550/arxiv.2306.15029

Abstract

In this paper, we present Score-life programming, a novel theoretical approach for solving reinforcement learning problems. In contrast with classical dynamic programming-based methods, our method can search over non-stationary policy functions, and can directly compute optimal infinite horizon action sequences from a given state. The central idea in our method is the construction of a mapping between infinite horizon action sequences and real numbers in a bounded interval. This construction enables us to formulate an optimization problem for directly computing optimal infinite horizon action sequences, without requiring a policy function. We demonstrate the effectiveness of our approach by applying it to nonlinear optimal control problems. Overall, our contributions provide a novel theoretical framework for formulating and solving reinforcement learning problems.

Discussion

Topics

More

Suggest a correction or report