This library provides several ways of describing a finite Markov Decision Process (MDP) model (see FiniteMDP::Model) and some reasonably efficient implementations of policy iteration and value iteration to solve it (see FiniteMDP::Solver).
Required Ruby Version
>= 0
Authors
John Lees-Miller