finite_mdp 0.1.1
This library provides several ways of describing a finite Markov Decision Process (MDP) model (see FiniteMDP::Model) and some reasonably efficient implementations of policy iteration and value iteration to solve it (see FiniteMDP::Solver).