### Manual installation commands Source: https://pymdptoolbox.readthedocs.io Commands for extracting, navigating, and installing the package manually. ```bash tar -xzvf pymdptoolbox-.tar.gz ``` ```bash unzip pymdptoolbox- ``` ```bash cd pymdptoolbox ``` ```bash python setup.py install ``` ```bash python setup.py install --user ``` -------------------------------- ### Install dependencies on Debian/Ubuntu Source: https://pymdptoolbox.readthedocs.io Commands to install required system dependencies for Python 2 or Python 3 environments. ```bash sudo apt-get install python-numpy python-scipy python-cvxopt ``` ```bash sudo apt-get install python3-numpy python3-scipy liblapack-dev libatlas-base-dev libgsl0-dev fftw-dev libglpk-dev libdsdp-dev ``` -------------------------------- ### Solve MDP with Value Iteration Source: https://pymdptoolbox.readthedocs.io Example demonstrating how to import the module, generate a forest problem, and solve it using value iteration. ```python import mdptoolbox.example P, R = mdptoolbox.example.forest() vi = mdptoolbox.mdp.ValueIteration(P, R, 0.9) vi.run() vi.policy # result is (0, 0, 0) ``` -------------------------------- ### Install via pip Source: https://pymdptoolbox.readthedocs.io Commands to install the package using pip, including optional support for linear programming. ```bash pip install pymdptoolbox ``` ```bash pip install "pymdptoolbox[LP]" ``` ```bash pip install --user pymdptoolbox ``` -------------------------------- ### Clone repository Source: https://pymdptoolbox.readthedocs.io Command to clone the source code from GitHub. ```bash git clone https://github.com/sawcordwell/pymdptoolbox.git ``` -------------------------------- ### Access documentation in IPython Source: https://pymdptoolbox.readthedocs.io Commands to view docstrings for the module and its components using the question mark operator. ```python import mdptoolbox mdptoolbox? mdptoolbox.mdp? mdptoolbox.mdp.ValueIteration? ``` === COMPLETE CONTENT === This response contains all available snippets from this library. No additional content exists. Do not make further requests.