Markov Decision Process (MDP) Toolbox for Python

https://pymdptoolbox.readthedocs.io

Admin

The Markov Decision Process (MDP) Toolbox for Python provides classes and functions for solving...

Tokens:709

Snippets:11

Trust Score:9.6

Update:1 month ago

Show doc for...

Tokens:

Raw

### Manual installation commands

Source: https://pymdptoolbox.readthedocs.io

Commands for extracting, navigating, and installing the package manually.

```bash
tar -xzvf pymdptoolbox-<VERSION>.tar.gz
```

```bash
unzip pymdptoolbox-<VERSION>
```

```bash
cd pymdptoolbox
```

```bash
python setup.py install
```

```bash
python setup.py install --user
```

--------------------------------

### Install dependencies on Debian/Ubuntu

Source: https://pymdptoolbox.readthedocs.io

Commands to install required system dependencies for Python 2 or Python 3 environments.

```bash
sudo apt-get install python-numpy python-scipy python-cvxopt
```

```bash
sudo apt-get install python3-numpy python3-scipy liblapack-dev libatlas-base-dev libgsl0-dev fftw-dev libglpk-dev libdsdp-dev
```

--------------------------------

### Solve MDP with Value Iteration

Source: https://pymdptoolbox.readthedocs.io

Example demonstrating how to import the module, generate a forest problem, and solve it using value iteration.

```python
import mdptoolbox.example
P, R = mdptoolbox.example.forest()
vi = mdptoolbox.mdp.ValueIteration(P, R, 0.9)
vi.run()
vi.policy # result is (0, 0, 0)
```

--------------------------------

### Install via pip

Source: https://pymdptoolbox.readthedocs.io

Commands to install the package using pip, including optional support for linear programming.

```bash
pip install pymdptoolbox
```

```bash
pip install "pymdptoolbox[LP]"
```

```bash
pip install --user pymdptoolbox
```

--------------------------------

### Clone repository

Source: https://pymdptoolbox.readthedocs.io

Command to clone the source code from GitHub.

```bash
git clone https://github.com/sawcordwell/pymdptoolbox.git
```

--------------------------------

### Access documentation in IPython

Source: https://pymdptoolbox.readthedocs.io

Commands to view docstrings for the module and its components using the question mark operator.

```python
import mdptoolbox
mdptoolbox?<ENTER>
mdptoolbox.mdp?<ENTER>
mdptoolbox.mdp.ValueIteration?<ENTER>
```

Tokens:

Raw