### Install Flash Attention for faster inference

Source: https://github.com/ziems/arbor/blob/main/README.md

Optionally installs the flash-attn library to accelerate inference. This installation can be time-consuming on some setups due to build requirements.

```bash
pip install flash-attn --no-build-isolation
```

--------------------------------

### Start Arbor CLI Server

Source: https://github.com/ziems/arbor/blob/main/README.md

Initiates the Arbor server through the command-line interface. On the first run, it prompts for GPU configuration, which is then saved to ~/.arbor/config.yaml.

```bash
python -m arbor.cli serve
```

--------------------------------

### Install Arbor AI via pip

Source: https://github.com/ziems/arbor/blob/main/README.md

Installs the Arbor AI framework using pip, the Python package installer. This command ensures you have the latest stable version of Arbor AI.

```bash
pip install -U arbor-ai
```

--------------------------------

### Resolve NCCL Errors with Environment Variables

Source: https://github.com/ziems/arbor/blob/main/README.md

Provides environment variables to mitigate NCCL-related crashes, particularly common with newer GPU setups. Setting these variables can help stabilize Arbor's operation.

```bash
export NCCL_P2P_DISABLE=1
export NCCL_IB_DISABLE=1
```

--------------------------------

### Cite Arbor in Research

Source: https://github.com/ziems/arbor/blob/main/README.md

Provides the BibTeX entry for citing the Arbor framework in academic research. This citation acknowledges the use of the Arbor code.

```bibtex
@misc{ziems2025arbor,
  title={Arbor: Open Source Language Model Post Training},
  author={Ziems, Noah and Agrawal, Lakshya A and Soylu, Dilara and Lai, Liheng and Miller, Isaac and Qian, Chen and Jiang, Meng and Khattab, Omar},
  year={2025}
}
```

=== COMPLETE CONTENT === This response contains all available snippets from this library. No additional content exists. Do not make further requests.