LitGPT

https://lightning.ai/docs/litgpt/

Admin

LitGPT is a minimal, hackable collection of high-performance LLMs for pretraining, finetuning, and...

Tokens:510

Snippets:8

Trust Score:9.8

Update:6 months ago

Show doc for...

Tokens:

Raw

### Install LitGPT

Source: https://lightning.ai/docs/litgpt/home

Install LitGPT with all optional dependencies for full functionality. This command installs the core library and all extra packages.

```bash
pip install litgpt[all]
```

--------------------------------

### LitGPT Command-Line Usage

Source: https://lightning.ai/docs/litgpt/home

Demonstrates the core LitGPT command-line workflow: listing available models, downloading a pretrained model, finetuning it with custom data, and then chatting with the finetuned model. Ensure the dataset path is correct and adjust validation split as needed.

```bash
litgpt download list
```

```bash
litgpt download microsoft/phi-2
```

```bash
curl -L https://huggingface.co/datasets/ksaw008/finance_alpaca/resolve/main/finance_alpaca.json -o my_custom_dataset.json
```

```bash
litgpt finetune microsoft/phi-2 \
  --data JSON \
  --data.json_path my_custom_dataset.json \
  --data.val_split_fraction 0.1 \
  --out_dir out/custom-model
```

```bash
litgpt chat out/custom-model/final
```

Tokens:

Raw