wordchipper

https://github.com/crutcher/wordchipper

wordchipper is a high-performance Rust byte-pair encoder tokenizer for OpenAI GPT-2 models with...

Tokens:48,520
Snippets:474
Trust Score:8.4
Update:2 months ago
Tokens:
Raw