Tiktoken is a BPE tokeniser for OpenAI's models, offering WASM bindings for NodeJS and JS runtimes,...

Tokens:3,827
Snippets:19
Trust Score:9.5
License:MIT
Update:2 weeks ago
Tokens:
Raw