JetStream

https://github.com/ai-hypercomputer/jetstream

JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting...

Tokens:12,135
Snippets:138
Trust Score:7.8
License:Apache-2.0
Update:5 days ago
Tokens:
Raw