oMLX

https://github.com/jundot/omlx

oMLX is an optimized LLM inference server for Apple Silicon Macs featuring continuous batching and...

Tokens:50,628
Snippets:394
Trust Score:8.8
License:Apache-2.0
Update:3 weeks ago
Tokens:
Raw