ONNX Runtime GenAI

https://github.com/microsoft/onnxruntime-genai

ONNX Runtime GenAI is an API that provides an easy, flexible, and performant way to run generative...

Tokens:43,007
Snippets:549
Trust Score:9.5
License:MIT
Update:1 week ago
Tokens:
Raw