Llama Cpp Provider

https://github.com/lgrammel/llama-cpp-provider

A llama.cpp provider for the Vercel AI SDK that enables local LLM inference in Node.js via native...

Tokens:39,182
Snippets:434
Trust Score:8.8
License:MIT
Update:1 month ago
Tokens:
Raw