TensorRT Edge-LLM

https://github.com/nvidia/tensorrt-edge-llm

A high-performance C++ inference runtime for deploying Large Language Models and Vision-Language...

Tokens:87,237
Snippets:981
Trust Score:8.6
License:Apache-2.0
Update:4 weeks ago
Tokens:
Raw