TensorRT LLM

https://github.com/nvidia/tensorrt-llm

TensorRT-LLM is a TensorRT toolbox for optimized large language model inference, providing high...

Tokens:873,858
Snippets:9,567
Trust Score:-
License:Apache-2.0
Update:6 days ago
Tokens:
Raw