LLMServingSim

https://github.com/casys-kaist/llmservingsim

LLMServingSim is a hardware/software co-simulation infrastructure for large language model inference...

Tokens:9,949
Snippets:56
Trust Score:8
License:MIT
Update:6 months ago
Tokens:
Raw