NeuronX Distributed Inference

https://github.com/aws-neuron/neuronx-distributed-inference

This package provides a model hub and inference demo for running models on Neuronx Distributed...

Tokens:4,051
Snippets:20
Trust Score:8.6
License:Apache-2.0
Update:1 year ago
Tokens:
Raw