TinyTorch

https://mlsysbook.org/tinytorch

Admin

TinyTorch is an educational ML framework for building your own machine learning system from scratch,...

Tokens:519

Snippets:8

Trust Score:6.9

Update:5 months ago

Show doc for...

Tokens:

Raw

### Traditional ML Framework Usage (PyTorch)

Source: https://mlsysbook.org/tinytorch

Illustrates the typical usage of a pre-built ML library like PyTorch. This approach can be limiting when debugging complex issues.

```python
import torch
model = torch.nn.Linear(784, 10)
output = model(input)
# When this breaks, you're stuck
```

--------------------------------

### Building a Linear Layer in TinyTorch

Source: https://mlsysbook.org/tinytorch

Demonstrates how to define and use a custom Linear layer within the TinyTorch framework. This approach allows for deeper understanding and debugging.

```python
# BUILD it yourself
class Linear:
    def forward(self, x):
        return x @ self.weight + self.bias
```

```python
# USE it on real data
loss.backward()  # YOUR autograd
```

Tokens:

Raw