Skip to content

Commit 837a495

Browse files
authored
Update README.md
1 parent a7beb16 commit 837a495

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

README.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,11 @@
11
# [TinyModel](https://github.com/noanabeshima/tiny_model)
2+
23
TinyModel is a 4 layer, 44M parameter model trained on [TinyStories V2](https://arxiv.org/abs/2305.07759) for mechanistic interpretability. It uses ReLU activations and no layernorms. It comes with trained SAEs and transcoders.
34

45
It can be installed with `pip install tinymodel` for Python 3.11 and higher.
56

7+
This library is in an alpha state, it probably has some bugs. Please let me know if you find any or you're having any trouble with the library, I can be emailed at my full name @ gmail.com or messaged on twitter. You can also add GitHub issues.
8+
69

710
```
811
from tiny_model import TinyModel, tokenizer

0 commit comments

Comments
 (0)