Python script for dividing Embedding layer of LLM.
The solution was tested on meta-llama/Llama-3.2-1B.
Installation from PyPI:
pip install embdiv- Python 3.9+
- cachetools>=5.5.0,
- torch>=2.5.1,
- transformers>=4.45.2,
1kkiRen/Embeddings-Division
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|