GitHub - Khsaadi/built_basic_transformer: This repo contains a basic transformer implementation

Khsaadi / built_basic_transformer Public

Notifications You must be signed in to change notification settings
Fork 0
Star 1

This repo contains a basic transformer implementation

1 star 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
README.md		README.md
build_basic_transformer_from_scratch.ipynb		build_basic_transformer_from_scratch.ipynb

Repository files navigation

This repository contains:

A notebook of a basic transformer architecture built from scratch.

About

This repo contains a basic transformer implementation

query key-value transformers attention-mechanism encoder-decoder positional-encoding

Report repository

Releases

No releases published

Packages

No packages published

Languages

Jupyter Notebook 100.0%