Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
959 commits
Select commit Hold shift + click to select a range
7a59e05
updating notebook
GaelGil Sep 5, 2025
e56d6c5
adding headers
GaelGil Sep 8, 2025
6ca7d5a
updating the notebook
GaelGil Sep 8, 2025
15de95a
added stuff
GaelGil Sep 9, 2025
d58a27a
added the config
GaelGil Sep 9, 2025
8416425
updating the project strucutre
GaelGil Sep 9, 2025
6c3345b
added notebook
GaelGil Sep 9, 2025
d231327
added headers
GaelGil Sep 9, 2025
e8a3e6c
added dockerfile
GaelGil Sep 19, 2025
8482a5e
updated dependencies
GaelGil Sep 19, 2025
e6f6819
updated dockerfile
GaelGil Sep 19, 2025
687dddf
added docker compose
GaelGil Sep 19, 2025
4337505
renamed folder
GaelGil Sep 19, 2025
7bad1ba
more edits
GaelGil Sep 19, 2025
5783063
updated notebook
GaelGil Sep 19, 2025
dda76d9
updated dockerfile
GaelGil Sep 20, 2025
303b4d0
added dockerignore
GaelGil Sep 20, 2025
b322f23
updated notebook
GaelGil Sep 24, 2025
a9be5c8
working on implementing the model
GaelGil Oct 8, 2025
e17ce99
updating the model
GaelGil Oct 8, 2025
d7f4eba
working on model implementation
GaelGil Oct 9, 2025
439c8d9
added comments
GaelGil Oct 9, 2025
a906cc7
working on encoder
GaelGil Oct 9, 2025
c5b845e
fixed param type
GaelGil Oct 9, 2025
a7982df
adding comments
GaelGil Oct 9, 2025
1b84b31
more comments
GaelGil Oct 9, 2025
93d5c51
more comments
GaelGil Oct 9, 2025
8c0a643
more comments
GaelGil Oct 9, 2025
b6872b7
added comment
GaelGil Oct 9, 2025
efb68b0
updated the notebook
GaelGil Oct 9, 2025
4ff9104
adding comments
GaelGil Oct 9, 2025
13f8484
documentation and types
GaelGil Oct 9, 2025
81a03a9
adding examples
GaelGil Oct 9, 2025
3c24f00
updating the embeddings explanaation
GaelGil Oct 9, 2025
59d36c6
updated types
GaelGil Oct 9, 2025
307b39f
updatint the notebook
GaelGil Oct 9, 2025
49aee66
working on comments
GaelGil Oct 10, 2025
daeb074
more comments
GaelGil Oct 10, 2025
d283a13
updated the input embeddings part
GaelGil Oct 10, 2025
3369294
working on attention explanation:
GaelGil Oct 10, 2025
6da5826
working on model implementation
GaelGil Oct 10, 2025
fbb8846
more function defenitions
GaelGil Oct 10, 2025
bd58626
implementing the decoder
GaelGil Oct 10, 2025
1e3da1a
added decoder
GaelGil Oct 10, 2025
f03119f
implementing transformer calss
GaelGil Oct 10, 2025
7999569
adding utils
GaelGil Oct 10, 2025
c10f575
adding config
GaelGil Oct 10, 2025
fdcd3ac
added train.py
GaelGil Oct 10, 2025
a9385ae
adding more comments and renaming
GaelGil Oct 10, 2025
5078ea8
updating the comments
GaelGil Oct 10, 2025
2bf4575
added docker stuff
GaelGil Oct 15, 2025
9b61ac2
updated dependencies
GaelGil Oct 15, 2025
d36853c
added new files
GaelGil Oct 15, 2025
1ea8007
changes
GaelGil Oct 15, 2025
30ddba1
updating the model
GaelGil Oct 15, 2025
163cc95
added model
GaelGil Oct 15, 2025
d6c5407
added comments
GaelGil Oct 15, 2025
7dfe774
fixed typo
GaelGil Oct 15, 2025
215931e
updating the input embeddings
GaelGil Oct 16, 2025
ad0e004
updating the model to use patch embedding
GaelGil Oct 16, 2025
5e9668e
updating the model
GaelGil Oct 17, 2025
d07834e
updating comments
GaelGil Oct 21, 2025
05bdbaf
comments
GaelGil Oct 21, 2025
16f5baa
adding comments
GaelGil Oct 21, 2025
50b2487
comments
GaelGil Oct 22, 2025
ac3a680
updating stuff
GaelGil Oct 22, 2025
e6c98d4
implemented build funciton
GaelGil Oct 22, 2025
4d55104
updating the project
GaelGil Oct 22, 2025
5491f7a
updated model implementation
GaelGil Oct 22, 2025
188b590
upadting the model
GaelGil Oct 22, 2025
629c1c2
adding build model function and comments
GaelGil Oct 22, 2025
1d73c5e
added train file not yet implemented
GaelGil Oct 22, 2025
5977fec
updating positional embeddings
GaelGil Oct 22, 2025
8ba9684
updating the comments
GaelGil Oct 22, 2025
a53a705
updating positonal embedding and layernorm
GaelGil Oct 22, 2025
574d1b8
comments
GaelGil Oct 22, 2025
7820f37
updated main.py
GaelGil Oct 22, 2025
8313454
updated config with basic values
GaelGil Oct 22, 2025
9a28757
added print statement to train
GaelGil Oct 22, 2025
512350e
updating the build transformer function
GaelGil Oct 22, 2025
27978e7
adding missing values and correct typing
GaelGil Oct 22, 2025
b185d6d
updaitng the model
GaelGil Oct 22, 2025
bf6a180
fixing missing args
GaelGil Oct 22, 2025
773806f
updating stuff
GaelGil Oct 22, 2025
3e8616a
updating list of encodeerblocks
GaelGil Oct 22, 2025
8f706c9
updating model to user correct types
GaelGil Oct 22, 2025
86af4a3
updated stuff
GaelGil Oct 22, 2025
ad4564f
updating stuff
GaelGil Oct 22, 2025
6058280
updating projection layet
GaelGil Oct 23, 2025
8cd931d
more updates
GaelGil Oct 23, 2025
1afa001
updating the positional embeddings
GaelGil Oct 23, 2025
277ae79
updated project strucutre
GaelGil Oct 23, 2025
b9695f4
updating stuff
GaelGil Oct 23, 2025
f0ccf7a
adding stuff
GaelGil Oct 23, 2025
aad8aad
updating the init functions
GaelGil Oct 23, 2025
ed576c1
updates
GaelGil Oct 23, 2025
9891955
updating the init strucutre
GaelGil Oct 23, 2025
cb3b4c4
adding comments
GaelGil Oct 23, 2025
94e3713
added comments
GaelGil Oct 23, 2025
0e68ef8
fixed embeddings mistake
GaelGil Oct 24, 2025
407d615
removed file
GaelGil Oct 24, 2025
39927d9
updated config and model init
GaelGil Oct 24, 2025
1aa2ace
updating the traininng function
GaelGil Oct 24, 2025
cab3bbc
adding more comments
GaelGil Oct 24, 2025
3a569b4
updating the model
GaelGil Oct 24, 2025
abb68d9
updating the depencencies
GaelGil Oct 24, 2025
5025185
creating dataset loader
GaelGil Oct 24, 2025
1badda4
updating dataset loading
GaelGil Oct 24, 2025
a2a5060
added deafult value for transformations
GaelGil Oct 24, 2025
d158be3
updaitng the train function
GaelGil Oct 24, 2025
44308e0
updated training step
GaelGil Oct 24, 2025
5335b2f
updating stuff
GaelGil Oct 24, 2025
e5cb6fc
adding comments
GaelGil Oct 24, 2025
cbf3f8f
updating more stuff
GaelGil Oct 24, 2025
f47fd2c
updating the training and eval functions
GaelGil Oct 24, 2025
30dedef
updated eval to use state
GaelGil Oct 25, 2025
b7ebeba
added checkpointing
GaelGil Oct 25, 2025
96c0238
updating comments
GaelGil Oct 25, 2025
2c1d3aa
added tqdm dependency
GaelGil Oct 28, 2025
ba7b9e0
updating train and eval
GaelGil Oct 28, 2025
bec1406
updated main.py
GaelGil Oct 28, 2025
a881a11
added file to load dataset
GaelGil Oct 28, 2025
cb338fa
added dependency
GaelGil Oct 28, 2025
9a39cc3
updating the checkpointing
GaelGil Oct 28, 2025
193c368
updating the checkpoints
GaelGil Oct 28, 2025
cc0ff50
updating checkpoint initializng
GaelGil Oct 28, 2025
eee0e28
updated config
GaelGil Oct 28, 2025
83acd08
updated checkpoint saving
GaelGil Oct 28, 2025
1b45881
added comments
GaelGil Oct 28, 2025
9ed3d26
updating saving final model
GaelGil Oct 28, 2025
1761564
updated gitignore
GaelGil Oct 28, 2025
9ec7e53
added data to igore
GaelGil Oct 28, 2025
a0a028a
fixing issues
GaelGil Oct 28, 2025
26540b3
updating stuff
GaelGil Oct 28, 2025
2ac9c75
updating intialise model function
GaelGil Oct 28, 2025
138519f
updating to linen
GaelGil Oct 29, 2025
cbdcc90
updated imports
GaelGil Oct 29, 2025
75a63b1
updating the code to linen
GaelGil Oct 29, 2025
52e3a88
updating more linen stuff
GaelGil Oct 29, 2025
281efa0
updating the model again
GaelGil Oct 29, 2025
550d7cf
updating to linen
GaelGil Oct 29, 2025
6e7ac4d
created initializing function
GaelGil Oct 29, 2025
dd7457e
updating the param initialization
GaelGil Oct 29, 2025
d50837e
fixed issue
GaelGil Oct 30, 2025
0ff64ff
updating more of the code
GaelGil Oct 30, 2025
e4dca9c
fixing code issues
GaelGil Oct 30, 2025
eb552b3
fixing issues and adding training var
GaelGil Oct 30, 2025
9e56523
added notes
GaelGil Oct 30, 2025
1ac6b05
save
GaelGil Oct 30, 2025
7bf9778
fixing the code and config
GaelGil Oct 30, 2025
d2bb69f
debugging
GaelGil Oct 30, 2025
9e0808a
model trained initialiy but need to add comments
GaelGil Oct 30, 2025
ba76c43
added comments
GaelGil Oct 30, 2025
7e1ba30
more comments
GaelGil Oct 30, 2025
d110637
updated initialzie state function
GaelGil Oct 30, 2025
9e61dd4
updating for trainig
GaelGil Oct 30, 2025
7d53e95
small comments
GaelGil Oct 30, 2025
134abb2
trained a bit
GaelGil Oct 30, 2025
ea8012a
updating checkpointing
GaelGil Oct 30, 2025
866aab4
working on tokenizing
GaelGil Oct 31, 2025
f8133a2
debugging
GaelGil Oct 31, 2025
539b05c
fixed logging
GaelGil Oct 31, 2025
2e845ac
removed line
GaelGil Oct 31, 2025
f4bbaaf
fixing the model setup/__init__
GaelGil Oct 31, 2025
f58d0a8
working on model
GaelGil Oct 31, 2025
4593546
removed unused import
GaelGil Oct 31, 2025
6b29f13
adding a encode function
GaelGil Oct 31, 2025
6414b2c
updating the data loading
GaelGil Oct 31, 2025
e5e021c
working on tokenizer
GaelGil Oct 31, 2025
febd787
checking for null values
GaelGil Oct 31, 2025
94e6d2f
updating the function
GaelGil Oct 31, 2025
9faa437
debuggin the decoder
GaelGil Nov 1, 2025
fade633
working on tokenizer
GaelGil Nov 1, 2025
111c41d
working on loading the dataset
GaelGil Nov 1, 2025
6659701
loaded dataset
GaelGil Nov 1, 2025
68c00ba
removed unused imports
GaelGil Nov 1, 2025
3b2700e
updated naming
GaelGil Nov 1, 2025
87fc59b
refactoring
GaelGil Nov 1, 2025
0cf7ca4
more updates
GaelGil Nov 1, 2025
601a055
updating the dataset class
GaelGil Nov 1, 2025
19ff796
refactoring
GaelGil Nov 1, 2025
64343a0
working on training
GaelGil Nov 1, 2025
08c9617
updating restoring and logging
GaelGil Nov 1, 2025
d23bfb6
updated dependency
GaelGil Nov 1, 2025
107cffd
updating utils
GaelGil Nov 1, 2025
482c948
adding comments
GaelGil Nov 3, 2025
6133c0f
Merge branch 'master' of github.com:GaelGil/notebooks
GaelGil Nov 3, 2025
63f48f6
adding metrics saving
GaelGil Nov 3, 2025
36d01db
implemengint saving metrics
GaelGil Nov 3, 2025
ae99fbe
more comments
GaelGil Nov 3, 2025
9b12ea7
updating the code
GaelGil Nov 3, 2025
03ae856
updates
GaelGil Nov 3, 2025
b5d3ca1
updating the data path
GaelGil Nov 4, 2025
649930c
updating the custom handlwer
GaelGil Nov 4, 2025
f7aaff6
updating stuff
GaelGil Nov 5, 2025
6e1caf4
stuff
GaelGil Nov 5, 2025
b5a8947
stuff
GaelGil Nov 5, 2025
64f2fc3
more updates
GaelGil Nov 5, 2025
e02aa15
updates
GaelGil Nov 5, 2025
3134c79
error
GaelGil Nov 5, 2025
29c182e
more updates
GaelGil Nov 5, 2025
aaa795b
updates
GaelGil Nov 5, 2025
1323e6a
more updates
GaelGil Nov 5, 2025
937b5f1
errors
GaelGil Nov 5, 2025
742bb38
trained
GaelGil Nov 5, 2025
ebd7130
updated code
GaelGil Nov 5, 2025
f272ca4
updates
GaelGil Nov 5, 2025
26181b9
updated gitignore
GaelGil Nov 5, 2025
36ab556
updated stuff
GaelGil Nov 5, 2025
fe3befd
updated gitignore
GaelGil Nov 5, 2025
343745d
updating checkpoints
GaelGil Nov 6, 2025
7bdf491
removed unused import
GaelGil Nov 6, 2025
c9f9387
removed training value
GaelGil Nov 6, 2025
31377ca
added training for training and eval
GaelGil Nov 6, 2025
a54c3e0
updated determenistic values
GaelGil Nov 6, 2025
23a2ca9
updated stuff
GaelGil Nov 6, 2025
04ab845
adding more comments
GaelGil Nov 6, 2025
ee2184f
comments
GaelGil Nov 7, 2025
f67d4c9
updated layernorm
GaelGil Nov 7, 2025
3d1220c
creating a folder for the model
GaelGil Nov 7, 2025
15ea35b
updating the project structure
GaelGil Nov 7, 2025
a4de72c
added basic template
GaelGil Nov 7, 2025
88cc2c9
added image dataset class
GaelGil Nov 7, 2025
8f64370
added train state template
GaelGil Nov 7, 2025
945ff32
added template
GaelGil Nov 7, 2025
825c734
small updates
GaelGil Nov 7, 2025
963d0d4
updating stuff
GaelGil Nov 12, 2025
5616bf4
added comments
GaelGil Nov 12, 2025
2fdb5c7
adding comments
GaelGil Nov 12, 2025
deb5a42
updating project
GaelGil Nov 12, 2025
b8e1494
updates
GaelGil Nov 12, 2025
4ee3ba2
added comments
GaelGil Nov 15, 2025
190d545
updated the layernorm implementation
GaelGil Nov 18, 2025
d8e7fb2
updated rng stuff
GaelGil Nov 18, 2025
e75aaeb
updating the config
GaelGil Nov 18, 2025
0ec0b0e
removed line
GaelGil Nov 18, 2025
261a95a
Merge branch 'master' of github.com:GaelGil/notebooks
GaelGil Nov 18, 2025
5d05235
stoped tracking files
GaelGil Nov 18, 2025
c922c74
fixed bug
GaelGil Nov 21, 2025
46427b2
fixing stuff
GaelGil Nov 21, 2025
b6f5a08
added correct is_training handleing
GaelGil Nov 21, 2025
03c4148
updated init train state method
GaelGil Nov 21, 2025
ac29236
adding handler
GaelGil Nov 21, 2025
8e92c54
updates
GaelGil Nov 21, 2025
a1945eb
updating the model
GaelGil Nov 21, 2025
83a0293
updating tokenizers
GaelGil Nov 24, 2025
600a9b6
updating the loading of data
GaelGil Nov 24, 2025
0f82f0e
handling data
GaelGil Nov 24, 2025
368843c
implementing data loading
GaelGil Nov 24, 2025
aae8f6d
Bump jupyterlab from 4.4.3 to 4.4.8 in /amazon_sales
dependabot[bot] Nov 24, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 9 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -5,9 +5,17 @@
__pycache__/
*.py[cod]
*$py.class

**/checkpoints
# *.msgpack
# *.ckpt
# *.npz
# C extensions
*.so

*/data
/drug_alcohol_relation
*.csv
household_power_consumption.txt

*build_opencv
*knn
Expand Down
357 changes: 357 additions & 0 deletions amazon_sales/amazon_sales.ipynb

Large diffs are not rendered by default.

12 changes: 12 additions & 0 deletions amazon_sales/pyproject.toml
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
[project]
name = "amazon-sales"
version = "0.1.0"
description = "A data analysis project"
authors = [{ name = "Your Name" }]
dependencies = [
"jupyterlab",
"seaborn",
"pandas",
"numpy",
"scikit-learn"
]
10 changes: 10 additions & 0 deletions amazon_sales/requirements.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
fqdn==1.5.1
isoduration==20.11.0
jsonpointer==3.0.0
jupyterlab==4.4.8
pipdeptree==2.26.1
scikit-learn==1.6.1
seaborn==0.13.2
tinycss2==1.4.0
uri-template==1.3.0
webcolors==24.11.1
92 changes: 0 additions & 92 deletions back-propagation/back_progpagation_notes.ipynb

This file was deleted.

689 changes: 689 additions & 0 deletions back-propagation/back_propagation.ipynb

Large diffs are not rendered by default.

39 changes: 39 additions & 0 deletions back-propagation/data/X_test.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,39 @@
sepal length (cm),sepal width (cm),petal length (cm),petal width (cm)
6.2,2.8,4.8,1.8
6.7,3.1,4.7,1.5
5.0,3.5,1.3,0.3
6.5,3.0,5.2,2.0
5.7,3.0,4.2,1.2
5.9,3.0,4.2,1.5
4.7,3.2,1.3,0.2
5.7,2.8,4.5,1.3
5.5,2.4,3.8,1.1
4.9,2.5,4.5,1.7
4.6,3.2,1.4,0.2
6.2,2.2,4.5,1.5
6.9,3.2,5.7,2.3
5.4,3.0,4.5,1.5
4.7,3.2,1.6,0.2
4.8,3.4,1.6,0.2
4.9,3.1,1.5,0.1
6.7,2.5,5.8,1.8
5.4,3.4,1.7,0.2
4.4,3.2,1.3,0.2
5.8,2.7,3.9,1.2
6.3,2.3,4.4,1.3
4.4,3.0,1.3,0.2
5.8,2.7,5.1,1.9
5.0,3.6,1.4,0.2
7.7,2.6,6.9,2.3
6.0,3.0,4.8,1.8
7.1,3.0,5.9,2.1
7.7,3.8,6.7,2.2
6.6,3.0,4.4,1.4
6.4,3.2,5.3,2.3
5.0,2.0,3.5,1.0
6.0,2.2,5.0,1.5
6.4,2.7,5.3,1.9
6.7,3.0,5.0,1.7
6.1,3.0,4.6,1.4
5.6,2.8,4.9,2.0
6.1,2.8,4.0,1.3
113 changes: 113 additions & 0 deletions back-propagation/data/X_train.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,113 @@
sepal length (cm),sepal width (cm),petal length (cm),petal width (cm)
5.5,2.4,3.7,1.0
4.8,3.0,1.4,0.1
5.5,2.6,4.4,1.2
5.0,3.2,1.2,0.2
6.9,3.1,5.1,2.3
5.9,3.0,5.1,1.8
5.0,3.4,1.6,0.4
6.6,2.9,4.6,1.3
5.7,2.8,4.1,1.3
5.0,2.3,3.3,1.0
6.3,3.4,5.6,2.4
6.0,3.4,4.5,1.6
5.2,3.5,1.5,0.2
5.9,3.2,4.8,1.8
6.1,2.6,5.6,1.4
5.6,2.7,4.2,1.3
5.1,3.8,1.5,0.3
7.7,2.8,6.7,2.0
5.7,2.6,3.5,1.0
5.2,2.7,3.9,1.4
6.5,2.8,4.6,1.5
6.5,3.0,5.8,2.2
5.8,2.7,5.1,1.9
5.5,2.5,4.0,1.3
6.0,2.7,5.1,1.6
5.5,4.2,1.4,0.2
5.0,3.0,1.6,0.2
5.6,2.5,3.9,1.1
5.2,4.1,1.5,0.1
6.1,2.8,4.7,1.2
5.4,3.7,1.5,0.2
6.5,3.2,5.1,2.0
6.4,2.8,5.6,2.1
4.6,3.1,1.5,0.2
4.9,2.4,3.3,1.0
6.3,3.3,6.0,2.5
4.8,3.1,1.6,0.2
5.1,3.3,1.7,0.5
5.7,3.8,1.7,0.3
5.7,4.4,1.5,0.4
7.4,2.8,6.1,1.9
6.4,2.9,4.3,1.3
4.9,3.0,1.4,0.2
5.1,2.5,3.0,1.1
6.8,2.8,4.8,1.4
6.3,3.3,4.7,1.6
5.4,3.9,1.3,0.4
6.0,2.2,4.0,1.0
4.9,3.1,1.5,0.1
6.8,3.2,5.9,2.3
6.7,3.1,4.4,1.4
5.7,2.9,4.2,1.3
5.0,3.4,1.5,0.2
5.1,3.5,1.4,0.3
5.8,2.7,4.1,1.0
6.2,3.4,5.4,2.3
6.4,3.2,4.5,1.5
6.7,3.3,5.7,2.5
7.0,3.2,4.7,1.4
6.3,2.9,5.6,1.8
6.8,3.0,5.5,2.1
5.1,3.7,1.5,0.4
4.8,3.0,1.4,0.3
6.7,3.1,5.6,2.4
5.4,3.4,1.5,0.4
6.4,3.1,5.5,1.8
6.5,3.0,5.5,1.8
5.6,2.9,3.6,1.3
5.3,3.7,1.5,0.2
5.7,2.5,5.0,2.0
4.9,3.1,1.5,0.1
5.4,3.9,1.7,0.4
6.7,3.3,5.7,2.1
6.9,3.1,4.9,1.5
4.8,3.4,1.9,0.2
5.6,3.0,4.5,1.5
5.1,3.8,1.9,0.4
4.3,3.0,1.1,0.1
7.9,3.8,6.4,2.0
7.6,3.0,6.6,2.1
5.1,3.8,1.6,0.2
7.3,2.9,6.3,1.8
6.0,2.9,4.5,1.5
6.1,3.0,4.9,1.8
5.8,2.8,5.1,2.4
4.6,3.4,1.4,0.3
6.7,3.0,5.2,2.3
6.4,2.8,5.6,2.2
5.0,3.3,1.4,0.2
5.1,3.5,1.4,0.2
4.6,3.6,1.0,0.2
4.4,2.9,1.4,0.2
5.1,3.4,1.5,0.2
5.5,3.5,1.3,0.2
4.5,2.3,1.3,0.3
7.2,3.6,6.1,2.5
6.3,2.5,5.0,1.9
5.8,2.6,4.0,1.2
6.9,3.1,5.4,2.1
6.3,2.8,5.1,1.5
5.6,3.0,4.1,1.3
6.1,2.9,4.7,1.4
7.7,3.0,6.1,2.3
5.5,2.3,4.0,1.3
6.2,2.9,4.3,1.3
5.0,3.5,1.6,0.6
6.3,2.5,4.9,1.5
6.3,2.7,4.9,1.8
7.2,3.0,5.8,1.6
5.8,4.0,1.2,0.2
5.2,3.4,1.4,0.2
7.2,3.2,6.0,1.8
Loading