Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1050 commits
Select commit Hold shift + click to select a range
277ae79
updated project strucutre
GaelGil Oct 23, 2025
b9695f4
updating stuff
GaelGil Oct 23, 2025
f0ccf7a
adding stuff
GaelGil Oct 23, 2025
aad8aad
updating the init functions
GaelGil Oct 23, 2025
ed576c1
updates
GaelGil Oct 23, 2025
9891955
updating the init strucutre
GaelGil Oct 23, 2025
cb3b4c4
adding comments
GaelGil Oct 23, 2025
94e3713
added comments
GaelGil Oct 23, 2025
0e68ef8
fixed embeddings mistake
GaelGil Oct 24, 2025
407d615
removed file
GaelGil Oct 24, 2025
39927d9
updated config and model init
GaelGil Oct 24, 2025
1aa2ace
updating the traininng function
GaelGil Oct 24, 2025
cab3bbc
adding more comments
GaelGil Oct 24, 2025
3a569b4
updating the model
GaelGil Oct 24, 2025
abb68d9
updating the depencencies
GaelGil Oct 24, 2025
5025185
creating dataset loader
GaelGil Oct 24, 2025
1badda4
updating dataset loading
GaelGil Oct 24, 2025
a2a5060
added deafult value for transformations
GaelGil Oct 24, 2025
d158be3
updaitng the train function
GaelGil Oct 24, 2025
44308e0
updated training step
GaelGil Oct 24, 2025
5335b2f
updating stuff
GaelGil Oct 24, 2025
e5cb6fc
adding comments
GaelGil Oct 24, 2025
cbf3f8f
updating more stuff
GaelGil Oct 24, 2025
f47fd2c
updating the training and eval functions
GaelGil Oct 24, 2025
30dedef
updated eval to use state
GaelGil Oct 25, 2025
b7ebeba
added checkpointing
GaelGil Oct 25, 2025
96c0238
updating comments
GaelGil Oct 25, 2025
2c1d3aa
added tqdm dependency
GaelGil Oct 28, 2025
ba7b9e0
updating train and eval
GaelGil Oct 28, 2025
bec1406
updated main.py
GaelGil Oct 28, 2025
a881a11
added file to load dataset
GaelGil Oct 28, 2025
cb338fa
added dependency
GaelGil Oct 28, 2025
9a39cc3
updating the checkpointing
GaelGil Oct 28, 2025
193c368
updating the checkpoints
GaelGil Oct 28, 2025
cc0ff50
updating checkpoint initializng
GaelGil Oct 28, 2025
eee0e28
updated config
GaelGil Oct 28, 2025
83acd08
updated checkpoint saving
GaelGil Oct 28, 2025
1b45881
added comments
GaelGil Oct 28, 2025
9ed3d26
updating saving final model
GaelGil Oct 28, 2025
1761564
updated gitignore
GaelGil Oct 28, 2025
9ec7e53
added data to igore
GaelGil Oct 28, 2025
a0a028a
fixing issues
GaelGil Oct 28, 2025
26540b3
updating stuff
GaelGil Oct 28, 2025
2ac9c75
updating intialise model function
GaelGil Oct 28, 2025
138519f
updating to linen
GaelGil Oct 29, 2025
cbdcc90
updated imports
GaelGil Oct 29, 2025
75a63b1
updating the code to linen
GaelGil Oct 29, 2025
52e3a88
updating more linen stuff
GaelGil Oct 29, 2025
281efa0
updating the model again
GaelGil Oct 29, 2025
550d7cf
updating to linen
GaelGil Oct 29, 2025
6e7ac4d
created initializing function
GaelGil Oct 29, 2025
dd7457e
updating the param initialization
GaelGil Oct 29, 2025
d50837e
fixed issue
GaelGil Oct 30, 2025
0ff64ff
updating more of the code
GaelGil Oct 30, 2025
e4dca9c
fixing code issues
GaelGil Oct 30, 2025
eb552b3
fixing issues and adding training var
GaelGil Oct 30, 2025
9e56523
added notes
GaelGil Oct 30, 2025
1ac6b05
save
GaelGil Oct 30, 2025
7bf9778
fixing the code and config
GaelGil Oct 30, 2025
d2bb69f
debugging
GaelGil Oct 30, 2025
9e0808a
model trained initialiy but need to add comments
GaelGil Oct 30, 2025
ba76c43
added comments
GaelGil Oct 30, 2025
7e1ba30
more comments
GaelGil Oct 30, 2025
d110637
updated initialzie state function
GaelGil Oct 30, 2025
9e61dd4
updating for trainig
GaelGil Oct 30, 2025
7d53e95
small comments
GaelGil Oct 30, 2025
134abb2
trained a bit
GaelGil Oct 30, 2025
ea8012a
updating checkpointing
GaelGil Oct 30, 2025
866aab4
working on tokenizing
GaelGil Oct 31, 2025
f8133a2
debugging
GaelGil Oct 31, 2025
539b05c
fixed logging
GaelGil Oct 31, 2025
2e845ac
removed line
GaelGil Oct 31, 2025
f4bbaaf
fixing the model setup/__init__
GaelGil Oct 31, 2025
f58d0a8
working on model
GaelGil Oct 31, 2025
4593546
removed unused import
GaelGil Oct 31, 2025
6b29f13
adding a encode function
GaelGil Oct 31, 2025
6414b2c
updating the data loading
GaelGil Oct 31, 2025
e5e021c
working on tokenizer
GaelGil Oct 31, 2025
febd787
checking for null values
GaelGil Oct 31, 2025
94e6d2f
updating the function
GaelGil Oct 31, 2025
9faa437
debuggin the decoder
GaelGil Nov 1, 2025
fade633
working on tokenizer
GaelGil Nov 1, 2025
111c41d
working on loading the dataset
GaelGil Nov 1, 2025
6659701
loaded dataset
GaelGil Nov 1, 2025
68c00ba
removed unused imports
GaelGil Nov 1, 2025
3b2700e
updated naming
GaelGil Nov 1, 2025
87fc59b
refactoring
GaelGil Nov 1, 2025
0cf7ca4
more updates
GaelGil Nov 1, 2025
601a055
updating the dataset class
GaelGil Nov 1, 2025
19ff796
refactoring
GaelGil Nov 1, 2025
64343a0
working on training
GaelGil Nov 1, 2025
08c9617
updating restoring and logging
GaelGil Nov 1, 2025
d23bfb6
updated dependency
GaelGil Nov 1, 2025
107cffd
updating utils
GaelGil Nov 1, 2025
482c948
adding comments
GaelGil Nov 3, 2025
6133c0f
Merge branch 'master' of github.com:GaelGil/notebooks
GaelGil Nov 3, 2025
63f48f6
adding metrics saving
GaelGil Nov 3, 2025
36d01db
implemengint saving metrics
GaelGil Nov 3, 2025
ae99fbe
more comments
GaelGil Nov 3, 2025
9b12ea7
updating the code
GaelGil Nov 3, 2025
03ae856
updates
GaelGil Nov 3, 2025
b5d3ca1
updating the data path
GaelGil Nov 4, 2025
649930c
updating the custom handlwer
GaelGil Nov 4, 2025
f7aaff6
updating stuff
GaelGil Nov 5, 2025
6e1caf4
stuff
GaelGil Nov 5, 2025
b5a8947
stuff
GaelGil Nov 5, 2025
64f2fc3
more updates
GaelGil Nov 5, 2025
e02aa15
updates
GaelGil Nov 5, 2025
3134c79
error
GaelGil Nov 5, 2025
29c182e
more updates
GaelGil Nov 5, 2025
aaa795b
updates
GaelGil Nov 5, 2025
1323e6a
more updates
GaelGil Nov 5, 2025
937b5f1
errors
GaelGil Nov 5, 2025
742bb38
trained
GaelGil Nov 5, 2025
ebd7130
updated code
GaelGil Nov 5, 2025
f272ca4
updates
GaelGil Nov 5, 2025
26181b9
updated gitignore
GaelGil Nov 5, 2025
36ab556
updated stuff
GaelGil Nov 5, 2025
fe3befd
updated gitignore
GaelGil Nov 5, 2025
343745d
updating checkpoints
GaelGil Nov 6, 2025
7bdf491
removed unused import
GaelGil Nov 6, 2025
c9f9387
removed training value
GaelGil Nov 6, 2025
31377ca
added training for training and eval
GaelGil Nov 6, 2025
a54c3e0
updated determenistic values
GaelGil Nov 6, 2025
23a2ca9
updated stuff
GaelGil Nov 6, 2025
04ab845
adding more comments
GaelGil Nov 6, 2025
ee2184f
comments
GaelGil Nov 7, 2025
f67d4c9
updated layernorm
GaelGil Nov 7, 2025
3d1220c
creating a folder for the model
GaelGil Nov 7, 2025
15ea35b
updating the project structure
GaelGil Nov 7, 2025
a4de72c
added basic template
GaelGil Nov 7, 2025
88cc2c9
added image dataset class
GaelGil Nov 7, 2025
8f64370
added train state template
GaelGil Nov 7, 2025
945ff32
added template
GaelGil Nov 7, 2025
825c734
small updates
GaelGil Nov 7, 2025
963d0d4
updating stuff
GaelGil Nov 12, 2025
5616bf4
added comments
GaelGil Nov 12, 2025
2fdb5c7
adding comments
GaelGil Nov 12, 2025
deb5a42
updating project
GaelGil Nov 12, 2025
b8e1494
updates
GaelGil Nov 12, 2025
4ee3ba2
added comments
GaelGil Nov 15, 2025
190d545
updated the layernorm implementation
GaelGil Nov 18, 2025
d8e7fb2
updated rng stuff
GaelGil Nov 18, 2025
e75aaeb
updating the config
GaelGil Nov 18, 2025
0ec0b0e
removed line
GaelGil Nov 18, 2025
261a95a
Merge branch 'master' of github.com:GaelGil/notebooks
GaelGil Nov 18, 2025
5d05235
stoped tracking files
GaelGil Nov 18, 2025
c922c74
fixed bug
GaelGil Nov 21, 2025
46427b2
fixing stuff
GaelGil Nov 21, 2025
b6f5a08
added correct is_training handleing
GaelGil Nov 21, 2025
03c4148
updated init train state method
GaelGil Nov 21, 2025
ac29236
adding handler
GaelGil Nov 21, 2025
8e92c54
updates
GaelGil Nov 21, 2025
a1945eb
updating the model
GaelGil Nov 21, 2025
83a0293
updating tokenizers
GaelGil Nov 24, 2025
600a9b6
updating the loading of data
GaelGil Nov 24, 2025
0f82f0e
handling data
GaelGil Nov 24, 2025
368843c
implementing data loading
GaelGil Nov 24, 2025
28422a9
updating tokenixing
GaelGil Nov 24, 2025
7bedc90
updates
GaelGil Nov 24, 2025
a352263
removed stuff
GaelGil Nov 24, 2025
f6f8a4e
preped for train
GaelGil Nov 24, 2025
dfa2b35
trained tokenizer
GaelGil Nov 24, 2025
04befa3
updating stuff
GaelGil Nov 24, 2025
0fc5739
splitting
GaelGil Nov 24, 2025
5f89d48
updating splitting
GaelGil Nov 25, 2025
725b617
removed file
GaelGil Nov 25, 2025
00a1a20
updating some stuff
GaelGil Nov 25, 2025
b4b34cb
creating function to make batches
GaelGil Nov 25, 2025
6adc5ff
updating stuff
GaelGil Nov 25, 2025
e03a156
preparing for training
GaelGil Nov 25, 2025
a9f5520
updating stuff
GaelGil Nov 25, 2025
5748a8e
adding fixed
GaelGil Nov 25, 2025
3ab9a3f
finishing up stuff
GaelGil Nov 25, 2025
7a8d627
adding comments
GaelGil Nov 25, 2025
6e124d1
more comments
GaelGil Nov 25, 2025
c0ddbdc
small changes
GaelGil Nov 25, 2025
35480ae
added some type checking
GaelGil Nov 25, 2025
bb5ce26
adding data loader class
GaelGil Nov 25, 2025
070786f
using data laoder class
GaelGil Nov 25, 2025
a85a328
fixing some stuff
GaelGil Nov 25, 2025
9930066
updating eval step
GaelGil Nov 25, 2025
b86df55
eval used wrong output
GaelGil Nov 26, 2025
c2302c8
updating stuff
GaelGil Nov 26, 2025
e2218f1
debugging
GaelGil Nov 26, 2025
a938add
adding correct dropout range
GaelGil Nov 26, 2025
4f901f6
fixing stuff
GaelGil Nov 26, 2025
daab3d5
fixed some bugs
GaelGil Dec 1, 2025
a5a4338
added prefix
GaelGil Dec 1, 2025
c14a652
added stuff for prefixing
GaelGil Dec 1, 2025
894fd2a
changes
GaelGil Dec 1, 2025
29364e5
merged
GaelGil Dec 1, 2025
02f544a
fixed stuff
GaelGil Dec 1, 2025
d1ffad6
updated to float32 for masks
GaelGil Dec 2, 2025
ed0f442
updated the dummy input
GaelGil Dec 2, 2025
8f037d5
updating stuff
GaelGil Dec 2, 2025
4c7e4f0
updating model
GaelGil Dec 2, 2025
ebf2a21
updating some naming
GaelGil Dec 2, 2025
4724efb
fixed bug
GaelGil Dec 2, 2025
a745a81
updating some naming
GaelGil Dec 2, 2025
103b23f
updated some small mistakes
GaelGil Dec 2, 2025
a43d096
added some comments
GaelGil Dec 2, 2025
1d9b561
updating stuff
GaelGil Dec 2, 2025
443eadd
updating stuff
GaelGil Dec 2, 2025
2221ba5
fixing masks
GaelGil Dec 2, 2025
61822d9
updating masks
GaelGil Dec 3, 2025
3a7f51e
updated stuff
GaelGil Dec 3, 2025
26586f9
updated the second training
GaelGil Dec 3, 2025
51d8a04
updating epochs
GaelGil Dec 3, 2025
8cf58a7
training stuff
GaelGil Dec 3, 2025
bbbe686
updated train/eval
GaelGil Dec 3, 2025
e2fe221
updating stuff
GaelGil Dec 4, 2025
ccb183a
updates
GaelGil Dec 4, 2025
cf6bc8a
added scale
GaelGil Dec 4, 2025
ee004c1
added prefixs to the tokenizer call
GaelGil Dec 4, 2025
bbebae5
added tokenizer
GaelGil Dec 4, 2025
141156e
updated the tokenizer to train on prefixes
GaelGil Dec 4, 2025
99c4ad1
updates
GaelGil Dec 4, 2025
9582411
adding prefix
GaelGil Dec 4, 2025
144409b
more updates
GaelGil Dec 4, 2025
380097c
updates
GaelGil Dec 7, 2025
71655fb
more updates
GaelGil Dec 7, 2025
bd1a5d0
updates
GaelGil Dec 8, 2025
1f8794e
changes
GaelGil Dec 8, 2025
7c45c95
removed compact
GaelGil Dec 8, 2025
f3037d3
small updates
GaelGil Dec 8, 2025
71740ce
updating tokenizer
GaelGil Dec 8, 2025
c44b32b
more tokenizer updates
GaelGil Dec 8, 2025
3f1f056
updating data loading
GaelGil Dec 8, 2025
2d5c7a1
fixing stuff
GaelGil Dec 8, 2025
fd8850c
debugging
GaelGil Dec 9, 2025
c850451
updated stuff
GaelGil Dec 9, 2025
71cbdc3
loading data correctly
GaelGil Dec 9, 2025
3ffb1e1
updated data loader
GaelGil Dec 9, 2025
dfa5d30
debugging
GaelGil Dec 10, 2025
968f2ca
updatse
GaelGil Dec 11, 2025
f0cd0fd
removed second dataset
GaelGil Dec 11, 2025
e0f7628
updating to nnx from linen
GaelGil Dec 11, 2025
76f1bd5
updating code
GaelGil Dec 11, 2025
5ba7880
more nxx updates
GaelGil Dec 11, 2025
0d53e30
stuff
GaelGil Dec 11, 2025
d7c81bc
updating stuff
GaelGil Dec 11, 2025
0739e00
trained tokenizer
GaelGil Dec 11, 2025
9cdcb75
more changes
GaelGil Dec 11, 2025
8bbf019
updated the init train state
GaelGil Dec 11, 2025
fbadd16
updates
GaelGil Dec 12, 2025
2329b62
adding grain data loader
GaelGil Dec 12, 2025
2709f98
added data loader
GaelGil Dec 12, 2025
1e61039
updates
GaelGil Dec 12, 2025
1dd0ca3
Bump jupyterlab from 4.4.3 to 4.4.8 in /goodreads_recomender
dependabot[bot] Dec 12, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 9 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -5,9 +5,17 @@
__pycache__/
*.py[cod]
*$py.class

**/checkpoints
# *.msgpack
# *.ckpt
# *.npz
# C extensions
*.so

*/data
/drug_alcohol_relation
*.csv
household_power_consumption.txt

*build_opencv
*knn
Expand Down
357 changes: 357 additions & 0 deletions amazon_sales/amazon_sales.ipynb

Large diffs are not rendered by default.

12 changes: 12 additions & 0 deletions amazon_sales/pyproject.toml
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
[project]
name = "amazon-sales"
version = "0.1.0"
description = "A data analysis project"
authors = [{ name = "Your Name" }]
dependencies = [
"jupyterlab",
"seaborn",
"pandas",
"numpy",
"scikit-learn"
]
10 changes: 10 additions & 0 deletions amazon_sales/requirements.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
fqdn==1.5.1
isoduration==20.11.0
jsonpointer==3.0.0
jupyterlab==4.4.3
pipdeptree==2.26.1
scikit-learn==1.6.1
seaborn==0.13.2
tinycss2==1.4.0
uri-template==1.3.0
webcolors==24.11.1
92 changes: 0 additions & 92 deletions back-propagation/back_progpagation_notes.ipynb

This file was deleted.

689 changes: 689 additions & 0 deletions back-propagation/back_propagation.ipynb

Large diffs are not rendered by default.

39 changes: 39 additions & 0 deletions back-propagation/data/X_test.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,39 @@
sepal length (cm),sepal width (cm),petal length (cm),petal width (cm)
6.2,2.8,4.8,1.8
6.7,3.1,4.7,1.5
5.0,3.5,1.3,0.3
6.5,3.0,5.2,2.0
5.7,3.0,4.2,1.2
5.9,3.0,4.2,1.5
4.7,3.2,1.3,0.2
5.7,2.8,4.5,1.3
5.5,2.4,3.8,1.1
4.9,2.5,4.5,1.7
4.6,3.2,1.4,0.2
6.2,2.2,4.5,1.5
6.9,3.2,5.7,2.3
5.4,3.0,4.5,1.5
4.7,3.2,1.6,0.2
4.8,3.4,1.6,0.2
4.9,3.1,1.5,0.1
6.7,2.5,5.8,1.8
5.4,3.4,1.7,0.2
4.4,3.2,1.3,0.2
5.8,2.7,3.9,1.2
6.3,2.3,4.4,1.3
4.4,3.0,1.3,0.2
5.8,2.7,5.1,1.9
5.0,3.6,1.4,0.2
7.7,2.6,6.9,2.3
6.0,3.0,4.8,1.8
7.1,3.0,5.9,2.1
7.7,3.8,6.7,2.2
6.6,3.0,4.4,1.4
6.4,3.2,5.3,2.3
5.0,2.0,3.5,1.0
6.0,2.2,5.0,1.5
6.4,2.7,5.3,1.9
6.7,3.0,5.0,1.7
6.1,3.0,4.6,1.4
5.6,2.8,4.9,2.0
6.1,2.8,4.0,1.3
113 changes: 113 additions & 0 deletions back-propagation/data/X_train.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,113 @@
sepal length (cm),sepal width (cm),petal length (cm),petal width (cm)
5.5,2.4,3.7,1.0
4.8,3.0,1.4,0.1
5.5,2.6,4.4,1.2
5.0,3.2,1.2,0.2
6.9,3.1,5.1,2.3
5.9,3.0,5.1,1.8
5.0,3.4,1.6,0.4
6.6,2.9,4.6,1.3
5.7,2.8,4.1,1.3
5.0,2.3,3.3,1.0
6.3,3.4,5.6,2.4
6.0,3.4,4.5,1.6
5.2,3.5,1.5,0.2
5.9,3.2,4.8,1.8
6.1,2.6,5.6,1.4
5.6,2.7,4.2,1.3
5.1,3.8,1.5,0.3
7.7,2.8,6.7,2.0
5.7,2.6,3.5,1.0
5.2,2.7,3.9,1.4
6.5,2.8,4.6,1.5
6.5,3.0,5.8,2.2
5.8,2.7,5.1,1.9
5.5,2.5,4.0,1.3
6.0,2.7,5.1,1.6
5.5,4.2,1.4,0.2
5.0,3.0,1.6,0.2
5.6,2.5,3.9,1.1
5.2,4.1,1.5,0.1
6.1,2.8,4.7,1.2
5.4,3.7,1.5,0.2
6.5,3.2,5.1,2.0
6.4,2.8,5.6,2.1
4.6,3.1,1.5,0.2
4.9,2.4,3.3,1.0
6.3,3.3,6.0,2.5
4.8,3.1,1.6,0.2
5.1,3.3,1.7,0.5
5.7,3.8,1.7,0.3
5.7,4.4,1.5,0.4
7.4,2.8,6.1,1.9
6.4,2.9,4.3,1.3
4.9,3.0,1.4,0.2
5.1,2.5,3.0,1.1
6.8,2.8,4.8,1.4
6.3,3.3,4.7,1.6
5.4,3.9,1.3,0.4
6.0,2.2,4.0,1.0
4.9,3.1,1.5,0.1
6.8,3.2,5.9,2.3
6.7,3.1,4.4,1.4
5.7,2.9,4.2,1.3
5.0,3.4,1.5,0.2
5.1,3.5,1.4,0.3
5.8,2.7,4.1,1.0
6.2,3.4,5.4,2.3
6.4,3.2,4.5,1.5
6.7,3.3,5.7,2.5
7.0,3.2,4.7,1.4
6.3,2.9,5.6,1.8
6.8,3.0,5.5,2.1
5.1,3.7,1.5,0.4
4.8,3.0,1.4,0.3
6.7,3.1,5.6,2.4
5.4,3.4,1.5,0.4
6.4,3.1,5.5,1.8
6.5,3.0,5.5,1.8
5.6,2.9,3.6,1.3
5.3,3.7,1.5,0.2
5.7,2.5,5.0,2.0
4.9,3.1,1.5,0.1
5.4,3.9,1.7,0.4
6.7,3.3,5.7,2.1
6.9,3.1,4.9,1.5
4.8,3.4,1.9,0.2
5.6,3.0,4.5,1.5
5.1,3.8,1.9,0.4
4.3,3.0,1.1,0.1
7.9,3.8,6.4,2.0
7.6,3.0,6.6,2.1
5.1,3.8,1.6,0.2
7.3,2.9,6.3,1.8
6.0,2.9,4.5,1.5
6.1,3.0,4.9,1.8
5.8,2.8,5.1,2.4
4.6,3.4,1.4,0.3
6.7,3.0,5.2,2.3
6.4,2.8,5.6,2.2
5.0,3.3,1.4,0.2
5.1,3.5,1.4,0.2
4.6,3.6,1.0,0.2
4.4,2.9,1.4,0.2
5.1,3.4,1.5,0.2
5.5,3.5,1.3,0.2
4.5,2.3,1.3,0.3
7.2,3.6,6.1,2.5
6.3,2.5,5.0,1.9
5.8,2.6,4.0,1.2
6.9,3.1,5.4,2.1
6.3,2.8,5.1,1.5
5.6,3.0,4.1,1.3
6.1,2.9,4.7,1.4
7.7,3.0,6.1,2.3
5.5,2.3,4.0,1.3
6.2,2.9,4.3,1.3
5.0,3.5,1.6,0.6
6.3,2.5,4.9,1.5
6.3,2.7,4.9,1.8
7.2,3.0,5.8,1.6
5.8,4.0,1.2,0.2
5.2,3.4,1.4,0.2
7.2,3.2,6.0,1.8
Loading