Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1114 commits
Select commit Hold shift + click to select a range
9e61dd4
updating for trainig
GaelGil Oct 30, 2025
7d53e95
small comments
GaelGil Oct 30, 2025
134abb2
trained a bit
GaelGil Oct 30, 2025
ea8012a
updating checkpointing
GaelGil Oct 30, 2025
866aab4
working on tokenizing
GaelGil Oct 31, 2025
f8133a2
debugging
GaelGil Oct 31, 2025
539b05c
fixed logging
GaelGil Oct 31, 2025
2e845ac
removed line
GaelGil Oct 31, 2025
f4bbaaf
fixing the model setup/__init__
GaelGil Oct 31, 2025
f58d0a8
working on model
GaelGil Oct 31, 2025
4593546
removed unused import
GaelGil Oct 31, 2025
6b29f13
adding a encode function
GaelGil Oct 31, 2025
6414b2c
updating the data loading
GaelGil Oct 31, 2025
e5e021c
working on tokenizer
GaelGil Oct 31, 2025
febd787
checking for null values
GaelGil Oct 31, 2025
94e6d2f
updating the function
GaelGil Oct 31, 2025
9faa437
debuggin the decoder
GaelGil Nov 1, 2025
fade633
working on tokenizer
GaelGil Nov 1, 2025
111c41d
working on loading the dataset
GaelGil Nov 1, 2025
6659701
loaded dataset
GaelGil Nov 1, 2025
68c00ba
removed unused imports
GaelGil Nov 1, 2025
3b2700e
updated naming
GaelGil Nov 1, 2025
87fc59b
refactoring
GaelGil Nov 1, 2025
0cf7ca4
more updates
GaelGil Nov 1, 2025
601a055
updating the dataset class
GaelGil Nov 1, 2025
19ff796
refactoring
GaelGil Nov 1, 2025
64343a0
working on training
GaelGil Nov 1, 2025
08c9617
updating restoring and logging
GaelGil Nov 1, 2025
d23bfb6
updated dependency
GaelGil Nov 1, 2025
107cffd
updating utils
GaelGil Nov 1, 2025
482c948
adding comments
GaelGil Nov 3, 2025
6133c0f
Merge branch 'master' of github.com:GaelGil/notebooks
GaelGil Nov 3, 2025
63f48f6
adding metrics saving
GaelGil Nov 3, 2025
36d01db
implemengint saving metrics
GaelGil Nov 3, 2025
ae99fbe
more comments
GaelGil Nov 3, 2025
9b12ea7
updating the code
GaelGil Nov 3, 2025
03ae856
updates
GaelGil Nov 3, 2025
b5d3ca1
updating the data path
GaelGil Nov 4, 2025
649930c
updating the custom handlwer
GaelGil Nov 4, 2025
f7aaff6
updating stuff
GaelGil Nov 5, 2025
6e1caf4
stuff
GaelGil Nov 5, 2025
b5a8947
stuff
GaelGil Nov 5, 2025
64f2fc3
more updates
GaelGil Nov 5, 2025
e02aa15
updates
GaelGil Nov 5, 2025
3134c79
error
GaelGil Nov 5, 2025
29c182e
more updates
GaelGil Nov 5, 2025
aaa795b
updates
GaelGil Nov 5, 2025
1323e6a
more updates
GaelGil Nov 5, 2025
937b5f1
errors
GaelGil Nov 5, 2025
742bb38
trained
GaelGil Nov 5, 2025
ebd7130
updated code
GaelGil Nov 5, 2025
f272ca4
updates
GaelGil Nov 5, 2025
26181b9
updated gitignore
GaelGil Nov 5, 2025
36ab556
updated stuff
GaelGil Nov 5, 2025
fe3befd
updated gitignore
GaelGil Nov 5, 2025
343745d
updating checkpoints
GaelGil Nov 6, 2025
7bdf491
removed unused import
GaelGil Nov 6, 2025
c9f9387
removed training value
GaelGil Nov 6, 2025
31377ca
added training for training and eval
GaelGil Nov 6, 2025
a54c3e0
updated determenistic values
GaelGil Nov 6, 2025
23a2ca9
updated stuff
GaelGil Nov 6, 2025
04ab845
adding more comments
GaelGil Nov 6, 2025
ee2184f
comments
GaelGil Nov 7, 2025
f67d4c9
updated layernorm
GaelGil Nov 7, 2025
3d1220c
creating a folder for the model
GaelGil Nov 7, 2025
15ea35b
updating the project structure
GaelGil Nov 7, 2025
a4de72c
added basic template
GaelGil Nov 7, 2025
88cc2c9
added image dataset class
GaelGil Nov 7, 2025
8f64370
added train state template
GaelGil Nov 7, 2025
945ff32
added template
GaelGil Nov 7, 2025
825c734
small updates
GaelGil Nov 7, 2025
963d0d4
updating stuff
GaelGil Nov 12, 2025
5616bf4
added comments
GaelGil Nov 12, 2025
2fdb5c7
adding comments
GaelGil Nov 12, 2025
deb5a42
updating project
GaelGil Nov 12, 2025
b8e1494
updates
GaelGil Nov 12, 2025
4ee3ba2
added comments
GaelGil Nov 15, 2025
190d545
updated the layernorm implementation
GaelGil Nov 18, 2025
d8e7fb2
updated rng stuff
GaelGil Nov 18, 2025
e75aaeb
updating the config
GaelGil Nov 18, 2025
0ec0b0e
removed line
GaelGil Nov 18, 2025
261a95a
Merge branch 'master' of github.com:GaelGil/notebooks
GaelGil Nov 18, 2025
5d05235
stoped tracking files
GaelGil Nov 18, 2025
c922c74
fixed bug
GaelGil Nov 21, 2025
46427b2
fixing stuff
GaelGil Nov 21, 2025
b6f5a08
added correct is_training handleing
GaelGil Nov 21, 2025
03c4148
updated init train state method
GaelGil Nov 21, 2025
ac29236
adding handler
GaelGil Nov 21, 2025
8e92c54
updates
GaelGil Nov 21, 2025
a1945eb
updating the model
GaelGil Nov 21, 2025
83a0293
updating tokenizers
GaelGil Nov 24, 2025
600a9b6
updating the loading of data
GaelGil Nov 24, 2025
0f82f0e
handling data
GaelGil Nov 24, 2025
368843c
implementing data loading
GaelGil Nov 24, 2025
28422a9
updating tokenixing
GaelGil Nov 24, 2025
7bedc90
updates
GaelGil Nov 24, 2025
a352263
removed stuff
GaelGil Nov 24, 2025
f6f8a4e
preped for train
GaelGil Nov 24, 2025
dfa2b35
trained tokenizer
GaelGil Nov 24, 2025
04befa3
updating stuff
GaelGil Nov 24, 2025
0fc5739
splitting
GaelGil Nov 24, 2025
5f89d48
updating splitting
GaelGil Nov 25, 2025
725b617
removed file
GaelGil Nov 25, 2025
00a1a20
updating some stuff
GaelGil Nov 25, 2025
b4b34cb
creating function to make batches
GaelGil Nov 25, 2025
6adc5ff
updating stuff
GaelGil Nov 25, 2025
e03a156
preparing for training
GaelGil Nov 25, 2025
a9f5520
updating stuff
GaelGil Nov 25, 2025
5748a8e
adding fixed
GaelGil Nov 25, 2025
3ab9a3f
finishing up stuff
GaelGil Nov 25, 2025
7a8d627
adding comments
GaelGil Nov 25, 2025
6e124d1
more comments
GaelGil Nov 25, 2025
c0ddbdc
small changes
GaelGil Nov 25, 2025
35480ae
added some type checking
GaelGil Nov 25, 2025
bb5ce26
adding data loader class
GaelGil Nov 25, 2025
070786f
using data laoder class
GaelGil Nov 25, 2025
a85a328
fixing some stuff
GaelGil Nov 25, 2025
9930066
updating eval step
GaelGil Nov 25, 2025
b86df55
eval used wrong output
GaelGil Nov 26, 2025
c2302c8
updating stuff
GaelGil Nov 26, 2025
e2218f1
debugging
GaelGil Nov 26, 2025
a938add
adding correct dropout range
GaelGil Nov 26, 2025
4f901f6
fixing stuff
GaelGil Nov 26, 2025
daab3d5
fixed some bugs
GaelGil Dec 1, 2025
a5a4338
added prefix
GaelGil Dec 1, 2025
c14a652
added stuff for prefixing
GaelGil Dec 1, 2025
894fd2a
changes
GaelGil Dec 1, 2025
29364e5
merged
GaelGil Dec 1, 2025
02f544a
fixed stuff
GaelGil Dec 1, 2025
d1ffad6
updated to float32 for masks
GaelGil Dec 2, 2025
ed0f442
updated the dummy input
GaelGil Dec 2, 2025
8f037d5
updating stuff
GaelGil Dec 2, 2025
4c7e4f0
updating model
GaelGil Dec 2, 2025
ebf2a21
updating some naming
GaelGil Dec 2, 2025
4724efb
fixed bug
GaelGil Dec 2, 2025
a745a81
updating some naming
GaelGil Dec 2, 2025
103b23f
updated some small mistakes
GaelGil Dec 2, 2025
a43d096
added some comments
GaelGil Dec 2, 2025
1d9b561
updating stuff
GaelGil Dec 2, 2025
443eadd
updating stuff
GaelGil Dec 2, 2025
2221ba5
fixing masks
GaelGil Dec 2, 2025
61822d9
updating masks
GaelGil Dec 3, 2025
3a7f51e
updated stuff
GaelGil Dec 3, 2025
26586f9
updated the second training
GaelGil Dec 3, 2025
51d8a04
updating epochs
GaelGil Dec 3, 2025
8cf58a7
training stuff
GaelGil Dec 3, 2025
bbbe686
updated train/eval
GaelGil Dec 3, 2025
e2fe221
updating stuff
GaelGil Dec 4, 2025
ccb183a
updates
GaelGil Dec 4, 2025
cf6bc8a
added scale
GaelGil Dec 4, 2025
ee004c1
added prefixs to the tokenizer call
GaelGil Dec 4, 2025
bbebae5
added tokenizer
GaelGil Dec 4, 2025
141156e
updated the tokenizer to train on prefixes
GaelGil Dec 4, 2025
99c4ad1
updates
GaelGil Dec 4, 2025
9582411
adding prefix
GaelGil Dec 4, 2025
144409b
more updates
GaelGil Dec 4, 2025
380097c
updates
GaelGil Dec 7, 2025
71655fb
more updates
GaelGil Dec 7, 2025
bd1a5d0
updates
GaelGil Dec 8, 2025
1f8794e
changes
GaelGil Dec 8, 2025
7c45c95
removed compact
GaelGil Dec 8, 2025
f3037d3
small updates
GaelGil Dec 8, 2025
71740ce
updating tokenizer
GaelGil Dec 8, 2025
c44b32b
more tokenizer updates
GaelGil Dec 8, 2025
3f1f056
updating data loading
GaelGil Dec 8, 2025
2d5c7a1
fixing stuff
GaelGil Dec 8, 2025
fd8850c
debugging
GaelGil Dec 9, 2025
c850451
updated stuff
GaelGil Dec 9, 2025
71cbdc3
loading data correctly
GaelGil Dec 9, 2025
3ffb1e1
updated data loader
GaelGil Dec 9, 2025
dfa5d30
debugging
GaelGil Dec 10, 2025
968f2ca
updatse
GaelGil Dec 11, 2025
f0cd0fd
removed second dataset
GaelGil Dec 11, 2025
e0f7628
updating to nnx from linen
GaelGil Dec 11, 2025
76f1bd5
updating code
GaelGil Dec 11, 2025
5ba7880
more nxx updates
GaelGil Dec 11, 2025
0d53e30
stuff
GaelGil Dec 11, 2025
d7c81bc
updating stuff
GaelGil Dec 11, 2025
0739e00
trained tokenizer
GaelGil Dec 11, 2025
9cdcb75
more changes
GaelGil Dec 11, 2025
8bbf019
updated the init train state
GaelGil Dec 11, 2025
fbadd16
updates
GaelGil Dec 12, 2025
2329b62
adding grain data loader
GaelGil Dec 12, 2025
2709f98
added data loader
GaelGil Dec 12, 2025
1e61039
updates
GaelGil Dec 12, 2025
6bc2e83
updating stuff
GaelGil Dec 12, 2025
cba691a
implemented the state
GaelGil Dec 12, 2025
8a0dbdf
cleaned up project
GaelGil Dec 12, 2025
2b258dd
updating the train and eval steps
GaelGil Dec 12, 2025
706b732
removed unused file
GaelGil Dec 12, 2025
3c46614
updated main.py
GaelGil Dec 12, 2025
0781ab8
more debugging
GaelGil Dec 12, 2025
f9709b7
updated stuff
GaelGil Dec 12, 2025
b59fd71
added types
GaelGil Dec 12, 2025
ee7fd78
added comments
GaelGil Dec 12, 2025
68b2e5c
updates
GaelGil Dec 13, 2025
7dc773a
updated stuff
GaelGil Dec 15, 2025
e826836
updated the data loader
GaelGil Dec 15, 2025
0da0a8c
updated the model
GaelGil Dec 15, 2025
8e6fd0d
debugging stuff
GaelGil Dec 15, 2025
2b17a66
updating stuff
GaelGil Dec 15, 2025
fa6d9db
added print statement
GaelGil Dec 15, 2025
2acb551
debugging
GaelGil Dec 15, 2025
d7c0059
added rngs
GaelGil Dec 15, 2025
a51c79c
updated stuff
GaelGil Dec 16, 2025
0861857
stuff
GaelGil Dec 17, 2025
8a4fea5
adding comments
GaelGil Dec 17, 2025
c5a17f9
cleaned up stuff
GaelGil Dec 17, 2025
4c99c0c
updating stuff
GaelGil Dec 17, 2025
47008a0
stuff
GaelGil Dec 18, 2025
77aa608
changes
GaelGil Dec 18, 2025
0e249ab
improving training loop
GaelGil Dec 18, 2025
c8449b3
updated stuff
GaelGil Dec 18, 2025
fa6fe0a
more stuff
GaelGil Dec 20, 2025
b3ad08a
fixed opt issue
GaelGil Dec 20, 2025
c01bb67
stuff
GaelGil Dec 22, 2025
a244061
added comments
GaelGil Dec 22, 2025
184638b
more comments
GaelGil Dec 22, 2025
25a24c7
removed some stuff
GaelGil Dec 22, 2025
df5df39
more comments
GaelGil Dec 22, 2025
9f4ee34
added comments
GaelGil Dec 22, 2025
e308a15
more comments
GaelGil Dec 22, 2025
4e5e4ff
addded restoreing from best checkpoint
GaelGil Dec 22, 2025
4ace618
updating the train step
GaelGil Dec 30, 2025
2ea3f96
fixed train step
GaelGil Dec 30, 2025
db8b512
fixing eval
GaelGil Dec 30, 2025
1d848cd
fixing types
GaelGil Dec 30, 2025
b75f3d3
changed data to numpy
GaelGil Dec 30, 2025
f29a11f
updates
GaelGil Dec 30, 2025
15744e9
updates
GaelGil Dec 31, 2025
2365c05
updated rngs
GaelGil Jan 8, 2026
85648da
updates
GaelGil Jan 9, 2026
5daceef
rng updates
GaelGil Jan 13, 2026
9c93395
updated deleting
GaelGil Jan 15, 2026
c568687
fixed rngs
GaelGil Jan 22, 2026
5040b72
updating the model
GaelGil Jan 30, 2026
b188b92
more updates
GaelGil Jan 30, 2026
3536626
more updates
GaelGil Jan 30, 2026
3e55c16
updated the model to nnx
GaelGil Jan 30, 2026
db6b467
enoguh updates for now
GaelGil Jan 30, 2026
acbe5ff
updating the data loader
GaelGil Feb 2, 2026
e914f53
updated the loader again
GaelGil Feb 2, 2026
a0b0026
more updates
GaelGil Feb 2, 2026
ad56d0c
updated some typing stuff
GaelGil Feb 2, 2026
eef24ea
removed old file
GaelGil Feb 2, 2026
168dbf8
adding types
GaelGil Feb 2, 2026
42fbf36
updated the gitignore
GaelGil Feb 3, 2026
68f5275
Merge branch 'master' of github.com:GaelGil/notebooks
GaelGil Feb 3, 2026
894d63c
removed line
GaelGil Feb 3, 2026
903a1be
Bump pip from 25.1 to 26.0 in /who_life_expectancy
dependabot[bot] Feb 3, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 10 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -5,9 +5,18 @@
__pycache__/
*.py[cod]
*$py.class

**/checkpoints
**/ckpt
# *.msgpack
# *.ckpt
# *.npz
# C extensions
*.so

*/data
/drug_alcohol_relation
*.csv
household_power_consumption.txt

*build_opencv
*knn
Expand Down
357 changes: 357 additions & 0 deletions amazon_sales/amazon_sales.ipynb

Large diffs are not rendered by default.

12 changes: 12 additions & 0 deletions amazon_sales/pyproject.toml
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
[project]
name = "amazon-sales"
version = "0.1.0"
description = "A data analysis project"
authors = [{ name = "Your Name" }]
dependencies = [
"jupyterlab",
"seaborn",
"pandas",
"numpy",
"scikit-learn"
]
10 changes: 10 additions & 0 deletions amazon_sales/requirements.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
fqdn==1.5.1
isoduration==20.11.0
jsonpointer==3.0.0
jupyterlab==4.4.3
pipdeptree==2.26.1
scikit-learn==1.6.1
seaborn==0.13.2
tinycss2==1.4.0
uri-template==1.3.0
webcolors==24.11.1
92 changes: 0 additions & 92 deletions back-propagation/back_progpagation_notes.ipynb

This file was deleted.

689 changes: 689 additions & 0 deletions back-propagation/back_propagation.ipynb

Large diffs are not rendered by default.

39 changes: 39 additions & 0 deletions back-propagation/data/X_test.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,39 @@
sepal length (cm),sepal width (cm),petal length (cm),petal width (cm)
6.2,2.8,4.8,1.8
6.7,3.1,4.7,1.5
5.0,3.5,1.3,0.3
6.5,3.0,5.2,2.0
5.7,3.0,4.2,1.2
5.9,3.0,4.2,1.5
4.7,3.2,1.3,0.2
5.7,2.8,4.5,1.3
5.5,2.4,3.8,1.1
4.9,2.5,4.5,1.7
4.6,3.2,1.4,0.2
6.2,2.2,4.5,1.5
6.9,3.2,5.7,2.3
5.4,3.0,4.5,1.5
4.7,3.2,1.6,0.2
4.8,3.4,1.6,0.2
4.9,3.1,1.5,0.1
6.7,2.5,5.8,1.8
5.4,3.4,1.7,0.2
4.4,3.2,1.3,0.2
5.8,2.7,3.9,1.2
6.3,2.3,4.4,1.3
4.4,3.0,1.3,0.2
5.8,2.7,5.1,1.9
5.0,3.6,1.4,0.2
7.7,2.6,6.9,2.3
6.0,3.0,4.8,1.8
7.1,3.0,5.9,2.1
7.7,3.8,6.7,2.2
6.6,3.0,4.4,1.4
6.4,3.2,5.3,2.3
5.0,2.0,3.5,1.0
6.0,2.2,5.0,1.5
6.4,2.7,5.3,1.9
6.7,3.0,5.0,1.7
6.1,3.0,4.6,1.4
5.6,2.8,4.9,2.0
6.1,2.8,4.0,1.3
113 changes: 113 additions & 0 deletions back-propagation/data/X_train.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,113 @@
sepal length (cm),sepal width (cm),petal length (cm),petal width (cm)
5.5,2.4,3.7,1.0
4.8,3.0,1.4,0.1
5.5,2.6,4.4,1.2
5.0,3.2,1.2,0.2
6.9,3.1,5.1,2.3
5.9,3.0,5.1,1.8
5.0,3.4,1.6,0.4
6.6,2.9,4.6,1.3
5.7,2.8,4.1,1.3
5.0,2.3,3.3,1.0
6.3,3.4,5.6,2.4
6.0,3.4,4.5,1.6
5.2,3.5,1.5,0.2
5.9,3.2,4.8,1.8
6.1,2.6,5.6,1.4
5.6,2.7,4.2,1.3
5.1,3.8,1.5,0.3
7.7,2.8,6.7,2.0
5.7,2.6,3.5,1.0
5.2,2.7,3.9,1.4
6.5,2.8,4.6,1.5
6.5,3.0,5.8,2.2
5.8,2.7,5.1,1.9
5.5,2.5,4.0,1.3
6.0,2.7,5.1,1.6
5.5,4.2,1.4,0.2
5.0,3.0,1.6,0.2
5.6,2.5,3.9,1.1
5.2,4.1,1.5,0.1
6.1,2.8,4.7,1.2
5.4,3.7,1.5,0.2
6.5,3.2,5.1,2.0
6.4,2.8,5.6,2.1
4.6,3.1,1.5,0.2
4.9,2.4,3.3,1.0
6.3,3.3,6.0,2.5
4.8,3.1,1.6,0.2
5.1,3.3,1.7,0.5
5.7,3.8,1.7,0.3
5.7,4.4,1.5,0.4
7.4,2.8,6.1,1.9
6.4,2.9,4.3,1.3
4.9,3.0,1.4,0.2
5.1,2.5,3.0,1.1
6.8,2.8,4.8,1.4
6.3,3.3,4.7,1.6
5.4,3.9,1.3,0.4
6.0,2.2,4.0,1.0
4.9,3.1,1.5,0.1
6.8,3.2,5.9,2.3
6.7,3.1,4.4,1.4
5.7,2.9,4.2,1.3
5.0,3.4,1.5,0.2
5.1,3.5,1.4,0.3
5.8,2.7,4.1,1.0
6.2,3.4,5.4,2.3
6.4,3.2,4.5,1.5
6.7,3.3,5.7,2.5
7.0,3.2,4.7,1.4
6.3,2.9,5.6,1.8
6.8,3.0,5.5,2.1
5.1,3.7,1.5,0.4
4.8,3.0,1.4,0.3
6.7,3.1,5.6,2.4
5.4,3.4,1.5,0.4
6.4,3.1,5.5,1.8
6.5,3.0,5.5,1.8
5.6,2.9,3.6,1.3
5.3,3.7,1.5,0.2
5.7,2.5,5.0,2.0
4.9,3.1,1.5,0.1
5.4,3.9,1.7,0.4
6.7,3.3,5.7,2.1
6.9,3.1,4.9,1.5
4.8,3.4,1.9,0.2
5.6,3.0,4.5,1.5
5.1,3.8,1.9,0.4
4.3,3.0,1.1,0.1
7.9,3.8,6.4,2.0
7.6,3.0,6.6,2.1
5.1,3.8,1.6,0.2
7.3,2.9,6.3,1.8
6.0,2.9,4.5,1.5
6.1,3.0,4.9,1.8
5.8,2.8,5.1,2.4
4.6,3.4,1.4,0.3
6.7,3.0,5.2,2.3
6.4,2.8,5.6,2.2
5.0,3.3,1.4,0.2
5.1,3.5,1.4,0.2
4.6,3.6,1.0,0.2
4.4,2.9,1.4,0.2
5.1,3.4,1.5,0.2
5.5,3.5,1.3,0.2
4.5,2.3,1.3,0.3
7.2,3.6,6.1,2.5
6.3,2.5,5.0,1.9
5.8,2.6,4.0,1.2
6.9,3.1,5.4,2.1
6.3,2.8,5.1,1.5
5.6,3.0,4.1,1.3
6.1,2.9,4.7,1.4
7.7,3.0,6.1,2.3
5.5,2.3,4.0,1.3
6.2,2.9,4.3,1.3
5.0,3.5,1.6,0.6
6.3,2.5,4.9,1.5
6.3,2.7,4.9,1.8
7.2,3.0,5.8,1.6
5.8,4.0,1.2,0.2
5.2,3.4,1.4,0.2
7.2,3.2,6.0,1.8
Loading