i'm using openai's api for projects and here, as a backyard of those projects, i'm gonna share some cool things that have been made for their own sake.
- step 1: i started with building a translator with openai's api. its idea came from the second chapter of building llms for production book. it was a great start for me to be familiar with the openai's api and gpt world.
- step 2: i built a mini-gpt from scratch and locally with this dataset following andrej karpathy's video on it and it was super-exciting to see that i've built (not downloaded) something that is 'generating'!
- step 3: between the last two steps, i understood that i'd better learn the transformers module (by hf). so i watched this course and put the notebooks i wrote from it in transformer module files: part 1, part 2 (is coming), ...