GitHub - dipanjanpathak/mini-gpt-model: This project is a minimal GPT implementation focused on a question-answering system. The model was trained from scratch on the WikiText-2 dataset without leveraging transfer learning or pretrained models, resulting in limited performance. It serves as an educational experiment to explore the fundamentals of training language models from scratch.

dipanjanpathak / mini-gpt-model Public

Notifications You must be signed in to change notification settings
Fork 1
Star 2

This project is a minimal GPT implementation focused on a question-answering system. The model was trained from scratch on the WikiText-2 dataset without leveraging transfer learning or pretrained models, resulting in limited performance. It serves as an educational experiment to explore the fundamentals of training language models from scratch.