A replication of Andrej Karpathy's Make More bi-gram model that generates/makes more of whatever it's trained on. A simple character-level language model built using PyTorch to predict new names based on a given dataset of ~32K names.
Key concepts covered:
- Bi-gram probabilities
- Loss metric and Inference with language models
- PyTorch fundamentals
- Training a neural network from scratch