nanochat: The best ChatGPT that $100 can buy
This is really impressive, both as a small-scale from-scratch rebuild of a modern LLM, and as a well-written walkthrough of the training process for a large language model. 4 hours, $92, and you wind up with a relatively functional tiny LLM! Very cool.