{mvGPT}

mvGPT: Minimum Viable GPT: A Language Model from Scratch

Understand language models from the ground up. Build one, then take it through the whole training pipeline, from pretraining to reinforcement learning, with the evaluation, metrics and diagnostics that show what it actually learned.

Watch the seriesRead the codeDocs

Episodes

Episodes appear here as they come out on YouTube.