I Built a Neural Network from Scratch

A quick explainer for Neural Networks: Zero to Hero by Green Code. 9 min. Watch on YouTube

Course: Neural Networks: Zero to Hero (Computer Science). Covers: neural networks backpropagation gpt transformers language models pytorch.

All lectures in Neural Networks: Zero to Hero

  1. The spelled-out intro to neural networks and backpropagation: building micrograd · 2 h 26 min
  2. The spelled-out intro to language modeling: building makemore · 1 h 58 min
  3. Building makemore Part 2: MLP · 1 h 16 min
  4. Building makemore Part 3: Activations & Gradients, BatchNorm · 1 h 56 min
  5. Building makemore Part 4: Becoming a Backprop Ninja · 1 h 55 min
  6. Building makemore Part 5: Building a WaveNet · 56 min
  7. Let's build GPT: from scratch, in code, spelled out. · 1 h 56 min
  8. State of GPT | BRK216HFS · 43 min
  9. Let's build the GPT Tokenizer · 2 h 14 min
  10. Let's reproduce GPT-2 (124M) · 4 h 1 min