Module 1Runs in your browser
Softmax, causal attention weights and KV-cache size
From the lesson How LLMs work.
Practice
Homework
4 short coding exercises. Each one is a Python starter file and some tests; 4 run right here in your browser, with nothing to install.
Module 1Runs in your browser
Build a tiny byte-pair-encoding tokenizer
From the lesson Tokenization and embeddings.
Module 2Runs in your browser
Build a few-shot prompt, vote on answers and measure a pass rate
From the lesson Prompting fundamentals.
Module 3Runs in your browser
Cosine similarity and nearest-neighbour search from scratch
From the lesson Embeddings and similarity search.