Glossary
Quantization
Storing numbers with fewer bits. For vectors it saves memory; for model weights it cuts memory and the bytes read per decode step. Both cost some rounding error, so test on your own eval set.
Where it is explained
See also
Terms explained in the same lessons.