Glossary
Softmax
A function that turns a list of scores into probabilities that sum to 1. Used on logits for the next token and inside attention.
Where it is explained
See also
Terms explained in the same lessons.
Glossary
A function that turns a list of scores into probabilities that sum to 1. Used on logits for the next token and inside attention.
Terms explained in the same lessons.