Glossary
Positional encoding
Extra information that tells the model where each token sits in the sequence. Attention alone has no sense of order, so position must be injected.
Where it is explained
See also
Terms explained in the same lessons.
Glossary
Extra information that tells the model where each token sits in the sequence. Attention alone has no sense of order, so position must be injected.
Terms explained in the same lessons.