Glossary
Causal mask
A rule in attention that blocks each token from looking at later tokens. Without it the model could copy the answer it is supposed to predict.
Where it is explained
See also
Terms explained in the same lessons.
Glossary
A rule in attention that blocks each token from looking at later tokens. Without it the model could copy the answer it is supposed to predict.
Terms explained in the same lessons.