Glossary
Query, key and value (Q, K, V)
Three vectors computed for each token in attention. Queries are compared with keys to get weights, and the weights mix the values.
Where it is explained
See also
Terms explained in the same lessons.
Glossary
Three vectors computed for each token in attention. Queries are compared with keys to get weights, and the weights mix the values.
Terms explained in the same lessons.