GlossaryAbbreviation
GQA
Short for grouped-query attention: query heads share key and value heads, which shrinks the KV cache.
- Full form: Grouped-query attention (GQA)
Where it is explained
See also
Terms explained in the same lessons.
GlossaryAbbreviation
Short for grouped-query attention: query heads share key and value heads, which shrinks the KV cache.
Terms explained in the same lessons.