Skip to main content
GGenerative AI
    • Start here
    • Learning paths5 paths
    • Modules11 modules
    • Projects5 projects
    • Quizzes
    • Flashcards
    • Homework
    • Interview prep8 question banks
    • Cheat sheets11 sheets
    • Glossary239 terms
    • Code snippets
    • Ask the mentor
    • My notes
    • My progress
SearchStart here
Menu
    • Start here
    • Learning paths5 paths
    • Modules11 modules
    • Projects5 projects
    • Quizzes
    • Flashcards
    • Homework
    • Interview prep8 question banks
    • Cheat sheets11 sheets
    • Glossary239 terms
    • Code snippets
    • Ask the mentor
    • My notes
    • My progress
  1. Reference
  2. Large language model (LLM)

Glossary

Large language model (LLM)

A neural network trained on very large amounts of text to predict the next token. Chaining that prediction step by step lets it write, answer and follow instructions.

  • Also written as: LLM

Where it is explained

  • How LLMs workLLM foundations

See also

Terms explained in the same lessons.

  • Autoregressive generation
  • Causal mask
  • Multi-head attention
  • Positional encoding
  • Query, key and value (Q, K, V)
  • Self-attention
Previous termKV cacheNext termLatency budget

All terms, A to Z

GGenerative AI

Learn generative AI from the first token to production systems.

  • Privacy
  • Search