Skip to main content
GGenerative AI
    • Start here
    • Learning paths5 paths
    • Modules11 modules
    • Projects5 projects
    • Quizzes
    • Flashcards
    • Homework
    • Interview prep8 question banks
    • Cheat sheets11 sheets
    • Glossary239 terms
    • Code snippets
    • Ask the mentor
    • My notes
    • My progress
SearchStart here
Menu
    • Start here
    • Learning paths5 paths
    • Modules11 modules
    • Projects5 projects
    • Quizzes
    • Flashcards
    • Homework
    • Interview prep8 question banks
    • Cheat sheets11 sheets
    • Glossary239 terms
    • Code snippets
    • Ask the mentor
    • My notes
    • My progress
  1. Reference
  2. Byte-pair encoding (BPE)

Glossary

Byte-pair encoding (BPE)

A way to build a subword vocabulary by repeatedly merging the most frequent adjacent pair of symbols. Any text, even an unseen word, can then be written from a fixed set of pieces.

  • Also written as: BPE

Where it is explained

  • Tokenization and embeddingsLLM foundations

See also

Terms explained in the same lessons.

  • Embedding table
  • Token
  • Tokenizer
  • Vocabulary
  • Embedding
Previous termBPENext termCanary release

All terms, A to Z

GGenerative AI

Learn generative AI from the first token to production systems.

  • Privacy
  • Search