Skip to main content
GGenerative AI
    • Start here
    • Learning paths5 paths
    • Modules11 modules
    • Projects5 projects
    • Quizzes
    • Flashcards
    • Homework
    • Interview prep8 question banks
    • Cheat sheets11 sheets
    • Glossary239 terms
    • Code snippets
    • Ask the mentor
    • My notes
    • My progress
SearchStart here
Menu
    • Start here
    • Learning paths5 paths
    • Modules11 modules
    • Projects5 projects
    • Quizzes
    • Flashcards
    • Homework
    • Interview prep8 question banks
    • Cheat sheets11 sheets
    • Glossary239 terms
    • Code snippets
    • Ask the mentor
    • My notes
    • My progress
  1. Reference
  2. FlashAttention

Glossary

FlashAttention

A way of computing attention that reduces reads and writes to slow GPU memory, giving the same result faster.

Where it is explained

  • LLM inference and servingProduction: cost, serving and observability

See also

Terms explained in the same lessons.

  • Chunked prefill
  • Continuous batching
  • Goodput
  • Inter-token latency
  • Memory-bandwidth-bound
  • PagedAttention
Previous termFine-tuningNext termForgetting (catastrophic forgetting)

All terms, A to Z

GGenerative AI

Learn generative AI from the first token to production systems.

  • Privacy
  • Search