Transformer

The neural network design behind modern LLMs. Stacked blocks of self-attention and feedforward layers process all positions of the input in parallel during training and prefill.

All terms, A to Z