Streaming

Sending output tokens as they are generated. It improves perceived latency, not total latency or cost.

All terms, A to Z