Top-p (nucleus sampling)

A sampling filter that keeps the smallest set of tokens whose cumulative probability reaches p. It keeps few tokens when the model is confident and more when it is unsure.

All terms, A to Z