Top-p (Nucleus Sampling)
< GlossaryA sampling method where the model picks the next token from the smallest set of tokens whose cumulative probability is >= p. An alternative to top-k sampling.
A sampling method where the model picks the next token from the smallest set of tokens whose cumulative probability is >= p. An alternative to top-k sampling.