Concept

Sampling temperature

A parameter that rescales a model's output probabilities before a token is drawn; lower values make generation more deterministic, and a temperature of zero always takes the most likely token (greedy decoding).