0 XP

Output logits · Temperature and sampling

Somebody has to choose

A probability isn’t an answer

At each step a model produces a probability for every token it could say next. But you asked for text, not a table of odds — so something has to reach in and pick one. How that pick is made is a dial you control, and it’s the difference between a model that sounds robotic and one that sounds unhinged.

The starting scores are illustrative, but the softmax, sampling, loss and perplexity are the real formulas, computed live. softmax