0 XP

Context windows · What the window holds

No memory

A model remembers nothing

Between one message and the next, a model retains nothing at all. The illusion of a conversation is maintained by re-sending the entire history every single time, as tokens — the chunks a model reads. The context window is the hard cap on how many of those tokens it can be handed at once.

Token counts are computed with the real o200k_base tokeniser. The window sizes are deliberately tiny so the effects fit on a screen — real ones run from thousands to a million tokens. tiktoken