Context windows · When it overflows

Something has to give

The window doesn’t stretch

A model can only be handed so many tokens at once, and a conversation only grows. When it no longer fits, nothing clever happens by default: the oldest material is dropped so the newest still fits. The model isn’t told anything went missing.