Core Concepts

What Is a Context Window?

The context window is the maximum amount of text — measured in tokens — that a language model can take into account at one time, including both the prompt and its response. Larger context windows let a model work with longer documents or conversations, which is why expanding context length has been a major area of competition.