Resource	Limit	Description
Context window size in tokens	200,000	The maximum number of tokens a model can reference plus subsequently generate.
Requests per minute	100	The number of prompts sent to any model in any given minute.
Tokens per minute	50,000	The maximum number of tokens that a single model can process each minute.
Inference time in minutes	5	The maximum time a model can process and generate responses before a timeout occurs, assuming the Async events API is used with a specified timeout equal or greater than 5 minutes. Otherwise the specified or default timeouts apply.