Aldridge M   •   over 1 year ago

call rate limit exceeded

Hi i am getting this error using the Azure AI proxy playground: "Requests to the ChatCompletions_Create Operation under Azure OpenAI API version 2024-02-01 have exceeded call rate limit"
how can i fix?
Thanks

• 1 comment
• 

  Jasmine Greenaway   •   over 1 year ago

  Hello! You can retry calling the service after a few minutes, maybe give it an hour. Or you may need to manage your token counts.

  This error often occurs because a large number of calls to the Azure OpenAI Service in a short period of time, or the number of tokens exceeds the limit. Check out this list for best practices in managing rate limits: https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/quota?tabs=rest#rate-limit-best-practices

Comments are closed.