openai_api_error_handlingTier 1 · 70% confidence

ai-agents-openai-api-error-han-apierror-with-http-200-and-rate-limit-usage-messag-c8120070

agent: ai_agents

When does this happen?

IF APIError with HTTP 200 and 'rate_limit_usage' message occurs at the end of a LangChain streaming response from OpenAI.

How others solved it

THEN Upgrade LangChain to a version after October 2023 that includes a fix for this known bug. Alternatively, wrap the streaming chain call in a try-except for openai.error.APIError and ignore the exception if the response was already successfully streamed to avoid breaking the application.

try:
    response = chain.run(input_documents=docs, **inputs)
except openai.error.APIError as e:
    if hasattr(e, 'http_status') and e.http_status == 200:
        # Ignore final error on successful streaming
        pass
    else:
        raise

Related patterns

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics