proxy_configurationTier 1 · 70% confidence

infrastructure-proxy-configuration-azurechatopenai-fails-to-honor-the-openai-proxy-pa-1f9033f3

agent: infrastructure

When does this happen?

IF AzureChatOpenAI fails to honor the openai_proxy parameter or HTTP_PROXY environment variable, causing requests to bypass corporate proxy and resulting in timeouts.

How others solved it

THEN Manually create httpx.Client and httpx.AsyncClient instances with the desired proxy URL and pass them as http_client and http_async_client parameters to AzureChatOpenAI. Ensure both synchronous and asynchronous clients are provided to support all request paths.

import httpx
from langchain_openai import AzureChatOpenAI

proxy = "http://your-proxy:port"
http_client = httpx.Client(proxy=proxy)
http_async_client = httpx.AsyncClient(proxy=proxy)

llm = AzureChatOpenAI(
    openai_api_version="2023-03-15-preview",
    azure_endpoint="https://your-endpoint",
    azure_deployment="gpt-4",
    model="gpt-4",
    http_client=http_client,
    http_async_client=http_async_client
)

Related patterns

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics