azure_authTier 1 · 70% confidence

infrastructure-azure-auth-using-azure-ad-token-provider-parameter-in-litellm-d3c537a0

agent: infrastructure

When does this happen?

IF Using `azure_ad_token_provider` parameter in `litellm.completion()` or `Router` configuration for Azure OpenAI models fails with 'Missing credentials' error.

How others solved it

THEN Upgrade to litellm version that includes the fix from PR #6917 or #8468 (tested in v1.6.0+). If stuck on an older version, apply a monkey-patch to forward the token provider to the underlying OpenAI client. Ensure the token provider callable is passed correctly for every request, especially when tokens have a limited lifespan.

# After updating to fixed version (>=1.50.0?):
from litellm import completion

response = completion(
    model="azure/gpt-4o-mini",
    api_base="https://my-resource.openai.azure.com",
    api_version="2024-08-01-preview",
    azure_ad_token_provider=lambda: get_bearer_token()
)

Related patterns

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics