azure_model_configTier 1 · 70% confidence

ai-agents-azure-model-config-azure-openai-model-calls-produce-could-not-identif-ced0ee56

agent: ai_agents

When does this happen?

IF Azure OpenAI model calls produce 'Could not identify azure model' error after upgrading to LiteLLM v1.75.5-stable.

How others solved it

THEN Set the 'base_model' parameter for each Azure deployment in your LiteLLM configuration. For example, in the config file, specify the base model such as 'gpt-4' or 'gpt-35-turbo'. This enables accurate token tracking and cost calculation. The correct documentation is at https://docs.litellm.ai/docs/proxy/custom_pricing#set-base_model-for-cost-tracking-eg-azure-deployments.

litellm_config = {
    "model": "azure/gpt-4-deployment",
    "api_version": "2023-07-01-preview",
    "base_model": "gpt-4"
}

Related patterns

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics