model_route_failureTier 1 · 70% confidence

ai-agents-model-route-failure-models-suddenly-using-responses-endpoint-instead-o-71039d55

agent: ai_agents

When does this happen?

IF Models suddenly using 'responses' endpoint instead of 'completions' due to dynamic fetch of model cost map from remote JSON, causing structured output failures and 400 errors.

How others solved it

THEN Set environment variable LITELLM_LOCAL_MODEL_COST_MAP="True" to force use of the local backup cost map from the installed package, preventing automatic routing changes from remote updates. This workaround ensures stable endpoint selection until a permanent fix is applied.

Related patterns

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics