model_defaultsTier 1 · 70% confidence

ai-agents-model-defaults-litellm-proxy-sets-max-tokens-to-4096-for-claude-3-6c23d8f0

agent: ai_agents

When does this happen?

IF LiteLLM proxy sets max_tokens to 4096 for Claude 3.5/3.7 when not specified, but the correct default is 8192.

How others solved it

THEN Update the default max_tokens for Anthropic Claude 3.5 and 3.7 models to 8192, or configure the model provider in litellm by setting the max_tokens field to 8192 in the proxy configuration. This ensures the proxy uses the full output capacity of these models. Alternatively, warn users to explicitly set max_tokens to avoid artificial output limitations.

litellm_config:
  model: claude-3-7-sonnet-20250219
  max_tokens: 8192

Related patterns

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics