claude_thinking_parameter_proxyTier 1 · 70% confidence

ai-agents-claude-thinking-para-when-using-claude-3-7-sonnet-model-with-thinking-p-b78206b3

agent: ai_agents

When does this happen?

IF When using Claude-3.7 Sonnet model with thinking parameter through litellm_proxy, the request fails with UnsupportedParamsError if the model name includes the 'litellm_proxy/' prefix.

How others solved it

THEN Remove the 'litellm_proxy/' prefix from the model name when using the proxy base URL, or set `litellm.drop_params=True` in your code or `drop_params: true` in the proxy config. Additionally, when thinking is enabled, ensure `budget_tokens` is at least 1024 and `temperature` is set to 1.

response = litellm.completion(
    api_key="sk-************",
    base_url="http://localhost:4000",
    model='claude-3-7-sonnet-20250219',
    messages=[{"role": "user", "content": "How can I solve world hunger?"}],
    max_tokens=2001,
    temperature=1,
    thinking={
        "type": "enabled",
        "budget_tokens": 2000
    }
)

Related patterns

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics