ai-agents-model-parameters-when-using-claude-3-7-sonnet-with-the-thinking-par-0bc34e12

THEN Omit the 'litellm_proxy/' prefix and pass the model name directly (e.g., 'claude-3-7-sonnet-20250219') to the proxy endpoint. Additionally, ensure 'budget_tokens' is set to at least 1024 and 'temperature' is set to 1 when 'thinking' is enabled.

import litellm
response = litellm.completion(
    api_key="sk-...",
    base_url="http://localhost:4000",
    model='claude-3-7-sonnet-20250219',  # no litellm_proxy/ prefix
    messages=[{"role": "user", "content": "Hello"}],
    max_tokens=2001,
    temperature=1,
    thinking={"type": "enabled", "budget_tokens": 2000}
)