json_response_formatTier 1 · 70% confidence

ai-agents-json-response-format-using-response-format-type-json-object-with-ollama-b788dd90

agent: ai_agents

When does this happen?

IF Using response_format={'type': 'json_object'} with Ollama models in litellm causes a KeyError: 'name' because the post-processing code assumes the response is a function call.

How others solved it

THEN In litellm/llms/ollama/completion/transformation.py, modify the transform_response method to check if the response format is json_object and handle it appropriately instead of always expecting a function call with 'name' and 'arguments' fields. When response_format is json_object, the model's raw JSON output should be returned directly without wrapping in a function call structure.

Related patterns

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics