structured_output_compatibilityTier 1 · 70% confidence

ai-agents-structured-output-co-using-a-pydantic-model-as-response-format-or-with--9f25ba16

agent: ai_agents

When does this happen?

IF Using a Pydantic model as response_format (or with_structured_output) with deepseek-chat via LiteLLM or LangChain causes BadRequestError because Deepseek does not support json_schema.

How others solved it

THEN Replace response_format with {'type': 'json_object'} and add instructions in the system message to output JSON matching the expected schema. Alternatively, use a model like Llama 3.3 that supports json_schema.

from litellm import completion
response = completion(
    model='deepseek-chat',
    messages=[{'role': 'system', 'content': 'Output JSON with fields: topic (string), subtopics (list of strings)'}, {'role': 'user', 'content': '...'}],
    response_format={'type': 'json_object'}
)

Related patterns

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics