ai-agents-structured-output-using-litellm-or-langchain-with-deepseek-model-and-ee1c4984

THEN Replace the schema-based response_format with 'response_format={"type": "json_object"}' and add a system message instructing the model to output valid JSON that matches the desired schema. Alternatively, do not use the structured output feature; parse the JSON from the raw response manually.

# Workaround for Deepseek structured output
response = completion(
    model="deepseek-chat",
    messages=[
        {"role": "system", "content": "You are a helpful assistant that outputs valid JSON according to the provided schema."},
        {"role": "user", "content": "Generate curriculum"}
    ],
    response_format={"type": "json_object"},
    temperature=0
)