structured_output_multi_turn_bugTier 1 · 70% confidence

ai-agents-structured-output-mu-using-gpt-oss-harmony-model-with-structured-output-17519e90

agent: ai_agents

When does this happen?

IF Using GPT-OSS (Harmony) model with structured outputs (json_schema, grammar) in multi-turn chat where history includes assistant messages causes chat.completions to return content: null.

How others solved it

THEN Downgrade to vLLM 0.10.1 or earlier. Alternatively, in the message history, change the role of the assistant message to 'user' and prefix with '[ASSISTANT message]:\n\n' to bypass the bug. Avoid using structured outputs in multi-turn conversations with GPT-OSS models.

chat_extended = [
    {"role": "user", "content": "[ASSISTANT message]:\n\n6, of course!"},
    {'role': 'user', 'content': 'No, try again. Respond with {"response": "<your answer>"}'}
]

Related patterns

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics