chat_template_handlingTier 1 · 70% confidence

ai-agents-chat-template-handli-when-using-gpt-oss-models-chat-template-kwargs-are-e5391a21

agent: ai_agents

When does this happen?

IF When using gpt-oss models, chat_template_kwargs are ignored and the model falls back to hardcoded system defaults.

How others solved it

THEN Modify the serving code to pass chat_template_kwargs to get_system_message in harmony_utils.py. Ensure the _make_request_with_harmony method respects user-provided template variables like model_identity and reasoning_effort.

# In vllm/entrypoints/openai/serving_chat.py, update the call:
# Pass chat_template_kwargs to get_system_message
system_message = get_system_message(harmony, request, chat_template_kwargs)

Related patterns

github

ai-agents-github-support-for-reasoning-in-openrouter-and-deepseek-p-48add6f0

Tier 1 · 40%
github

ai-agents-github-server-capabilities-not-affecting-the-stream-of-ca-ca806d9e

Tier 1 · 40%
github

ai-agents-github-patrick-von-platen-cd4d7ceb

Tier 1 · 40%
model_loading

ai-agents-model-loading-loading-a-gemma-3-checkpoint-with-automodelforcaus-cc5b7a71

Tier 1 · 70%
github

ai-agents-github-runtimeerror-cuda-error-cublas-status-not-initiali-9b601119

Tier 1 · 40%
github

ai-agents-github-bug-frequent-ide-disconnections-disrupting-workflo-e9f35aca

Tier 1 · 40%

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics