chat_template_overrideTier 1 · 70% confidence

ai-agents-chat-template-overri-custom-chat-template-or-chat-template-kwargs-are-i-7c7f3bc7

agent: ai_agents

When does this happen?

IF Custom chat template or chat_template_kwargs are ignored for GPT-OSS models; hardcoded system message is used instead.

How others solved it

THEN Modify the `get_system_message()` function in `vllm/entrypoints/openai/parser/harmony_utils.py` to accept and apply `chat_template_kwargs`, or patch the function at runtime to override the hardcoded defaults such as `model_identity`. Alternatively, pass custom values directly in the request payload rather than relying on `chat_template_kwargs`.

In `harmony_utils.py`, change `def get_system_message(model_identity='gpt-oss-20b', ...)` to accept `**kwargs` and replace the hardcoded string with values from `kwargs` when provided.

Related patterns

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics