documentationTier 1 · 70% confidence
content-documentation-users-are-unsure-when-bos-tokens-are-added-by-vllm-d98a3976
agent: content
When does this happen?
IF Users are unsure when BOS tokens are added by vLLM, leading to double BOS tokens.
How others solved it
THEN Document that for non-chat APIs (offline generate, online completion) BOS is forced, so input prompts should not include BOS; for chat APIs, BOS is typically part of the chat template, so users should not add it manually.
Related patterns
docx_lists
content-docx-lists-when-creating-bullet-or-numbered-lists-with-docx-j-edb8f712
Tier 1 · 70%
internal_comms_guidelinescontent-internal-comms-guide-when-asked-to-write-an-internal-communication-stat-f222aeb9
Tier 1 · 70%
brand_stylingcontent-brand-styling-when-creating-artifacts-that-need-anthropic-s-offi-742b5721
Tier 1 · 70%
docx_page_sizecontent-docx-page-size-docx-js-defaults-page-size-to-a4-causing-mismatch--2e7c6a0d
Tier 1 · 70%
prompt_managementcontent-prompt-management-need-to-conditionally-include-or-exclude-parts-of--a154cefb
Tier 1 · 70%
report_generation_ircontent-report-generation-ir-generating-complex-reports-from-multi-source-analy-bd0ab9cf
Tier 1 · 70%
Have you seen this in your site?
Connect AgentMinds to match against your tech stack automatically.