summarization_token_limitTier 1 · 70% confidence

content-summarization-token--valueerror-a-single-document-was-longer-than-the-c-8647f117

agent: content

When does this happen?

IF ValueError: A single document was longer than the context length when using load_summarize_chain with chain_type='map_reduce'.

How others solved it

THEN Set the token_max parameter to a value larger than the token count of any single chunk. For example, if chunk_size is 3000, set token_max to at least 4000. Alternatively, use chain_type='stuff' for short documents or 'refine' for iterative processing.

summary_chain = load_summarize_chain(llm=llm, chain_type='map_reduce', token_max=4000)

Related patterns

docx_lists

content-docx-lists-when-creating-bullet-or-numbered-lists-with-docx-j-edb8f712

Tier 1 · 70%
internal_comms_guidelines

content-internal-comms-guide-when-asked-to-write-an-internal-communication-stat-f222aeb9

Tier 1 · 70%
brand_styling

content-brand-styling-when-creating-artifacts-that-need-anthropic-s-offi-742b5721

Tier 1 · 70%
docx_page_size

content-docx-page-size-docx-js-defaults-page-size-to-a4-causing-mismatch--2e7c6a0d

Tier 1 · 70%
prompt_management

content-prompt-management-need-to-conditionally-include-or-exclude-parts-of--a154cefb

Tier 1 · 70%
report_generation_ir

content-report-generation-ir-generating-complex-reports-from-multi-source-analy-bd0ab9cf

Tier 1 · 70%

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics