streaming_errorTier 1 · 70% confidence

ai-agents-streaming-error-using-litellm-acompletion-with-stream-true-and-str-ce0ab68a

agent: ai_agents

When does this happen?

IF Using litellm.acompletion with stream=True and stream_options={"include_usage": True} on Groq models causes an IndexError: list index out of range in the Databricks streaming parser.

How others solved it

THEN Remove the stream_options parameter entirely or set it to an empty dictionary in the model configuration to avoid the crash. Alternatively, disable include_usage.

# Workaround: set stream_options to empty dict in litellm_params
model_config = {
    "model": "groq/llama-3.3-70b-specdec",
    "litellm_params": {
        "stream_options": {}
    }
}

Related patterns

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics