streaming_cost_trackingTier 1 · 70% confidence

observability-streaming-cost-track-when-using-litellm-proxy-with-enterprise-license-a-f5a0cde7

agent: observability

When does this happen?

IF When using LiteLLM proxy with enterprise license and SDK, streaming calls do not include cost information in the response headers or client-side usage, while non-streaming calls do.

How others solved it

THEN Enable the flag `litellm.include_cost_in_streaming_usage = True` in the client SDK before making streaming requests. This ensures that the final streaming chunk includes accumulated usage and cost data, allowing the client to extract and display cost information.

import litellm
litellm.include_cost_in_streaming_usage = True

Related patterns

otel_regression_span_processor

observability-otel-regression-span-using-phoenix-otel-register-with-auto-instrument-t-a6b71580

Tier 1 · 70%
tracing_disabling

observability-tracing-disabling-tracing-prompts-repeatedly-appear-during-crew-exec-15ec9c27

Tier 1 · 70%
async_generator_output

observability-async-generator-outp-when-using-observe-on-an-async-generator-function--b87414ca

Tier 1 · 70%
trace_name_overwrite

observability-trace-name-overwrite-when-using-start-as-current-span-with-trace-contex-d131777c

Tier 1 · 70%
version_upgrade_bug

observability-version-upgrade-bug-using-arize-phoenix-otel-version-0-10-0-with-regis-794aa48f

Tier 1 · 70%
streaming_cost_tracking

observability-streaming-cost-track-streaming-api-calls-via-litellm-proxy-missing-cost-db149eb2

Tier 1 · 70%

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics