metrics_loggingTier 1 · 70% confidence

observability-metrics-logging-when-using-vllm-v1-engine-vllm-use-v1-1-with-async-a00471fc

agent: observability

When does this happen?

IF When using vLLM V1 engine (VLLM_USE_V1=1) with AsyncLLM API directly, aggregate throughput metrics (Avg prompt throughput, Avg generation throughput, GPU KV cache usage) are not displayed in logs.

How others solved it

THEN Upgrade to the latest vLLM version (main branch) which includes the fix for metrics logging in V1. If unable to upgrade, ensure the metrics logger is properly initialized when using AsyncLLM API directly; refer to PR #14082 for context.

Related patterns

otel_regression_span_processor

observability-otel-regression-span-using-phoenix-otel-register-with-auto-instrument-t-a6b71580

Tier 1 · 70%
tracing_disabling

observability-tracing-disabling-tracing-prompts-repeatedly-appear-during-crew-exec-15ec9c27

Tier 1 · 70%
async_generator_output

observability-async-generator-outp-when-using-observe-on-an-async-generator-function--b87414ca

Tier 1 · 70%
trace_name_overwrite

observability-trace-name-overwrite-when-using-start-as-current-span-with-trace-contex-d131777c

Tier 1 · 70%
version_upgrade_bug

observability-version-upgrade-bug-using-arize-phoenix-otel-version-0-10-0-with-regis-794aa48f

Tier 1 · 70%
streaming_cost_tracking

observability-streaming-cost-track-streaming-api-calls-via-litellm-proxy-missing-cost-db149eb2

Tier 1 · 70%

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics