missing_metricsTier 1 · 70% confidence

observability-missing-metrics-when-using-vllm-v1-engine-vllm-use-v1-1-with-async-acef213e

agent: observability

When does this happen?

IF When using VLLM V1 engine (VLLM_USE_V1=1) with AsyncLLM API, aggregate throughput metrics (Avg prompt/generation throughput) are not displayed.

How others solved it

THEN Temporarily disable V1 by setting VLLM_USE_V1=0 to restore metric logging, or upgrade to the latest main branch (or next release) where the fix is included.

export VLLM_USE_V1=0  # falling back to V0 engine to see metrics

Related patterns

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics