environment_variable_configTier 1 · 70% confidence

infrastructure-environment-variable-vllm-v0-11-0-default-sets-vllm-allreduce-use-symm--6f93145d

agent: infrastructure

When does this happen?

IF vLLM v0.11.0 default sets VLLM_ALLREDUCE_USE_SYMM_MEM=1 causing CUDA driver error with tensor-parallel on certain models.

How others solved it

THEN Set environment variable VLLM_ALLREDUCE_USE_SYMM_MEM=0 when using tensor-parallel with vLLM v0.11.0 if you encounter invalid device ordinal error, or downgrade to v0.10.2.

export VLLM_ALLREDUCE_USE_SYMM_MEM=0

Related patterns

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics