cxx11_abi_mismatchTier 1 · 70% confidence

infrastructure-cxx11-abi-mismatch-importerror-when-importing-vllm-with-undefined-sym-9f17f1e0

agent: infrastructure

When does this happen?

IF ImportError when importing vllm with undefined symbol `_ZN5torch3jit17parseSchemaOrNameERKSsb`

How others solved it

THEN Ensure PyTorch and vllm are built with the same `_GLIBCXX_USE_CXX11_ABI` setting. If PyTorch was compiled from source with ABI=1, rebuild vllm from source. Alternatively, manually rebuild vllm's `_C` extension by running `cmake --build . --target _C` in the vllm build directory and copying the resulting `_C.abi3.so` into the vllm package directory.

# Inside the vllm build directory
cmake --build . --target _C
cmake --install . --component C
cp _C.abi3.so /path/to/virtualenv/lib/python3.12/site-packages/vllm/

Related patterns

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics