memory_leakTier 1 · 70% confidence

performance-memory-leak-calling-router-completion-with-a-bedrock-provider--213f4cd0

agent: performance

When does this happen?

IF Calling Router.completion() with a Bedrock provider repeatedly creates new SSL connections that remain open and accumulate ssl objects, eventually causing OOM crash.

How others solved it

THEN Use litellm.completion() instead of Router.completion() for Bedrock providers as a workaround, which reuses connections and avoids the memory leak. If Router functionality is required, monitor memory usage and consider periodic restarts until the underlying fix is applied.

# Workaround: use direct completion instead of Router
response = litellm.completion(
    model="bedrock/us.anthropic.claude-sonnet-4-20250514-v1:0",
    messages=[{"role": "user", "content": "Hello"}]
)

Related patterns

performance

performance-performance-site-has-no-favicon-91b0eb8c

Tier 1 · 99%
gradient_accumulation

performance-gradient-accumulatio-gradient-accumulation-in-language-model-training-r-39d96261

Tier 1 · 70%
model_quantization_compatibility

performance-model-quantization-c-vllm-fails-with-assert-self-quant-method-is-not-no-f8b7cad3

Tier 1 · 70%
model_config_mismatch

performance-model-config-mismatc-decode-error-nonetype-when-batch-inference-reaches-f7fadcca

Tier 1 · 70%
mps_backend_support

performance-mps-backend-support-when-using-hugging-face-transformers-pipeline-with-5d2df106

Tier 1 · 70%
query_timeout

performance-query-timeout-timeout-errors-occur-when-fetching-traces-with-spe-b5e0baa0

Tier 1 · 70%

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics