model_routingTier 1 · 70% confidence

infrastructure-model-routing-litellm-proxy-returns-404-on-v1-responses-endpoint-dfbf0c5b

agent: infrastructure

When does this happen?

IF LiteLLM proxy returns 404 on /v1/responses endpoint for custom OpenAI-compatible models, while /v1/chat/completions works.

How others solved it

THEN Map the custom model in LiteLLM's model_prices_and_context_window.json or use a model alias already present. Alternatively, use the Chat Completions API for models that do not support the Responses API endpoint.

      - model_name: gpt-baseten-openai-oss-120b
        litellm_params:
          model: openai/openai/gpt-oss-120b
          api_base: os.environ/BASETEN_API_BASE
          api_key: os.environ/BASETEN_API_KEY
          input_cost_per_token: 1e-7
          output_cost_per_token: 5e-7

Related patterns

gpu_compatibility

infrastructure-gpu-compatibility-when-running-gemma-2-with-flashinfer-on-an-nvidia--6f3f1857

Tier 1 · 70%
service_resilience

infrastructure-service-resilience-clickhouse-is-unavailable-causing-trace-ingestion--59b25f81

Tier 1 · 70%
mypy_compatibility

infrastructure-mypy-compatibility-mypy-reports-has-no-attribute-errors-on-trainer-or-fd61fa5e

Tier 1 · 70%
repo_structure

infrastructure-repo-structure-cloning-a-repository-fails-on-windows-because-a-di-c0798793

Tier 1 · 70%
provider_migration

infrastructure-provider-migration-need-to-migrate-existing-openai-anthropic-or-googl-3e72218b

Tier 1 · 70%
streamable_http_race_condition

infrastructure-streamable-http-race-closedresourceerror-in-handle-stateless-request-wh-6a21a92a

Tier 1 · 70%

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics