ai-agents-llm-structured-outpu-litellm-completion-with-response-format-returns-li-655bc922

THEN Set the environment variable LITELLM_LOCAL_MODEL_COST_MAP=True to use a local model cost map instead of the outdated cloud configuration. If the issue persists, update the system message to explicitly include a hint that the output must be JSON.

import os
os.environ["LITELLM_LOCAL_MODEL_COST_MAP"] = "True"
# Or run: export LITELLM_LOCAL_MODEL_COST_MAP=True