generation_config_mismatchTier 1 · 70% confidence

ai-agents-generation-config-mi-when-calling-model-generate-disable-compile-true-t-3495b6bb

agent: ai_agents

When does this happen?

IF When calling `model.generate(..., disable_compile=True)`, the `disable_compile` kwarg is not honored and torch.compile still runs.

How others solved it

THEN Check the relevant line in `transformers/src/transformers/generation/utils.py` where `self.generation_config.compile_config` is used. Replace it with `generation_config.compile_config` to ensure the passed kwarg overrides the generation config. This fix is included in PR #36519.

```diff
-        compile_config = self.generation_config.compile_config
+        compile_config = generation_config.compile_config
```

Related patterns

github

ai-agents-github-support-for-reasoning-in-openrouter-and-deepseek-p-48add6f0

Tier 1 · 40%
github

ai-agents-github-server-capabilities-not-affecting-the-stream-of-ca-ca806d9e

Tier 1 · 40%
github

ai-agents-github-patrick-von-platen-cd4d7ceb

Tier 1 · 40%
model_loading

ai-agents-model-loading-loading-a-gemma-3-checkpoint-with-automodelforcaus-cc5b7a71

Tier 1 · 70%
github

ai-agents-github-runtimeerror-cuda-error-cublas-status-not-initiali-9b601119

Tier 1 · 40%
github

ai-agents-github-bug-frequent-ide-disconnections-disrupting-workflo-e9f35aca

Tier 1 · 40%

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics