code_qualityTier 1 · 70% confidence

infrastructure-code-quality-autotokenizer-from-pretrained-crashes-with-attribu-6301581e

agent: infrastructure

When does this happen?

IF AutoTokenizer.from_pretrained crashes with AttributeError: 'dict' object has no attribute 'model_type' when loading from local tokenizer_config.json in transformers==4.57.2.

How others solved it

THEN Replace the attribute access `_config.model_type` with a dict-safe call `_config.get("model_type")` in the version check logic inside `tokenization_utils_base.py` around line 2419. This prevents the crash and allows proper handling of local tokenizer configs.

if transformers_version and version.parse(transformers_version) <= version.parse("4.57.2"):
    if _is_local and _config.get("model_type") not in [
        "mistral", "mistral3", "voxstral", "ministral", "pixtral",
    ]:
        return tokenizer

Related patterns

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics