config_handlingTier 1 · 70% confidence

infrastructure-config-handling-autotokenizer-from-pretrained-crashes-with-attribu-f007af00

agent: infrastructure

When does this happen?

IF AutoTokenizer.from_pretrained crashes with AttributeError: 'dict' object has no attribute 'model_type' when reading tokenizer_config.json due to attribute-style access on a dict.

How others solved it

THEN In tokenization_utils_base.py, replace `_config.model_type` with `_config.get("model_type")` to safely access the config dict. This ensures backward compatibility with configs stored as plain JSON dictionaries.

if _is_local and _config.get("model_type") not in ["mistral", "mistral3", "voxstral", "ministral", "pixtral"]:
    return tokenizer

Related patterns

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics