infrastructure-offline-mode-cache-when-hf-hub-offline-1-is-set-autotokenizer-from-pr-31ed2ac2

THEN Modify the tokenizer loading logic to check the local cache (using huggingface_hub's cached file lookup) before attempting to make any network requests. If the tokenizer is cached, load it directly without calling the Hub API.

if not os.path.exists(cached_path) and os.environ.get('HF_HUB_OFFLINE') == '1':
    raise OfflineModeIsEnabled(...)
elif os.path.exists(cached_path):
    load from local cache
else:
    download normally