ai-agents-auth-validation-huggingfaceendpoint-throws-a-pydantic-validationer-510a6057

THEN Set the HUGGINGFACEHUB_API_TOKEN environment variable to a valid (or dummy) token before instantiating HuggingFaceEndpoint when using a self-hosted TGI endpoint. Alternatively, use the deprecated HuggingFaceTextGenInference class, which does not require authentication. For a code fix, modify the HuggingFaceEndpoint validator to skip authentication if endpoint_url is provided and no inferen-ce_server_url or huggingfacehub_api_token is explicitly set.

import os
os.environ['HUGGINGFACEHUB_API_TOKEN'] = 'dummy_token'  # workaround
from langchain_community.llms import HuggingFaceEndpoint
llm = HuggingFaceEndpoint(endpoint_url='http://localhost:8080', streaming=True)