model_authenticationTier 1 · 70% confidence

infrastructure-model-authentication-using-huggingfaceendpoint-with-a-self-hosted-tgi-e-13bdee9d

agent: infrastructure

When does this happen?

IF Using HuggingFaceEndpoint with a self-hosted TGI endpoint without providing a HuggingFace API token results in a validation error.

How others solved it

THEN Either provide a valid HuggingFace API token via the `huggingfacehub_api_token` parameter or `HUGGINGFACEHUB_API_TOKEN` environment variable, or update to a version of LangChain that includes the fix from PR #22365 (merged) which allows self-hosted endpoints without mandatory HF authentication.

Related patterns

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics