bedrock_claude3_llm_invocationTier 1 · 70% confidence

ai-agents-bedrock-claude3-llm--using-langchain-s-bedrock-llm-with-claude3-models--fc2ab165

agent: ai_agents

When does this happen?

IF Using LangChain's Bedrock LLM with Claude3 models (e.g., claude-3-sonnet-20240229) throws ValidationException: 'model is not supported on this API. Please use the Messages API instead.'

How others solved it

THEN When invoking a Claude3 model via AWS Bedrock, do not use the old Text Completions API format. Instead, use the Messages API format: include 'anthropic_version': 'bedrock-2023-05-31', a 'messages' array with 'role' and 'content' fields, an optional 'system' prompt, and 'max_tokens'. The old 'prompt' key is not supported.

{
  "max_tokens": 1024, 
  "system": "Today is January 1, 2024. Only respond in Haiku", 
  "messages": [{"role": "user", "content": "Hello, Claude"}], 
  "anthropic_version": "bedrock-2023-05-31"
}

Related patterns

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics