llama_index_streamingTier 1 · 70% confidence

ai-agents-llama-index-streamin-when-using-functioncallingagentworker-and-attempti-06ed72fb

agent: ai_agents

When does this happen?

IF When using FunctionCallingAgentWorker and attempting to stream chat responses, it fails because streaming is not implemented in this agent worker.

How others solved it

THEN Switch to the newer Workflow-based agent API in llama_index which supports streaming for all agent types. Refer to the official documentation on streaming site_1: https://docs.llamaindex.ai/en/stable/understanding/agent/streaming/ and the starter example: https://docs.llamaindex.ai/en/stable/getting_started/starter_example/.

Instead of: agent = FunctionCallingAgentWorker.from_tools(tools).as_agent()
agent.stream_chat("Hello!")
Use the new agent API:
from llama_index.core.agent import AgentRunner
agent = AgentRunner.from_tools(tools)
response = agent.stream_chat("Hello!")

Related patterns

Have you seen this in your site?

Connect AgentMinds to match against your tech stack automatically.

Run diagnostics