Multi-agent Workflow Using Tavily

At a glance

The community member has implemented a Multi-Agent Workflow using Tavily, but it is very slow compared to Tavily's own Research Assistant. The multi-agent workflow takes around a minute to provide a report on the same topic, whereas Tavily's Research Assistant does it within seconds. The community member is using Azure OpenAI's GPT4o as the LLM in all agents and is asking for any bottlenecks or strategies to speed up the workflow.

The comments suggest that the example is a little contrived, and the same can be accomplished with a single agent. The comments also mention that the need to make tool calls to save the notes, report, review, and possibly pass them back to the writer will slow things down compared to a single agent making Tavily calls and writing an output to return directly to the user. One community member provides a code example of a single agent workflow that may get the job done.

Useful resources

TThe Mighty Wolfie

Hi. I have implemented this Multi-Agent Workflow using Tavily https://docs.llamaindex.ai/en/stable/examples/agent/agent_workflow_multi/

But it is very slow compared to Tavily's own Research Assistant on their website.

This multi-agent workflow takes around a minute to provide a report on the same topic whereas Tavily's Research Assistant does it within seconds.

I am using Azure OpenAI's GPT4o as the LLM in all agents.

Are there any bottlenecks that are present or any strategies I can use to speed up this workflow?

5 comments

LLogan M

this example is admittedly a little contrived, but was trying to make something simple that showed the concepts

LLogan M

You can accomplish the same with a single agent

LLogan M

Needing to make tool calls to save the notes, report, review (and possibly passing back to the writer after the review) will all slow things down compared to a single agent making tavily calls and writing an output to return directly to the user

LLogan M

Plain Text

agent = AgentWorkflow.from_tools_or_functions(
  [search_web],
  llm=llm,
  system_prompt="You are an expert report writer that will use a web search tool to help gather information to write the report requested by the user."
)

LLogan M

That will probably get the job done

Add a reply

Find answers from the community

Multi-agent Workflow Using Tavily