5Systems of agents

Parallelization

Run independent subtasks or repeated attempts at once, then combine the results.

Also called Concurrent orchestration, Fan-out/fan-in, Scatter-gather, Map-reduce, Concurrent pattern

Anthropic, Microsoft, Amazon Web Services, Google Cloud

TaskLLM callLLM callLLM callOutputsaggregatedResult
How to read this

The problem

The subtasks are independent, or one answer is not enough to trust.

Parallelization is effective when the divided subtasks can be parallelized for speed, or when multiple perspectives or attempts are needed for higher confidence results.
AnthropicBuilding effective AI agentsDec 19, 2024

Therefore

LLMs can sometimes work simultaneously on a task and have their outputs aggregated programmatically.
AnthropicBuilding effective AI agentsDec 19, 2024
The concurrent orchestration pattern runs multiple AI agents simultaneously on the same task.
MicrosoftAI agent orchestration patterns
This workflow involves breaking down a task into independent subtasks that can be handled concurrently by multiple LLM calls or agents. Outputs are then programmatically aggregated and synthesized into a result.
Amazon Web ServicesWorkflow for parallelization

In use

Claude Research

For speed, we introduced two kinds of parallelization: (1) the lead agent spins up 3-5 subagents in parallel rather than serially; (2) the subagents use 3+ tools in parallel. These changes cut research time by up to 90% for complex queries, allowing Research to do more work in minutes instead of hours while covering more information than other systems.
AnthropicHow we built our multi-agent research systemJun 13, 2025

Where it breaks

Parallel calls cost more, cannot see each other’s work, and may return results that conflict.

There's no clear conflict resolution strategy to handle contradictory or conflicting results from each agent.
MicrosoftAI agent orchestration patterns
Running multiple agents in parallel can increase immediate resource utilization and token consumption, which leads to higher operational costs. Furthermore, the gather step requires complex logic to synthesize potentially conflicting results, which adds to the development and maintenance overhead of the system.
Google CloudChoose a design pattern for your agentic AI system

Sources

  1. Building effective AI agentsAnthropic, Dec 19, 2024
  2. How we built our multi-agent research systemJeremy Hadfield, Barry Zhang, Kenneth Lien, Florian Scholz, Jeremy Fox, and Daniel Ford, Anthropic, Jun 13, 2025
  3. AI agent orchestration patternsMicrosoft
    The concurrent orchestration is also known as parallel, fan-out/fan-in, scatter-gather, or map-reduce.
  4. Workflow for parallelizationAmazon Web Services
  5. Choose a design pattern for your agentic AI systemGoogle Cloud
    multi-agent parallel pattern, also known as a concurrent pattern

Added Nov 14, 2026