Parallelization
Run independent subtasks or repeated attempts at once, then combine the results.
Also called Concurrent orchestration, Fan-out/fan-in, Scatter-gather, Map-reduce, Concurrent pattern
Anthropic, Microsoft, Amazon Web Services, Google Cloud
The problem
The subtasks are independent, or one answer is not enough to trust.
Parallelization is effective when the divided subtasks can be parallelized for speed, or when multiple perspectives or attempts are needed for higher confidence results.
Therefore
LLMs can sometimes work simultaneously on a task and have their outputs aggregated programmatically.
The concurrent orchestration pattern runs multiple AI agents simultaneously on the same task.
This workflow involves breaking down a task into independent subtasks that can be handled concurrently by multiple LLM calls or agents. Outputs are then programmatically aggregated and synthesized into a result.
In use
Claude Research
For speed, we introduced two kinds of parallelization: (1) the lead agent spins up 3-5 subagents in parallel rather than serially; (2) the subagents use 3+ tools in parallel. These changes cut research time by up to 90% for complex queries, allowing Research to do more work in minutes instead of hours while covering more information than other systems.
Where it breaks
Parallel calls cost more, cannot see each other’s work, and may return results that conflict.
There's no clear conflict resolution strategy to handle contradictory or conflicting results from each agent.
Running multiple agents in parallel can increase immediate resource utilization and token consumption, which leads to higher operational costs. Furthermore, the gather step requires complex logic to synthesize potentially conflicting results, which adds to the development and maintenance overhead of the system.
Sources
- Building effective AI agentsAnthropic, Dec 19, 2024
- How we built our multi-agent research systemJeremy Hadfield, Barry Zhang, Kenneth Lien, Florian Scholz, Jeremy Fox, and Daniel Ford, Anthropic, Jun 13, 2025
- AI agent orchestration patternsMicrosoft
The concurrent orchestration is also known as parallel, fan-out/fan-in, scatter-gather, or map-reduce.
- Workflow for parallelizationAmazon Web Services
- Choose a design pattern for your agentic AI systemGoogle Cloud
multi-agent parallel pattern, also known as a concurrent pattern
Added Nov 14, 2026



