Prefect acquires
Dagster Labs. Here's what it means and what comes next.
Both were founded in 2018. Both set out to replace legacy DAG orchestration. After years as direct competitors, they're now under one roof.
𝐖𝐡𝐲 𝐭𝐡𝐢𝐬 𝐦𝐚𝐤𝐞𝐬 𝐬𝐞𝐧𝐬𝐞
- Prefect is already a leader in data pipeline orchestration, known for dynamic execution-focused workflows. They also built FastMCP. The most widely adopted MCP frameworks.
- Dagster championed declarative, asset-first orchestration. Elegant for complex data platforms, but the paradigm shift has limited mainstream adoption.
- Together they have arguably become the innovation leaders in orchestration.
FastMCP gives them the credibility with enterprises when it comes to AI Agents.
𝐊𝐞𝐲 𝐚𝐜𝐪𝐮𝐢𝐬𝐢𝐭𝐢𝐨𝐧 𝐝𝐲𝐧𝐚𝐦𝐢𝐜𝐬
Prefect is positioned to compete much more aggressively against Airflow, and right now there is a chance to win big.
Why?
Astronomer has raised roughly $400M, compared with about $50M for Prefect. Commercially they're much larger. But money isn't the whole story. The center of innovation has shifted toward newer platforms. Airflow still enjoys enormous awareness - helped, ironically, by last year's Coldplay scandal. But product momentum is increasingly shifting elsewhere in the ecosystem.
The Dagster engineering team is joining Prefect, but the founders are not. That tells me this is consolidation, not the next chapter for Dagster. The technology and engineering talent continue, but from here the story now belongs to Prefect leadership. It also suggests this was likely a technology and talent driven acquisition, rather than an expensive strategic purchase.
𝐖𝐡𝐚𝐭'𝐬 𝐧𝐞𝐱𝐭?
Prefect is in a strong position in data pipeline orchestration. But note that agent orchestration is a fundamentally different problem. Pipelines execute known graphs. Agents create graphs as they work, branching unpredictably, invoking tools dynamically, running for hours, recovering from failures differently.
Data orchestration is a big market and winning that would be next on Prefect's target. But the story goes further. Prefect has shown strong instincts for the AI era with FastMCP and Harmony. The ingredients are there.
Can they win data orchestration and then extend that leadership into orchestrating AI agents? That's the real question, and one that
Temporal Technologies would love them to get wrong
I will be watching carefully as orchestration is adjacent and complementary to what we do at
Nexla. Our 900+ connectors power our Task-specific MCP as well as our ETL/ELT/Streaming data pipeline capabilities. The orchestration layer often helps customers stitch it all together."