Roadmap · stage 6/13

Orchestration

Stage 6 of 13 · 19 resources · 1 categories

What this stage is

Orchestration is stage 6 of 13 in the DE//AGENT roadmap. It currently holds 19 resources: 10 tutorials, 2 skills, 2 agents across 1 category.

Dependencies, retries, backfills and idempotency.

Gate: You can schedule and recover a multi-step pipeline. The stage deliverable: project-dbt-warehouse-tests.

Gates are self-assessed — the roadmap does not track your progress; it tells you what to be able to do before moving on.

Sorted by composite score — provenance, completeness and trust, per the scoring model:

Resource	Type	Difficulty	Verification	Score
Airflow DAG Reviewer	Skill	intermediate	community	39.5
Backfill Planner	Skill	advanced	community	39.5
Safe Backfill	Pattern	advanced	community	34.75
Review a DAG for idempotency and retry safety	Tutorial	beginner	community	34.15
Scaffold an idempotent DAG from the template	Tutorial	beginner	community	34.15
The orchestration mental model — DAGs, schedules, idempotency, backfills	Tutorial	beginner	community	34.15
Capstone — the checklist that decides whether a DAG ships	Tutorial	intermediate	community	34.15
Fan out over date batches with dynamic task mapping	Tutorial	intermediate	community	34.15
Gate backfills with the safety check hook	Tutorial	intermediate	community	34.15
Make a DAG data-aware with reschedule-mode sensors	Tutorial	intermediate	community	34.15
Plan and execute a safe backfill	Tutorial	intermediate	community	34.15
Production gotchas — topology, timeouts, concurrency	Tutorial	intermediate	community	34.15
Wire task dependencies and retries that survive failure	Tutorial	intermediate	community	34.15
Pipeline Reviewer	Agent	intermediate	community	33.5
Backfill Safety Check	Hook	advanced	community	32.6
Backfill required	Runbook	advanced	community	30.25
Backfill Planner	Agent	advanced	community	29
Apache Airflow Documentation	Reference	—	community	27.7
Airflow DAG Template	Template	intermediate	community	27.1