Learn
orchestration
8 registry resources · 2 tutorials, 2 runbooks · roadmap: Orchestration, Reliability
What this topic covers
DE//AGENT currently lists 8 resources under orchestration: 2 tutorials, 2 runbooks, 1 skill. Everything below is derived from the live registry — counts, capabilities, verification state and security posture come from the curated records, never from marketing copy.
Also present: 1 hook, 1 template, 1 reference.
What you can learn here
Documented learning objectives across these resources:
- Scope a backfill by date and by dependency — via Backfill Planner
- Detect which downstream tables must also be rebuilt — via Backfill Planner
- Stage a backfill gradually with validation between batches — via Backfill Planner
- Name the four decisions orchestration makes — schedule, catchup, idempotency, backfill — via The orchestration mental model — DAGs, schedules, idempotency, backfills
- Apply the idempotency test to a task before running anything — via The orchestration mental model — DAGs, schedules, idempotency, backfills
- Say what a backfill is for and why it is dangerous — via The orchestration mental model — DAGs, schedules, idempotency, backfills
- Run the full four-step review pass end to end — via Capstone — the checklist that decides whether a DAG ships
- Confirm every checklist item on your own pipeline — via Capstone — the checklist that decides whether a DAG ships
1 more objectives live on the individual resource pages.
Where this fits in the learning roadmap
These resources map to stages: Orchestration (7), Reliability (1). Follow the four-phase roadmap to place this topic inside a progression instead of learning it in isolation.
Compare the registry's options
Every entry, its shape and its trust state — sorted by the registry's composite score. This table is the honest version of a marketing comparison: no sponsored placements, no unverifiable claims.
| Resource | Type | Difficulty | Verification | Score |
|---|---|---|---|---|
| Backfill Planner | Skill | advanced | community flags | 39.5 |
| The orchestration mental model — DAGs, schedules, idempotency, backfills | Tutorial | beginner | community | 34.15 |
| Capstone — the checklist that decides whether a DAG ships | Tutorial | intermediate | community | 34.15 |
| Backfill Safety Check | Hook | advanced | community | 32.6 |
| Backfill required | Runbook | advanced | community flags | 30.25 |
| Pipeline failed | Runbook | beginner | community flags | 28.75 |
| Apache Airflow Documentation | Reference | — | community | 27.7 |
| Airflow DAG Template | Template | intermediate | community flags | 27.1 |
How scores are computed: source quality score.
Where to start
Highest composite score first:
- Backfill Planner score 39.5 — advanced
- The orchestration mental model — DAGs, schedules, idempotency, backfills score 34.15 — beginner
- Capstone — the checklist that decides whether a DAG ships score 34.15 — intermediate
Scores rank provenance, completeness and trust — read how verification works before adopting anything.
Good fits
Start here if you're new: The orchestration mental model — DAGs, schedules, idempotency, backfills, Pipeline failed.
Reach for these with production experience: Backfill Planner, Backfill Safety Check, Backfill required.
Cautions and limitations
Security-flagged entries: Backfill Planner (1 flag), Backfill required (3 flags), Pipeline failed (4 flags), Airflow DAG Template (4 flags). Flags mean the record declares capabilities like credential use or write access — read the security posture on each page before connecting.
Production use cases
- Backfill Planner — Produces a backfill plan: date ranges, blast radius, resource contention, idempotency check, validation gates and rollback. details
- The orchestration mental model — DAGs, schedules, idempotency, backfills — Build the map before touching code: a DAG plus its schedule decides when runs happen, the idempotency test decides whether re-runs are safe, catchup decides what happens to missed … details
- Capstone — the checklist that decides whether a DAG ships — Close the series by running the full review pass over your own pipeline: the idempotency test per task, partitioned or MERGE writes, deliberate catchup, backoff retries, reschedule… details
- Backfill Safety Check — Refuse to start a backfill that lacks a rollback path or overlaps the daily run. details
Install and inspect
Real install commands from the registry — read the source before running any of them:
npx de-agent-platform add backfill-plannerBackfill Planner — review first
amp template new de-agent/airflow-dag ./dagsAirflow DAG Template — review first
Further study
Adjacent topics: backfill (3 shared), Apache Airflow (2 shared), tutorial (2 shared), safety (2 shared).
Study path: the roadmap places this topic in a progression · the scoring model explains the numbers · the trust rule catalog shows every security check these entries passed through.
Full resource list
| Resource | Type | Score |
|---|---|---|
| Backfill Planner | Skill | 39.5 |
| The orchestration mental model — DAGs, schedules, idempotency, backfills | Tutorial | 34.15 |
| Capstone — the checklist that decides whether a DAG ships | Tutorial | 34.15 |
| Backfill Safety Check | Hook | 32.6 |
| Backfill required | Runbook | 30.25 |
| Pipeline failed | Runbook | 28.75 |
| Apache Airflow Documentation | Reference | 27.7 |
| Airflow DAG Template | Template | 27.1 |