Airflow / Orchestration

DAGs, operators, task state, retries, backfills and the difference between scheduling and dependency management. This path sequences the category's 19 resources by roadmap stage and composite score — work top-down inside each step.

Orchestration

1. Airflow DAG Reviewer 39.5 — Review a DAG for idempotency, retry safety, and backfill behaviour.
2. Backfill Planner 39.5 — Plan a backfill that doesn't melt production or corrupt the target.
3. Safe Backfill 34.75 — Safe Backfill
4. Review a DAG for idempotency and retry safety 34.15 — Review a DAG for idempotency and retry safety
5. Scaffold an idempotent DAG from the template 34.15 — Scaffold an idempotent DAG from the template
6. The orchestration mental model — DAGs, schedules, idempotency, backfills 34.15 — The orchestration mental model — DAGs, schedules, idempotency, backfills

13 more on the category page.

Documented prerequisites, deduplicated: skill-pipeline-test-author, skill-airflow-dag-reviewer.

• Make every task safe to re-run
• Choose retries and timeouts deliberately
• Predict what a backfill will do before running it
• Scope a backfill by date and by dependency
• Detect which downstream tables must also be rebuilt
• Stage a backfill gradually with validation between batches
• Apply the idempotency test to every task in a DAG
• Justify retry, timeout and concurrency settings per task

Security-flagged: Airflow DAG Reviewer, Backfill Planner, Pipeline Reviewer, Backfill required, Backfill Planner, Airflow DAG Template — review the security posture first. Verification on these records: 19 community. Nothing here is independently audited — the trust scan and your own review are the controls.

Phase 2 of the roadmap. Stage context: Orchestration · side-by-side comparison · all learning topics