Data Observability

Freshness, volume, schema and distribution monitoring with automated anomaly detection. This path sequences the category's 10 resources by roadmap stage and composite score — work top-down inside each step.

Observability

1. Express a freshness check as a metric and an alert 34.15 — Express a freshness check as a metric and an alert
2. Hold the observability mental model: infrastructure metrics versus data signals 34.15 — Hold the observability mental model: infrastructure metrics versus data signals
3. Capstone: the data-platform observability checklist 34.15 — Capstone: the data-platform observability checklist
4. Instrument pipelines with OpenTelemetry: traces for data jobs 34.15 — Instrument pipelines with OpenTelemetry: traces for data jobs
5. Incident drill: a broken upstream caught by freshness and lineage 31.15 — Incident drill: a broken upstream caught by freshness and lineage
6. Production gotchas: alert fatigue, missing contracts, no-data silence 31.15 — Production gotchas: alert fatigue, missing contracts, no-data silence

4 more on the category page.

• Declare a freshness SLA and compute worst-case lag from a schedule
• Express staleness as a metric and write an alerting rule
• Configure no-data handling so silence is an alert, not a pass
• Separate infrastructure metrics from data signals — freshness, volume, schema, distribution
• Place lineage and the catalog on the observability map, next to metrics and traces
• State what each layer answers and which tool owns it
• Assemble the full stack — metrics, alerts, traces, lineage, catalog
• Gate schedule and column changes pre-merge with SLA and impact checks

Security-flagged: Incident drill: a broken upstream caught by freshness and lineage, Production gotchas: alert fatigue, missing contracts, no-data silence, Freshness Pre-Merge Check — review the security posture first. Verification on these records: 10 community. Nothing here is independently audited — the trust scan and your own review are the controls.

Phase 3 of the roadmap. Stage context: Observability · side-by-side comparison · all learning topics