official

DE//AGENT currently lists 14 resources under official: 14 references. Everything below is derived from the live registry — counts, capabilities, verification state and security posture come from the curated records, never from marketing copy.

Learning objectives are not yet documented for these records — curation adds them evidence-first. What the entries cover today, from their own summaries:

• Airflow's documentation — DAG authoring, scheduling semantics and timetables, backfills and catchup, task state and retries, dynamic task mapping, and best practices. The scheduling and best-practices pages answer the idempotency and backfill questions our orchestration skills only sketch; read them before designing any recurring pipeline. Apache Airflow Documentation
• Official Arrow docs: the columnar in-memory format, its language bindings, IPC and Flight protocols, and zero-copy interchange between systems. Use it for exact memory-layout and type-system semantics behind every "columnar" claim in the registry. Apache Arrow Documentation
• Iceberg's specification and documentation — the table format, snapshots and manifests, hidden partitioning, schema and partition evolution, and maintenance procedures like compaction and snapshot expiry. The table format is a specification, so the spec is the ground truth when engines disagree; essential reading for multi-engine shops where Spark, Trino, and warehouses share tables. Apache Iceberg Documentation
• Kafka's official documentation — architecture and design, delivery semantics, the protocol, consumer groups and offsets, operations, and security. The design section explains why ordering and partitions behave the way they do; the operations section companions our lag-triage skill and consumer-lag runbook when a group falls behind. Apache Kafka Documentation
• The Parquet file format documentation: page structure, encodings, compression codecs, statistics and the predicate-pushdown behavior that columnar readers rely on. The ground truth for why columnar files scan less data and how row-group pruning works. Apache Parquet Format Documentation

These resources map to stages: Orchestration (1), Foundations (3), Lakehouse (2), Streaming (2), Data Processing (2), Observability (3), Python + SQL (1). Follow the four-phase roadmap to place this topic inside a progression instead of learning it in isolation.

Every entry, its shape and its trust state — sorted by the registry's composite score. This table is the honest version of a marketing comparison: no sponsored placements, no unverifiable claims.

2 more in the full list below.

How scores are computed: source quality score.

Highest composite score first:

1. Apache Airflow Documentation score 27.7 — difficulty not documented
2. Apache Arrow Documentation score 27.7 — difficulty not documented
3. Apache Iceberg Documentation score 27.7 — difficulty not documented

Scores rank provenance, completeness and trust — read how verification works before adopting anything.

• Apache Airflow Documentation — Airflow's documentation — DAG authoring, scheduling semantics and timetables, backfills and catchup, task state and retries, dynamic task mapping, and best practices. The schedulin… details
• Apache Arrow Documentation — Official Arrow docs: the columnar in-memory format, its language bindings, IPC and Flight protocols, and zero-copy interchange between systems. Use it for exact memory-layout and t… details
• Apache Iceberg Documentation — Iceberg's specification and documentation — the table format, snapshots and manifests, hidden partitioning, schema and partition evolution, and maintenance procedures like compacti… details
• Apache Kafka Documentation — Kafka's official documentation — architecture and design, delivery semantics, the protocol, consumer groups and offsets, operations, and security. The design section explains why o… details

Adjacent topics: docs (13 shared), lakehouse (2 shared).

Study path: the roadmap places this topic in a progression · the scoring model explains the numbers · the trust rule catalog shows every security check these entries passed through.