docs

DE//AGENT currently lists 24 resources under docs: 24 references. Everything below is derived from the live registry — counts, capabilities, verification state and security posture come from the curated records, never from marketing copy.

Learning objectives are not yet documented for these records — curation adds them evidence-first. What the entries cover today, from their own summaries:

• The Agent Skills format specification — a SKILL.md file with front-matter (name, description, version), plus references/, scripts/, and examples/ directories that an agent loads on demand. The format this platform's Skill object is modelled on — portable across compatible agents. Covers the SKILL.md schema, the directory layout convention, and the agent loading protocol. Agent Skills (open format)
• Airflow's documentation — DAG authoring, scheduling semantics and timetables, backfills and catchup, task state and retries, dynamic task mapping, and best practices. The scheduling and best-practices pages answer the idempotency and backfill questions our orchestration skills only sketch; read them before designing any recurring pipeline. Apache Airflow Documentation
• Official Arrow docs: the columnar in-memory format, its language bindings, IPC and Flight protocols, and zero-copy interchange between systems. Use it for exact memory-layout and type-system semantics behind every "columnar" claim in the registry. Apache Arrow Documentation
• Kafka's official documentation — architecture and design, delivery semantics, the protocol, consumer groups and offsets, operations, and security. The design section explains why ordering and partitions behave the way they do; the operations section companions our lag-triage skill and consumer-lag runbook when a group falls behind. Apache Kafka Documentation
• The Parquet file format documentation: page structure, encodings, compression codecs, statistics and the predicate-pushdown behavior that columnar readers rely on. The ground truth for why columnar files scan less data and how row-group pruning works. Apache Parquet Format Documentation

These resources map to stages: Agentic Data Engineering (1), Orchestration (1), Foundations (4), Streaming (2), Data Processing (2), Cloud (4), Observability (5), Warehousing (1), Lakehouse (1), Python + SQL (2), Data Quality (1). Follow the four-phase roadmap to place this topic inside a progression instead of learning it in isolation.

Every entry, its shape and its trust state — sorted by the registry's composite score. This table is the honest version of a marketing comparison: no sponsored placements, no unverifiable claims.

12 more in the full list below.

How scores are computed: source quality score.

Highest composite score first:

1. Agent Skills (open format) score 27.7 — difficulty not documented
2. Apache Airflow Documentation score 27.7 — difficulty not documented
3. Apache Arrow Documentation score 27.7 — difficulty not documented

Scores rank provenance, completeness and trust — read how verification works before adopting anything.

• Agent Skills (open format) — The Agent Skills format specification — a SKILL.md file with front-matter (name, description, version), plus references/, scripts/, and examples/ directories that an agent loads on… details
• Apache Airflow Documentation — Airflow's documentation — DAG authoring, scheduling semantics and timetables, backfills and catchup, task state and retries, dynamic task mapping, and best practices. The schedulin… details
• Apache Arrow Documentation — Official Arrow docs: the columnar in-memory format, its language bindings, IPC and Flight protocols, and zero-copy interchange between systems. Use it for exact memory-layout and t… details
• Apache Kafka Documentation — Kafka's official documentation — architecture and design, delivery semantics, the protocol, consumer groups and offsets, operations, and security. The design section explains why o… details

Adjacent topics: official (13 shared), lakehouse (2 shared), lineage (2 shared), catalog (2 shared), spec (2 shared), formats (2 shared).

Study path: the roadmap places this topic in a progression · the scoring model explains the numbers · the trust rule catalog shows every security check these entries passed through.