Learn
spec
4 registry resources · 4 references · roadmap: Lakehouse, Foundations, Agentic Data Engineering, Observability
What this topic covers
DE//AGENT currently lists 4 resources under spec: 4 references. Everything below is derived from the live registry — counts, capabilities, verification state and security posture come from the curated records, never from marketing copy.
What you can learn here
Learning objectives are not yet documented for these records — curation adds them evidence-first. What the entries cover today, from their own summaries:
- Iceberg's specification and documentation — the table format, snapshots and manifests, hidden partitioning, schema and partition evolution, and maintenance procedures like compaction and snapshot expiry. The table format is a specification, so the spec is the ground truth when engines disagree; essential reading for multi-engine shops where Spark, Trino, and warehouses share tables. Apache Iceberg Documentation
- The Model Context Protocol Specification — definitive reference for transports (stdio, SSE, HTTP), tool definitions, resource templates, prompts, and the security model. The security section is required reading before connecting any MCP server to real data; the transport section explains stdio vs HTTP tradeoffs. The canonical reference for all MCP server implementations on this platform. Model Context Protocol Specification
- Apache Parquet documentation and specification — columnar encoding, row groups, statistics, predicate pushdown, and how to structure files for efficient reads. Understanding statistics and row-group sizing is the practical step that turns "use Parquet" into "and lay out the file like this"; pairs with small-files and lambda-vs-kappa guides. Apache Parquet Documentation & Spec
- OpenLineage documentation — the open specification for lineage events, plus integrations for Airflow, Spark and dbt. Not a tool or a service; it is a standard for emitting lineage events, which is what makes cross-tool lineage possible. Read it before wiring any line-tracking pipeline. OpenLineage Documentation
Where this fits in the learning roadmap
These resources map to stages: Lakehouse (1), Foundations (1), Agentic Data Engineering (1), Observability (1). Follow the four-phase roadmap to place this topic inside a progression instead of learning it in isolation.
Compare the registry's options
Every entry, its shape and its trust state — sorted by the registry's composite score. This table is the honest version of a marketing comparison: no sponsored placements, no unverifiable claims.
| Resource | Type | Difficulty | Verification | Score |
|---|---|---|---|---|
| Apache Iceberg Documentation | Reference | — | community | 27.7 |
| Model Context Protocol Specification | Reference | — | community | 27.7 |
| Apache Parquet Documentation & Spec | Reference | — | community | 26.7 |
| OpenLineage Documentation | Reference | — | community | 26.7 |
How scores are computed: source quality score.
Where to start
Highest composite score first:
- Apache Iceberg Documentation score 27.7 — difficulty not documented
- Model Context Protocol Specification score 27.7 — difficulty not documented
- Apache Parquet Documentation & Spec score 26.7 — difficulty not documented
Scores rank provenance, completeness and trust — read how verification works before adopting anything.
Production use cases
- Apache Iceberg Documentation — Iceberg's specification and documentation — the table format, snapshots and manifests, hidden partitioning, schema and partition evolution, and maintenance procedures like compacti… details
- Model Context Protocol Specification — The Model Context Protocol Specification — definitive reference for transports (stdio, SSE, HTTP), tool definitions, resource templates, prompts, and the security model. The securi… details
- Apache Parquet Documentation & Spec — Apache Parquet documentation and specification — columnar encoding, row groups, statistics, predicate pushdown, and how to structure files for efficient reads. Understanding statis… details
- OpenLineage Documentation — OpenLineage documentation — the open specification for lineage events, plus integrations for Airflow, Spark and dbt. Not a tool or a service; it is a standard for emitting lineage … details
Further study
Adjacent topics: docs (2 shared).
Study path: the roadmap places this topic in a progression · the scoring model explains the numbers · the trust rule catalog shows every security check these entries passed through.
Full resource list
| Resource | Type | Score |
|---|---|---|
| Apache Iceberg Documentation | Reference | 27.7 |
| Model Context Protocol Specification | Reference | 27.7 |
| Apache Parquet Documentation & Spec | Reference | 26.7 |
| OpenLineage Documentation | Reference | 26.7 |