Apache Iceberg

DE//AGENT currently lists 3 resources under Apache Iceberg: 2 skills, 1 project. Everything below is derived from the live registry — counts, capabilities, verification state and security posture come from the curated records, never from marketing copy.

Documented learning objectives across these resources:

• Order change events deterministically — via CDC Merge Designer
• Handle deletes (tombstones) without losing history — via CDC Merge Designer
• Make the merge idempotent under replay — via CDC Merge Designer
• Read an Iceberg metadata table to size the problem — via Iceberg Table Maintenance
• Pick a compaction strategy and rewrite interval — via Iceberg Table Maintenance
• Expire snapshots without breaking time travel — via Iceberg Table Maintenance
• Configure a logical replication slot safely — via Postgres → CDC → Kafka → Lakehouse
• Order events by LSN and dedupe before merging — via Postgres → CDC → Kafka → Lakehouse

1 more objectives live on the individual resource pages.

These resources map to stages: Streaming (2), Lakehouse (1). Follow the four-phase roadmap to place this topic inside a progression instead of learning it in isolation.

Every entry, its shape and its trust state — sorted by the registry's composite score. This table is the honest version of a marketing comparison: no sponsored placements, no unverifiable claims.

How scores are computed: source quality score.

Highest composite score first:

1. CDC Merge Designer score 39.5 — advanced
2. Iceberg Table Maintenance score 36.5 — advanced
3. Postgres → CDC → Kafka → Lakehouse score 33.65 — advanced

Scores rank provenance, completeness and trust — read how verification works before adopting anything.

Reach for these with production experience: CDC Merge Designer, Iceberg Table Maintenance, Postgres → CDC → Kafka → Lakehouse.

Security-flagged entries: CDC Merge Designer (1 flag), Iceberg Table Maintenance (2 flags), Postgres → CDC → Kafka → Lakehouse (4 flags). Flags mean the record declares capabilities like credential use or write access — read the security posture on each page before connecting.

• CDC Merge Designer — Produces a MERGE (or Delta/Iceberg merge) that applies inserts, updates and deletes from a CDC stream correctly, including out-of-order events and tombstones. details
• Iceberg Table Maintenance — Diagnoses small-file and manifest bloat and generates the compaction, snapshot expiry and orphan-file cleanup plan for an Iceberg table. details
• Postgres → CDC → Kafka → Lakehouse — Capture changes from Postgres with Debezium, stream through Kafka, and merge into a lakehouse table with correct ordering, deletes and replay safety. details

Real install commands from the registry — read the source before running any of them:

npx de-agent-platform add cdc-merge-designer

CDC Merge Designer — review first

npx de-agent-platform add iceberg-table-maintenance

Iceberg Table Maintenance — review first

Official source: Apache Iceberg (license: Apache-2.0) — start there for the canonical documentation, then come back for the vetted registry entries.

Adjacent topics: Delta Lake (2 shared), Debezium (2 shared).

Study path: the roadmap places this topic in a progression · the scoring model explains the numbers · the trust rule catalog shows every security check these entries passed through.