streaming

DE//AGENT currently lists 12 resources under streaming: 5 tutorials, 2 patterns, 1 mcp server. Everything below is derived from the live registry — counts, capabilities, verification state and security posture come from the curated records, never from marketing copy.

Also present: 1 plugin, 1 template, 1 runbook, 1 reference.

Documented learning objectives across these resources:

• Explain why ordering and partitions behave the way they do — via Hold the streaming mental model: events, partitions, delivery semantics
• Treat at-least-once delivery and replays as the normal case — via Hold the streaming mental model: events, partitions, delivery semantics
• Choose between lambda, kappa, and plain batch for a latency and reprocessing need — via Hold the streaming mental model: events, partitions, delivery semantics
• Configure the Kafka MCP server against a broker list — via Inspect Kafka topics and groups with the Kafka MCP server
• Inventory topics and read group lag with the four tools — via Inspect Kafka topics and groups with the Kafka MCP server
• Sample messages without leaking production PII — via Inspect Kafka topics and groups with the Kafka MCP server
• Inventory topics with /topic-info before touching lag — via Debug a Kafka stream with the Kafka Console plugin
• Triage per-partition lag and rebalance detection with /lag-triage — via Debug a Kafka stream with the Kafka Console plugin

7 more objectives live on the individual resource pages.

These resources map to stage: Streaming (12). Follow the four-phase roadmap to place this topic inside a progression instead of learning it in isolation.

Every entry, its shape and its trust state — sorted by the registry's composite score. This table is the honest version of a marketing comparison: no sponsored placements, no unverifiable claims.

How scores are computed: source quality score.

Highest composite score first:

1. Kafka MCP Server score 37.6 — advanced
2. Lambda vs Kappa (batch + stream) score 34.75 — advanced
3. Hold the streaming mental model: events, partitions, delivery semantics score 34.15 — beginner

Scores rank provenance, completeness and trust — read how verification works before adopting anything.

Start here if you're new: Hold the streaming mental model: events, partitions, delivery semantics, Inspect Kafka topics and groups with the Kafka MCP server.

Reach for these with production experience: Kafka MCP Server, Lambda vs Kappa (batch + stream), Streaming Dedup and Upsert.

Security-flagged entries: Kafka MCP Server (2 flags), Streaming Dedup and Upsert (2 flags), Kafka consumer lagging (3 flags), Kafka Console (3 flags), Kafka Streaming Job Template (4 flags). Flags mean the record declares capabilities like credential use or write access — read the security posture on each page before connecting.

Known limits: Neither, if a nightly batch genuinely meets the SLA — keep it simple (Lambda vs Kappa (batch + stream))

• Kafka MCP Server — Community server for Apache Kafka that lists topics, reads consumer-group lag, and samples messages, for stream debugging from an agent. details
• Hold the streaming mental model: events, partitions, delivery semantics — Build the vocabulary before touching a cluster: events instead of rows, partitions instead of tables, at-least-once delivery instead of exactly-once, and the lambda/kappa decision … details
• Inspect Kafka topics and groups with the Kafka MCP server — Connect an agent to a Kafka cluster through the Kafka MCP server and work through its four tools: list_topics for inventory, describe_topic for a single topic, describe_consumer_gr… details
• Debug a Kafka stream with the Kafka Console plugin — Drive the Kafka Console plugin's three commands across a lag incident: /topic-info for inventory, /lag-triage for per-partition lag and rebalance detection, and /sample-topic for a… details

Real install commands from the registry — read the source before running any of them:

kafka-mcp-server

Kafka MCP Server — review first

amp plugin add de-agent/kafka-console

Kafka Console — review first

amp template new de-agent/kafka-streaming ./streaming

Kafka Streaming Job Template — review first

Adjacent topics: tutorial (5 shared), lag (5 shared), architecture (3 shared), mcp (2 shared), plugin (2 shared), dedup (2 shared).

Study path: the roadmap places this topic in a progression · the scoring model explains the numbers · the trust rule catalog shows every security check these entries passed through.